Laser diode maker Lumentum has teamed up with chip designer Ambarella on a reference design that uniquely combines edge artificial intelligence (AI) with privacy for smart building applications.
The Vision-D design combines Lumentum’s flood illuminator module for extremely accurate time-of-flight (ToF) 3D sensing with Ambarella’s low power CV22 edge AI SoC.
This combination allows small AIoT sensors with local processing to be blanketed across buildings for applications such as occupancy monitoring, intelligent space management and smart retail. Additionally, ToF 3D sensing maintains privacy by generating a point cloud with granular 3D information, but without any personally identifiable information, for applications such as healthcare.
The vast majority of occupancy systems are based on passive infrared sensors (PIRs) that provide only basic information about occupants and the building environment, while a small number are using cameras that capture identifiable features.
The joint reference design opens up possibilities for adding intelligent sensing with AI processing smarts at the edge, while offering privacy and avoiding the high cost of cloud computing. Integrating intelligence directly onto these sensing nodes allows functionality and scalability, such as the creation of digital twins for automated real-time space utilization or hot desking in shared workspaces. Other applications include traffic-based hospitality staffing, cleaning and maintenance alerts to address the labour shortage, and maximized energy efficiency through the fine-tuned usage of HVAC and lighting systems.
“There are currently two choices for occupancy sensing in building automation systems—basic motion-detection devices that preserve privacy, or intelligent camera-based systems that compromise privacy,” said Jerome Gigot, Senior Director of Marketing at Ambarella. “This joint reference design combines Lumentum’s high-performance flood illuminator module with our CVflow edge AI SoC to provide a novel solution for digital transformation that protects occupant privacy.”
“The use of sophisticated building automation and occupant monitoring solutions is expanding rapidly, driven by home healthcare and monitoring for the world’s growing senior population, efficient building usage with hybrid work schedules, and other increasingly important applications,” said Ken Huang, Director of Product Line Management at Lumentum. “This innovative reference design uniquely addresses key requirements of building automation and occupant monitoring systems by providing rich data sets and processing power while being unobtrusive in terms of both size and privacy.”
The CV22 supports multiple image sensor inputs with peripheral interfaces for a broad range of other sensors, including humidity, temperature and audio. The Lumentum 10 W flood illuminator module incorporates a high-performance, three-junction vertical-cavity surface-emitting laser (VCSEL) array for ToF 3D sensing.
This enables smart PIRs for home security that are able to differentiate pets from intruders; hotel environmental and scheduling systems that can intelligently adjust the HVAC temperature in reserved rooms based on real-time occupancy; and remote monitoring of aging parents without invading their privacy. Regardless of the location, AI algorithms running on the reference design can monitor occupants for sudden falls or medical events, intelligently and immediately triggering a request for emergency services.
- Ambarella to acquire adaptive radar perception specialist
- Lumentum to acquire Oclaro for $1.8bn
- II-VI crashes $6bn Coherent laser deal
Other articles on eeNews Europe
- RISC-V reference design for Intel FPGA module
- MIT launches AI hardware programme
- Synopsys boosts chip design with cloud platform
- Glass processors aim to boost edge AI