
Proof of concept brings augmented reality to driver monitoring systems
Icarus is a proof-of-concept for advanced DMS mounted in the instrument cluster or A-pillar. The ams Osram 3D sensor system provides high-resolution depth maps (<±0.5% depth accuracy at a range of 45-70cm) using Structured Light. This includes an in-house depth extraction algorithm that will enable customers with specific product developments to achieve higher performance in the future. The system is based on near infrared (NIR) surface emitting lasers (VCSEL) and ams Osram point pattern projectors.
Customers can use their DMS software in conjunction with the accurate depth map of the driver’s face to determine the 3D position of the driver’s eyes and head posture. This 3D position information can then be used for high-quality driver monitoring functions such as AR-HuD and driver authentication. To this end, the system’s accurate 3D measurement of the driver’s head position also supports the implementation of software to detect microsleep and other advanced signs of drowsiness that pose a risk to road safety.
With the Icarus concept, the chipmaker aims to demonstrate to automotive designers that there is a straightforward and cost-effective way to upgrade DMS designs that use 2D NIR sensing to a full-featured, high-quality 3D sensing system. The upgrade requires only the addition of an NIR point pattern projector and supporting depth extraction software.
According to Firat Sarialtun, Global Segment Manager for In-Cabin Sensing at ams Osram, the Structured Light sensor technology has already proven itself in consumer markets. There, for example, it is used for secure face authentication in mobile phones. In the automotive sector, however, 3D sensing has so far only been implemented with special indirect time-of-flight (iToF) cameras.
Related articles:
„Holokraktor“ demos potential auf Augmented Reality in the car
Infineon and pmdtechnologies develop 3D depth-sensing for AR
Top augmented reality trends of 2022
Augmented reality facilitates helicopter landings on ships
Holographic head-up display brings augmented reality into the car
