ST is providing a red-green-blue-infrared (RGB-IR) global shutter sensor for use with Eyeris' portfolio of deep neural network software that covers such functions as Driver Monitoring Systems (DMS), Occupant Monitoring Systems (OMS), child presence detection, object recognition, gesture control, and activity prediction.
ST's 2.3 megapixel VG5761 global-shutter sensor features a dynamic range of 98dB so that it can capture images inside a vehicle under all lighting and environmental conditions.
The VG5761 offers two memory zones that allow double-image storage which, in addition to contributing to the high dynamic range, supports background removal without lag effects and additional processing by the host system. In its RGB-IR version, ST’s image sensor uses modulation transfer functions at near-infrared wavelengths as well as through the RGB channel to monitor the full in-cabin scene under a broad range of lighting environments.
This aids the capability to analyze interior safety-critical regions of interest (ROIs) such as the driver's eyes and the occupants' body key-points -- to detect the earliest signs of driver drowsiness or distraction and occupants' body posture.
Related links and articles: