Driver monitoring ASIC adds AI and DDR3 memory for Euro NCAP
OmniVision Technologies has launched an entry level AI stacked die system-in-package for driver monitoring systems (DMS) and FaceID security based around four ARM Cortex A5 cores.
The OAX8000 uses a stacked-die architecture to provide the industry’s only DMS processor with on-chip DDR3 SDRAM memory (1GB). This is also the only dedicated DMS processor to integrate a neural processing unit (NPU) and image signal processor (ISP), which provides dedicated processing speeds up to 1.1 trillion operations per second for eye gaze and eye tracking algorithms.
The fast processing speeds with 1K MAC of convolutional neural network (CNN) acceleration, along with integrated SDRAM, enable the lowest power consumption available for DMS systems— at 1W. The system-in-package integration into a BGA196 package also reduces the board area for the engine control unit (ECU).
The market for DMS driver monitoring is expected to see a 56 percent annual growth between 2020 and 2025 says Yole Développement, driven by the European Union’s Euro NCAP requirement that all new cars sold in the region have a DMS camera by 2022.
“Most DMS processors on the market today are not dedicated to this application, requiring added circuitry to perform other system functions that consumes more power, occupies more board space and doesn’t allow room for on-chip SDRAM,” said Brian Pluckebaum, automotive product marketing manager at OmniVision. “By focusing the design of our OAX8000 ASIC on entry-level DMS, we were able to create the automotive industry’s most optimized solution.”
The OAX8000’s on-chip NPU is developed in-house and supports the popular TensorFlow, Caffe, MXNet and ONNX tool chains. The quad Arm Cortex A5 CPU cores have Neon signal procesing extensions for accelerated video encoding/decoding and on-chip video analytics algorithms, along with hardware for image processing, video encoding and RGB/IR processing. The high dynamic range (HDR) processing capability allows the ASIC to accept input from RBG/IR image sensors and support high quality output, for videos taken during the day or at night, in conditions with widely contrasting bright and dark images.
Boot-up time for the OAX8000 is significantly faster than previous parts to eliminate any delay between ignition and activation of the DMS camera. “The typical boot times we’ve witnessed are within 1 second. There are some implementation dependencies that will affect the time, but not severely,” said the company. It also supports secure boot features to provide cybersecurity.
The integrated video encoder accepts up to 5 megapixel captures from OmniVision’s automotive image sensors, and outputs up to 2K resolution video at 30 frames per second (fps).
As well as driver monitoring, the device can be used for processing occupant detection algorithms, such as distinguishing a baby from a grocery bag, and providing alerts when objects are left behind in the vehicle. It be also used in automotive video security systems to perform functions such as FaceID, as well as preset driver-comfort settings (e.g., seat position) that are activated when the DMS first scans the driver’s face.
Samples of the OAX8000 are available now in a BGA196 package. It is AEC-Q100 Grade 2 certified for automotive applications.
Related articles
- VOLVO TAPS FINNISH VR TECH FOR VEHICLE SIMULATOR
- AUSTRALIA’S SEEING MACHINES MOVES INTO ASIC IP
- SUPERRESOLUTION ADDED TO WORLD’S SMALLEST CAMERA MODULE FOR MEDICAL IMAGING
- FIRST MEDICAL IMAGE SENSOR TO COMBINE RGB AND IR SLASHES SIZE AND POWER
Oher articles on eeNews Europe
- Unsupervised in-memory AI learning goes digital
- Maxim teams for wearable medical monitor tech
- Dual core Xtensa chip for the AIoT
- Netherlands creates €30m hyperloop project
- Long distance detection of copper cable thefts
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
