140GHz radar leverages AI for intuitive user interfaces
The radar 140GHz operates up to a range of 10m, with 15mm range resolution and 10GHz of RF bandwidth. Multiple antenna paths are incorporated to enable a complete (virtual) 1×4 MIMO configuration to achieve angular target separation. The transceiver chip features on-chip antennas, and are integrated in 28nm bulk CMOS technology, ensuring a low-cost solution at high volume production.
By adding machine learning capabilities, imec has also demonstrated the radar’s capability to detect and classify small motions based on Doppler information.
“This opens new opportunities, for example, enabling gesture recognition for intuitive man-machine interactions”, explains Barend van Liempd, R&D manager at imec. “Think about the AR/VR space, where the new radar can support intuitive interaction with virtual objects. Gesture recognition can potentially also enable intuitive device control – complementary to existing interfaces such as voice control or smart touch screens.”
Being insensitive to lighting conditions and preserving privacy (a radar can so far not recognize humans), a radar solution has particular advantages over other types of motion sensors, for example time-of-flight-based infrared cameras. And, being extremely compact, the 140GHz radar system can be integrated invisibly in almost every device, such as laptops, smartphones or screen bezels.
Imec has developed a specific machine learning algorithm based on a multi-layer neural network including an LSTM layer and using supervised learning to train the inference model by using in-house labelled recordings of more than 25 people, including several captures for each of 7 different gestures. Against the experimental dataset, the model classifies the recorded 7 gestures and predicts the right gesture at least 94% of the time.
Aside from gestures, vital signs can also be measured with very high precision thanks to the high radio frequency. Therefore, the radar is an excellent candidate for in-car vital sign monitoring systems, to enable non-contact tracking of the driver’s state, e.g. to detect falling asleep, abnormal stress levels or possibly to prevent accidents due to acute health hazards, e.g. heart or epilepsy attacks. Another possible application is to monitor small children using motion and vital signs detection, even when the infant is covered by a blanket and asleep, e.g. to provide an alert in case a child is unintentionally left in a vehicle.
To enlarge data richness and spatial information, imec is currently building a 4×4 MIMO radar system, for which a new generation of radar chips is under development – incorporating the TX and RX as separate chips. This will allow a greater flexibility in distributing the MIMO array elements across the available area.
Imec – www.imec.be
Related articles:
140GHz CMOS radar has on-chip antennas
Sub-mW radar chip supports presence detection up to 15m
IDT, Steradian form mmWave partnership
Machine-learning radars may be coming to automotive
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
