Toyota Connected detects occupants by means of mm-wave tech
The Cabin Awareness concept takes a unique approach to in-vehicle occupant detection using a 4D imaging radar sensor, mounted out of sight above a vehicle’s headliner that can detect presence of a life form in the vehicle, even after a driver exits.
Specifically, the Cabin Awareness concept has the capability to sense micro movements, such as a heartbeat, motion and respiration of occupants across three full seating rows, the cargo area and footwells. It also classifies all occupants according to size, posture and position – a feature that enables advanced safety applications. The platform provides robust sensing even if the occupant is covered with a blanket, a scenario in which a passerby would be unable to see the occupant. It differs from other technologies on the market such as weight sensors, that can be prone to false alerts and mis-detects, cameras limited by blind spots or other radar systems with a limited range of passenger detection.
- Interior monitoring system offers multifunctionality on single chip platform
- First MIMO single RFIC 4D imaging radar
- High-res mmWave tracler module uses 4D imaging radar
While Cabin Awareness is currently a concept, the feature is getting a real-world trial through Toyota’s partner May Mobility. The autonomous-vehicle company is testing the technology in its fleet of Toyota Sienna AutonoMaaS (Autonomous Mobility as a Service) minivans at its headquarters in the U.S. state of Michigan and will soon begin testing in public AV deployments in Arlington, Texas, and Ann Arbor, Michigan, with additional deployments coming in late 2022. Recently, May Mobility announced that a portion of the fleet will be modified to become ADA-compliant and accommodate passengers in wheelchairs.
In the future, one possible application for autonomous shuttles is alerting parents when their children complete a ride. Conversely, a shuttle may delay driving to its next stop if it senses someone is still in the vehicle upon reaching its destination.
“The key difference with this system is the improved resolution and accuracy, full-cabin detection and scope of functionality Cabin Awareness provides,” said Simon Roberts, managing engineer, TCNA, who has spearheaded the development process. “With the precision of these sensors, we’re designing Cabin Awareness with the aim of reducing false positives and false negatives.”
In 2021 in the U.S., 23 children died from heat stroke after being left in vehicles, according to the nonprofit Kids and Cars. On average, one in four children that die in a hot car obtained access to the car while it was unattended or not operational. Depending on the circumstances, the inside of a car can get up to 52°C in minutes even when outside temperature is as low as 16°C. Studies show children’s body temperatures rise three to five times faster than adults. If left in a vehicle during the summer, the inside cabin temperature can reach dangerous levels in just 10 minutes.
As currently designed, the Cabin Awareness concept provides an array of warnings – from light signals at the cluster to honking the horn and notifying the owner by phone – to help alert the driver (and potentially, passersby) to check the back of the vehicle if a living being is detected.
The development team is continuing to explore additional notification alerts such as vehicle-to-vehicle (V2V) communications and the incorporation of smart infrastructure retail signage to further expand the reach of this alert.
The idea for Cabin Awareness was born in 2019 out of the inaugural Toyota Connected Hackathon, a 36-hour innovation event that challenged teams of software designers and engineers to ideate, develop and test real-world solutions. This winning idea grew support following the Hackathon.
The Cabin Awareness concept also allowed Toyota Connected to evaluate and develop hardware in addition to building the respective software systems and creating new processes. The Toyota Connected team evaluated millimeter-wave suppliers and began working with technology provider Vayyar Imaging’s in-cabin monitoring platform.
Vayyar’s high-resolution, single chip, 4D imaging radar is, according to the Toyota Connected engineers, currently the only solution on the market that has the capability to monitor an entire vehicle cabin with a single sensor. The platform provides exceptionally dense point cloud imaging, enabling developers to independently develop a wide range of advanced applications and deploy them remotely using over-the-air software updates.
Related articles
ASIC integrates ISP, neural processing unit for occupant monitoring systems
AI-enabled ASIC brings high processing power to driver monitoring systems
Omnivision, SmartEye roll comprehensive interior sensing solution
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
