Ambarella teams for transformer automated driving software stack
Ambarella has teamed up with AI-based driver assistance and autonomous driving (AD) software developer Plus to use transformer models on its CV3 chip.
PlusVision is a high-performance transformer-based AD perception software stack with low power consumption that now runs on the Ambarella CV3-AD AI domain controller family of systems-on-chip (SoCs).
The birds-eye-view vision technology developed by Plus enables OEMs to offer L2+ and L3 autonomy for the next generation of vehicle models with the same perception software. The Ambarella CV3 system on chip is being used by Kodiak for self-driving trucks and by Sany for autonomous construction vehicles. It is also being used by Bosch and Chinese car maker Leapmotor which is workinf with Stellantis for vehicles for Europe.
PlusVision is the transformer-based, deep neural network AI perception software that combines Plus’s L4 perception capabilities with an extensive and diverse dataset. Plus’s AD stack has accumulated millions of real-world driving miles in the U.S., Europe and Australia.
This data collection has made PlusVision smarter, enabling incredibly information-rich output that helps OEMs develop and fine-tune detailed autonomous driving policies. Implementing uniform perception software is key to enabling these data-driven, custom policies across different vehicle models and trim levels.
The PlusVision stack, running on a mid-range CV3-AD655 SoC, is capable of delivering peak performance of 11 cameras being simultaneously processed at 30 frames per second. This provides more than 200m of front-camera detection range, enabling the long-distance perception that is crucial in high-speed driving conditions.
The Plus and Ambarella teams collaborated to optimize the transformer-based PlusVision model for the CVflow AI engine inside the CV3-AD SoCs with low power AI processing. The processing performance provides OEMs with additional headroom to integrate other software and create differentiated features.
“We are delighted to collaborate with Ambarella in offering PlusVision’s leading-edge perception capabilities on their CV3-AD SoCs,” said David Liu, CEO and co-founder at Plus. “This combination will provide Tier-1s and OEMs with a flexible, high-performance and power-efficient perception solution, enabling them to create a future-proof platform that can be adapted for their evolving autonomy needs.”
“Our collaboration with Plus offers Tier-1s and OEMs additional cutting-edge transformer-based AI perception software solutions, to help accelerate their next-generation vehicle development,” said Fermi Wang, president and CEO of Ambarella. “This is a pivotal time for the automotive industry, and solutions like this give Tier-1s and OEMs the flexibility to efficiently differentiate their offerings and maximize customer value.”
If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :
