Automotive SoC combines 500 eTOPS with high-res image and radar processing

Automotive SoC combines 500 eTOPS with high-res image and radar processing

New Products |
By Christoph Hammerschmidt

The CV3 domain controller family represents a 42x increase over Ambarella’s prior automotive family. Featuring up to 16 Arm Cortex-A78AE CPU cores, the CV3 provides up to a 30x boost in CPU performance over the prior generation in support of autonomous vehicle (AV) software applications. According to Ambarella, this product family enables centralized, single-chip processing for multi-sensor perception, including high-resolution vision, radar and ultrasonic. In addition, it empowers deep fusion for multiple sensor modalities and AV path planning. The result is robust ADAS and L2+ to Level 4 autonomous driving (AD) systems with greater levels of environmental perception in challenging lighting, weather and driving conditions for both driver viewing and machine perception.

“With our CV3 AI domain controller family, we are now capable of running the full ADAS and AD stack with a single chip, while providing unprecedented performance and power efficiency,” says Ambarella CEO and President, Fermi Wang. “Through enhancements to our on-chip ISP, along with simultaneous radar processing that can take advantage of our Oculii adaptive AI algorithms, Ambarella is helping the automotive industry unlock greater levels of perception accuracy across all environmental conditions to realize the promise of autonomous driving.”

The CV3 marks the debut of Ambarella’s next-generation CVflow architecture, which continues the company’s algorithm-first design philosophy. This drove the development of the on-chip neural vector processor (NVP), with up to 500 eTOPS of AI compute, high power efficiency and support for the latest advancements in neural network (NN) inferences. The NVP is also enhanced to run advanced radar perception software, such as the Oculii adaptive AI software algorithms. This is complemented by a new floating-point general vector processor (GVP) designed to offload classical computer vision and radar processing from the NVP engines, and floating-point-intensive algorithms from the Arm CPUs.

The CV3 family’s hardware scalability allows customets to unify their software stacks across their entire retail portfolios, while reducing the cost and complexity of software development, Ambarella promises. With this scalability, the company hopes to address the rising complexity of automotive software by providing an alternative to the fragmented ADAS SoC offerings from competitors. Additionally, the CV3 family accelerates automakers’ development timelines while simplifying the deployment of new features by providing the headroom for a single, robust over-the-air (OTA) update implementation.

The product family has multiple options to meet the strategies of OEMs and Tier 1s, alike, from its low-power SoCs for regulatory-class, forward-facing cameras, scaling up to premium SoCs for Level 4 fully automated driving. Likewise, It supports both central and zonal architectures. In addition to covering the whole AD stack, the CV3 can simultaneously process in-cabin sensing applications, including driver and occupant monitoring.

The CV3 also integrates Ambarella’s next-generation ISP, helping to drive image signal processing quality to new levels. By simultaneously supporting up to 12 physical or 20 virtual cameras, a single CV3 can process the entire sensor suite, which for typical L2+ deployments includes 10 cameras, five radar modules and numerous ultrasonic sensors. Additionally, higher-performance stereo and dense optical flow engines provide greater depth and motion perception.

Additional features of the new CV3 central domain controller family include:

  • Automotive GPU for applications such as 3D surround-view rendering
  • Hardware security module, enabling the isolation of different domains and secure software provisioning
  • PCIe high-speed interfaces for ultra-low-latency communications
  • Processing headroom for OTA software updates and testing software stacks in shadow mode

The first SoCs in the CV3 family are expected to be available for sampling during the first half of 2022.

Related articles:

Mobileye develops single-chip supercomputer for autonomous driving

Radar crucial for autonomous driving, studies say

Ambarella to acquire radar AI firm for $300 million

Camera chip uses AI for monitoring applications

If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :    eeNews on Google News


Linked Articles