SoC handles in-car camera video with reduced latency

SoC handles in-car camera video with reduced latency

Feature articles |
By eeNews Europe

R-Car T2 system-on-a-chip (SoC) is an SoC dedicated for Ethernet AVB-enabled vehicle camera networks, complementing the company’s R-Car Family devices for infotainment, instrument cluster and ADAS (Advanced Driver Assistance System) applications. The R-Car T2 enables the delivery of high-resolution camera video through multiple systems while maintaining real-time performance with low latency levels. These capabilities are key to providing the “surround view” monitoring and obstacle detection applications that contribute to safe driving experiences.

Initially used for rear-view functionality and parking assistance applications, the use of vehicle cameras has since expanded to support 360-degree “surround view” functionality that expands what is seen by the system to every direction around the vehicle, helping to improve driver safety. Vehicle camera video is also now being used in driver assist systems for braking, steering and providing obstacle detection warnings, for instance when changing lanes. These sophisticated systems demand substantially higher processing performance in order to handle the expanded range of image recognition targets and increased processing load imposed by multiple cameras with higher pixel counts. Ethernet AVB offers features such as guaranteed bandwidth and synchronisation of multiple cameras simultaneously, and a system involving additional cameras that can be flexibly upgraded.

The R-Car T2 supports multiple standards, including IEEE 802.1AS, IEEE802.1Qav, IEEE802.1Qat, and IEEE1722. The R-Car T2 SoC features a built-in H.264 encoder developed by Renesas to provide low-latency compression while maintaining real-time high-quality HD video (1,280 × 960) transfer. Video can be compressed with extremely low latency of less than 1 msec and delivered to multiple systems through the networks to vehicle systems. The high quality and real-time transfer create a high level of safety, making it possible to rapidly share camera footage with the advanced driver assist systems.

Previously, with the popularity of Ethernet as an easy-to-use network standard that allows video to be transferred to multiple systems, video compression was necessary as the maximum bandwidth supported by UTP cable is 100 Mbps, and latency was an issue in applications such as driver safety assist systems. Renesas says it has succeeded in reducing the latency time to less than 1 msec, which is equivalent to a movement distance of 2.8 cm when driving at 100 km/h. This enables nearly real-time data transfer, allowing use in driver safety assist systems and making it possible to switch from the current LVDS system to Ethernet.

Renesas Electronics Europe;

next page; further SoC detail…

R-Car T2 SoC is :

– Compliant with four Ethernet AVB standards for enabling vehicle camera video sharing among multiple displays. Previously, in camera systems adopting analog or LVDS signal transfer, the video processing was concentrated peer-to-peer in a single processing device such as a navigation system or a meter cluster. With Ethernet AVB, however, video signals from multiple cameras can be distributed in parallel to multiple processing devices. This means that video from the cameras can be used by multiple displays and driver assist systems, among others. It also enables the camera networks to be configured flexibly for different vehicle grades or option packages, for example, by increasing the number of cameras or adding displays. Ethernet AVB standard also supports the use of Power over Ethernet (PoE).

– Low-latency transfer of high-quality HD video that contributes to increasing the value of the car by video recognition. Developed by Renesas, the built-in ultra-low-latency H.264 encoder has adopted the Ethernet AVB standard with real-time transfer of digital HD signals. The improved camera quality enhances visibility and aids in driver oversight prevention, for example, while the real-time performance better meets the safety requirements for driver assist systems that detect pedestrians and obstacles.

– Ultra-low power consumption and small-size form factor for more power-efficient and compact camera modules. The R-Car T2 features power consumption as low as 40 mW (typ.), which reduces heat concerns for a sealed camera module designed to keep out moisture and dust. At 6 mm square in size, the small form factor fits in camera modules designed to take up minimal space and contributes to flexible design.

Renesas Electronics Europe;

If you enjoyed this article, you will like the following ones: don't miss them by subscribing to :    eeNews on Google News


Linked Articles