NewsEnhanced Deep Learning Performance In Vehicle Monitoring Systems

Enhanced Deep Learning Performance In Vehicle Monitoring Systems

Category articles

Delivering significantly improved deep learning performance for smart camera applications, including driver and occupant monitoring systems (DMS/OMS), automotive front cameras, surround view and auto parking for high-volume vehicles up to Level 2+ is the R-Car V3H system-on-chip (SoC). 

Building on the state-of-the-art recognition technology, which includes integrated IP for convolutional neural networks (CNN), the R-Car V3H delivers 4x performance for CNN processing and achieves up to overall 7.2 TOPS processing including all computer vision IPs while maintaining low power consumption levels.

The highly integrated SoC supports up to ASIL C metrics safety goals on the real-time domain, reducing the need for an external safety microcontroller (MCU) to manage sensor fusion and final decision-based actions. The R-Car V3H features a suite of proven IPs that support the perception stack, sensor fusion with radar and/or Lidar and ISP with up to eight MP cameras support, allowing OEMs and Tier 1s to achieve quicker time to market with lower bill of materials costs.

 Key Features

  • Delivers up to 7.2 TOPS, including 3.7 TOPS for CNN, with optimised performance-to-power balance
  • Supports ASIL D development process for systematic capability for the full SoC
  • Supports metric targets for ASIL B (sensor layer, application processors) and ASIL C (real-time domain) safety goals
  • Full hardware and software compatibility with the currently mass-produced R-Car V3H SoC
  • Integrates a full set of automotive peripherals including CAN, Ethernet AVB, and FlexRay
  • Features a full set of video processing and image recognition IP for advanced sensing and recognition, including CNN-IP, Computer vision engine, Image-distortion-correction IPs, Stereovision, Classifier and Dense Optical Flow

“The rising popularity of intelligent systems for applications, such as driver monitoring, park assist, driver recognition and occupant sensing is stoking higher demand for deep learning functions as automakers look for new ways to enable smart camera applications,” said Naoki Yoshida, Vice President of Automotive Digital Products Marketing Division at Renesas. “The updated SoC provides R-Car V3H customers a flexible, easy and cost-effective path to higher computer vision performance for next-generation front camera systems.”

The updated R-Car V3H joins an expanding lineup of SoCs, which offer OEMs and Tier 1s complete scalability from entry-level NCAP applications up to highly automated driving systems. Customers can also combine the R-Car V3H SoC with Renesas’ high-performance low-power RH850 MCU, integrated power management ICs and power transistor devices to access the key components required for more complex safety compliant systems.

Mass production of the updated R-Car V3H is planned by Renesas Electronics Corporation for first quarter of 2022

Michal Pukala
Electronics and Telecommunications engineer with Electro-energetics Master degree graduation. Lightning designer experienced engineer. Currently working in IT industry.