Enables Understandable and Improved Visibility for Surround View Systems with Unique Viewpoint Conversion and Brightness Compensation

October 13, 2011
Renesas's SoC, the SH7766, for Top View System with Image Recognition Capabilities

TOKYO, Japan, October 13, 2011 — Renesas Electronics Corporation (TSE: 6723), a premier provider of advanced semiconductor solutions, and its subsidiary, Renesas Mobile Corporation, an innovative supplier of advanced cellular semiconductor solutions and platforms, today announced the availability of its new image recognition system-on-chip (SoC), the SH7766. This solution integrates on a single chip all the required functions to implement camera based surround view system together with the display of crucial information such as lanes, signs and markings, pedestrians, vehicles, etc.

The new SH7766 SoC retains compatibility with Renesas' existing SH77650 image recognition SoC while delivering improved performance. In particular, the display functions such as viewpoint conversion and dynamic range control (brightness compensation, etc.) are enhanced. These new functions make it possible to realize applications such as clear and easily-distinguishable top-view virtual camera visualization using different viewpoints to display the changing surroundings in real time as well as monitoring functionalities such as advanced driver assistance system (ADAS). 

ADAS applications, such as lane deviation warning systems (Note 2), are becoming widespread. The other trend is the display applications for monitoring the vehicle surroundings during parking maneuver. Especially rearview monitor and top view systems are gaining in popularity. As advances are made in seamless safety support systems providing uninterrupted coverage of the area in front of the vehicle as well as its surroundings, there is demand in the field of image recognition for improved recognition technology, as a key sensing technology, and also for extended functions for providing a clear and easily understandable display to the driver.

At the same time, image recognition systems are diversifying beyond lane recognition to include simultaneous recognition of multiple objects such as signs and markings, pedestrians, and vehicles. This directly leads into an increased performance demand for image recognition engines, which must perform multiple processing tasks in parallel. An efficient architecture using a combination of CPU and specialized IP is necessary to handle the different recognition algorithms in order to distinguish objects such as persons, in all various shapes and orientations.

In response to these demands, the next-generation SH7766 image recognition SoC improves on the performance of its predecessor, the SH77650, and delivers enhanced view functions and improved image recognition engine performance.

Key features of the SH7766 SoC:

  • (1) Viewpoint conversion engine and dynamic range control for improved view functions

The SH7766 SoC integrates a hardware engine that enables new view functions such as a viewpoint conversion engine and dynamic range control. The image renderer (IMR) viewpoint conversion engine generates in real time for each video input top view images in which the viewpoint changes with the surroundings. The dynamic range control (DRC) function, even when handling multiple video feeds with large brightness differences due to sunlight and shade, adjusts the composite video brightness to compensate for indistinctness in both very bright and very dark portions, presenting the driver with a display that is as easy to see as possible.

The SH7766 SoC also implements 2-D graphics (optionally 3-D graphics engine, Note 3) capabilities, making it possible to realize an unprecedentedly high-level user interface by overlaying sophisticated graphical elements onto the video from the cameras.

  • (2) IMP-X2 next-generation image recognition engine

The SH7766 SoC features the IMP-X2 next-generation image recognition engine. The IMP-X2 retains library compatibility with Renesas' existing image processing engine (IMP) while boosting processing performance over fourfold. This enables it to perform multiple processing tasks in parallel, such as tracking of lanes, signs and markings, pedestrians, and vehicles. It adds new functions such as integral image generation, which makes extensive use of image recognition algorithms requiring determination of pedestrians, vehicles, etc., and cooperates on determination processing with the CPU on the same chip, making possible a high level of image recognition performance while keeping power consumption low.

  • (3) Six video input channels, including four channels with integrated NTSC ADCs, for reduced system coste

The SH7766 SoC has six video input channels. Of these, four channels incorporate NTSC analog-to-digital converters (ADCs). This means that the capabilities necessary for an NTSC camera system are provided on a single chip. It is also possible to make use of the six video input channels to implement multiple applications using the capabilities provided on a single chip. For example, two digital channels could be used during normal driving, switching as necessary to four NTSC channels at intersections, when parking, etc.

The new SH7766 SoC shares its architecture, IP, and software with the Renesas R-Car series of SoCs for vehicle information terminals and it can be extended to applications such as navigation systems and vehicle information terminals equipped with image recognition and viewpoint conversion functions.

The technologies of the new SH7769 SoC will continue to be applied to Renesas' future R-Car series of SoCs for car infotainment systems.

Refer to the separate sheet for the main specifications of the SH7766.

(Note 1) Next-generation top view monitoring:

A type of application that displays the vehicle surroundings to the driver in an easy-to-follow format, employing image recognition technology to prevent important information from being overlooked.

(Note 2) Lane deviation warning system:

A typical ADAS system that monitors the lanes as the vehicle proceeds and warns the driver when deviation occurs.

(Note 3) 3-D graphics engine: Imagination Technologies' advanced 3D graphics IP core, the POWERVR™ SGX530, can be implemented in the 3D graphics engine as an option.

Pricing and Availability

Samples of the SH7766 SoC will be available in November 2011, priced at US$50 per unit. Mass production is scheduled to begin in September 2013 and is expected to reach a production volume of 100,000 units per month by September 2014. (Pricing and availability are subject to change without notice.)

(Remarks) POWERVR and SGX are trademarks or registered trademarks of Imagination Technologies Limited. (UK). Other product and service names that appear in this press release are trademarks or registered trademarks of their respective owners. 

About Renesas Electronics Corporation

Renesas Electronics Corporation (TSE: 6723) delivers trusted embedded design innovation with complete semiconductor solutions that enable billions of connected, intelligent devices to enhance the way people work and live. A global leader in microcontrollers, analog, power,and SoC products, Renesas provides comprehensive solutions for a broad range of automotive, industrial, infrastructure, and IoT applications that help shape a limitless future.Learn more at renesas.com.Follow us on LinkedIn, Facebook, Twitter, and YouTube.


The content in the press release, including, but not limited to, product prices and specifications, is based on the information as of the date indicated on the document, but may be subject to change without prior notice.