Renesas Electronics and its subsidiary, Renesas Mobile Corporation announced the availability of their image recognition system-on-chip (SoC) SH7766. This solution integrates on a single chip all the functions required for the implementation of camera-based surround view systems together with the display of crucial information such as lanes, signs and markings, pedestrians, vehicles, etc.
The SoC retains compatibility with Renesas’ existing SH77650 image recognition SoC while delivering improved performance. In particular, the display functions such as viewpoint conversion and dynamic range control (brightness compensation, etc.) have been enhanced. These functions make it possible to develop applications with clear top-view virtual camera visualization. These can use different viewpoints to display the changing surroundings in real time and provide monitoring functionalities such as advanced driver assistance systems (ADAS).
The device integrates a hardware engine that enables new view functions such as a viewpoint conversion engine and dynamic range control. For each video input, the image renderer (IMR) viewpoint conversion engine generates in real time top view images in which the viewpoint changes with the surroundings. The dynamic range control (DRC) function adjusts the composite video brightness to compensate for indistinctness in both very bright and very dark portions, even when handling multiple video feeds with large brightness differences due to sunlight and shade.
As a result, the driver with a display that is easy to see in all lighting conditions. The SH7766 also implements 2-D graphics capabilities (optionally a 3-D graphics engine), making it possible to develop an exceptionally high-level user interface by overlaying sophisticated graphical elements onto the video from the cameras.
The SH7766 features the IMP-X2 next-generation image recognition engine. The IMP-X2 retains library compatibility with Renesas’ existing image processing engine (IMP) while boosting processing performance more than fourfold. This enables it to perform multiple processing tasks in parallel, such as tracking lanes, signs and markings, pedestrians, and vehicles. It adds new functions such as integral image generation, which makes extensive use of image recognition algorithms for distinguishing pedestrians, vehicles, etc. It shares determination processing with the CPU on the same chip, making possible a high level of image recognition performance while keeping power consumption low.
The SoC has six video input channels. Of these, four channels incorporate NTSC analogue -to-digital converters (ADCs). This means that the capabilities necessary for an NTSC camera system are provided on a single chip. It is also possible to make use of the six video input channels to implement multiple applications using the capabilities provided on a single chip. For example, two digital channels could be used during normal driving, switching as necessary to four NTSC channels at intersections, when parking, etc.
The chip shares its architecture, IP, and software with the Renesas R-Car series of SoCs for vehicle information terminals. It can be extended to applications such as navigation systems and vehicle information terminals equipped with image recognition and viewpoint conversion functions.
Samples of the SH7766 SoC will be available in November 2011. Mass production is scheduled to begin in September 2013 and is expected to reach a production volume of 100,000 units per month by September 2014.
