RT-RK - Expertise on Renesas' Computer Vision and CNN

• Computer Vision:
  • CVe: MTMD parallelization
  • IMPc: configurable pre-processing-post pipeline (100 transformations)
  • PSC: pyramidal image scaling
  • Memory Pipeline: DDR - scratchpad - LWM
• Deep Learning:
  • CNN FE: improving configurability and usage of CNN Toolchain
  • CNN FW: from Caffe model to optimized forward propagation
  • Custom Layer - development: Fully Connected, Convolution 1x1, other on demand
  • CNN Toolchain – customer integration support of Renesas tailored ISP for Human Vision and Machine Vision
• VisionIP:
  • Stereo Block Matching IP – usage and configuration
  • Optical Flow IP – usage and configuration
  • Classifier IP - usage and configuration
• Image Processing:
  • IMR – camera capture integration into pipeline
  • ISP – usage and configuration, customization, development of advanced pipelines
• Training:
  • Basic: introduction of Renesas I/Ps, tool chain, vision pipeline
  • Advanced: focus on machine learning and CNN I/P

Applications

• Front Smart Camera for NCAP
• Surround View System
• Driver Monitoring System
• Autonomous Drive
• Intelligent Survey Camera
• Industrial Application
• Passenger Car, Commercial and Off-road Vehicles