Recently, the importance of Driver Monitoring Systems (DMS) and Occupant Monitoring Systems (OMS) are well recognized when it comes to autonomous driving (AD) because the driver is still responsible for driving under certain conditions up to Level 3. Moreover, DMS is playing an important role for carmakers to get a 5-star safety award in Euro-NCAP written in its Roadmap 2025 and already used in its 2020 rating. The European Union is to mandate DMS for new models by 2022, and other regions are expected to follow. Similarly, mandated OMS features like child presence when leaving the car are imminent for North America and Europe (i.e. 5-star on 2022 Euro-NCAP).
One of important market trend for DMS&OMS is RGB-IR sensor, which consists of RGB sensor and IR one where color image and IR image can be outputted. IR is very important since there is less illumination inside vehicle in the night. IR image can detect the driver status under the bad condition for RGB sensor. That’s why RGB-IR can take advantages of both RGB and IR.
In order to meet such like a market trend, Renesas is committed to DMS&OMS leveraging our partners. R-Car series offers an innovative scalable solution for a standalone DMS&OMS or integration along other ADAS applications (front camera or surround-view system). Especially R-Car V3M&V3H include state-of-the-art computer vision & deep learning processing that can be used for face detection and identification, gesture detection, classification enabling all DMS/OMS features, also state of the art functional safety and security with efficient and low power.
From the feature point of view, R-Car V3M&V3H can support Face detection & features (eyes, gaze, recognition, head 3D position), Hands detection (hands position, gesture detection), Status, distraction & alterness (drowsiness, emotion, phone usage, alcohol or substance influence), Occupants detection (occupancy count & positions, seat belts status) and Occupants classification (age, gender, child left behind).