Overview
Description
The 3D Gesture Reference Design is a solution that can detect the position (x, y and z coordinates) of a hand in space using Renesas' capacitive touch solution. The position of a hand up to 200mm above a panel surface is converted to x, y and z coordinates. Moreover, since sensing of coordinate data can be carried out at high speed, gestures (up and down, right and left, and front and behind) and simple pattern recognition can be used to operate a device.
This Reference Design is a solution combines multiple capacitive proximity sensors to detect hand gestures such as holding for a certain period of time or moving a hand over from the electrode to other electrode for realizing simplified gesture operations.
Features
- Based on Renesas' high sensitivity, noise-tolerant capacitive touch solution
- Recognize the position of a hand up to 200mm above a sensor
- Up to 1mm accuracy
- High noise tolerance and works with shielding
- Sensing can be carried out with any nonconducting material - thus can be embedded inside a wall, etc.
- Realize system control and gesture operation for your product using a high-performance, low power 32-bit microcontroller and touch IP
- Also possible to use gestures in combination with touch buttons
- Support for IEC 61000 4-3 Level3
Can gesture recognition be used with infrared (pyroelectric sensor), sound wave devices, or cameras?
Image
Suggested Touch-Free User Interfaces
Image
Hardware Configuration
Image
e-AI x 3D gesture recognition
You can develop a gesture application that reacts "by anyone's hand" without any specialized skills just by actually performing the gesture that you want AI to remember on the capacitance sensor.
e-AI × 3D Gesture Recognition >>
Usage Example of e-AI × 3D gesture recognition feature >>
Image
Hardware Information
| Reference Design | Application Notes | Gerber Data |
|---|---|---|
| 3D Standard Version (160mm) RX231 | 3D Gesture Demo Set (Hardware) (Standard version) Rev.1.00 (PDF | English, 日本語) | 3D Gesture Reference Design Standard Version Gerber Data (ZIP | English, 日本語) |
| 3D Small Version (80mm) RX130 | 3D Gesture Demo Set Small version (Hardware) Rev.1.00 (PDF | English, 日本語) | 3D Gesture Reference Design Small Version Gerber Data (ZIP | English, 日本語) |
| 3D Slim Version (100mm) RX130 | 3D Gesture Demo Set Slim version (Hardware) Rev.1.00 (PDF | English, 日本語) | 3D Gesture Reference Design Slim Version Gerber Data (ZIP | English, 日本語) |
| 2D Gesture (300*50mm) RX130 | 2D Gesture Solution Demo Set Hardware Rev.1.00 (PDF) | 2D Gesture Reference Design Gerber Data (ZIP | English, 日本語) |
| 3D Gesture Electrode Board | 3D Gesture Electrode Board (Hardware) (PDF | English, 日本語) | CTSU 3D Gesture Electrode Board Reference Design Gerber Data (ZIP) |
Software Configuration
| Firmware | Contents | Code Size |
|---|---|---|
| 3D Standard version (160mm) RX231 CTSU 3D Gesture Demo Set Sample Software (Standard version) - Sample Code (ZIP | English, 日本語) |
Gesture recognition binary code Coordinate detection middleware Touch API |
ROM: 34.2 KB RAM: 5.8 KB |
| 3D Small version (80mm) RX130 CTSU 3D Gesture Demo Set Sample Software (Small version) - Sample Code (ZIP | English, 日本語) |
Gesture recognition binary code Coordinate detection middleware Touch API |
ROM: 27.4 KB RAM: 4.8 KB |
| 3D Slim version (100mm) RX130 CTSU 3D Gesture Demo Set Sample Software (Slim version) - Sample Code (ZIP | English, 日本語) |
Gesture recognition binary code Coordinate detection middleware Touch API |
ROM: 27.3 KB RAM: 4.9 KB |
| 2D Gesture (300*50mm) RX130 CTSU 2D Gesture Reference Design Demo Set Sample Software - Sample Code (ZIP | English, 日本語) |
Sample Program Touch API |
ROM: 38.8 KB RAM: 3.8 KB |
| 3D Gesture Electrode Board RA2L1 Group 3D Gesture Electrode Board Sample Software (PDF | English, 日本語) |
Sample Program | ROM: 31.2 KB RAM: 5.4 KB |
*Gesture recognition, coordinate detection middleware is the same except electrode placement, USB presence/absence etc.
| PC Software | Contents | Code Size |
|---|---|---|
| 3D Monitor Tool CTSU 3D Gesture Demo Set Evaluation Tool '3D Monitor' Rev.1.00 - Sample Code (ZIP | English, 日本語) Three-dimensional coordinates, gesture motion, electrode sensitivity, etc. can be evaluated |
Executable EXE file | — |
| 2D Monitor Tool CTSU 2D Gesture reference Design Evaluation Tool '2D Monitor' Rev.1.00 - Sample Code (ZIP | English, 日本語) Simplified gesture operation, electrode sensitivity, etc. can be evaluated. |
Executable EXE file | — |
Design & Development
Software & Tools
Sample Code
Image
Lab on the Cloud
Renesas' Lab on the Cloud is an online environment where Renesas solutions, including popular evaluation boards, winning combinations and software, are hosted in a remote lab that customers access and test online.
3D Gesture Control
This solution demonstrates multiple capacitive proximity sensors used to detect hand gestures using a robotic arm. Up, Down, Right, Left, and Tap gestures can be tried by users.