Overview

Description

The 3D Gesture Reference Design is a solution that can detect the position (x, y and z coordinates) of a hand in space using Renesas' capacitive touch solution. The position of a hand up to 200mm above a panel surface is converted to x, y and z coordinates. Moreover, since sensing of coordinate data can be carried out at high speed, gestures (up and down, right and left, and front and behind) and simple pattern recognition can be used to operate a device.

This Reference Design is a solution combines multiple capacitive proximity sensors to detect hand gestures such as holding for a certain period of time or moving a hand over from the electrode to other electrode for realizing simplified gesture operations.

Features

  • Based on Renesas' high sensitivity, noise-tolerant capacitive touch solution
  • Recognize the position of a hand up to 200mm above a sensor
  • Up to 1mm accuracy
  • High noise tolerance and works with shielding
  • Sensing can be carried out with any nonconducting material - thus can be embedded inside a wall, etc.
  • Realize system control and gesture operation for your product using a high-performance, low power 32-bit microcontroller and touch IP
  • Also possible to use gestures in combination with touch buttons
  • Support for IEC 61000 4-3 Level3

Can gesture recognition be used with infrared (pyroelectric sensor), sound wave devices, or cameras?

Image
3D Gesture Solution

Suggested Touch-Free User Interfaces

Image
Suggested Touch-Free User Interfaces

Hardware Configuration

Image
3D Gesture Reference Design Hardware Configuration

e-AI x 3D gesture recognition

You can develop a gesture application that reacts "by anyone's hand" without any specialized skills just by actually performing the gesture that you want AI to remember on the capacitance sensor.
e-AI × 3D Gesture Recognition >>
Usage Example of e-AI × 3D gesture recognition feature >>

Image
3dgesture-concept-en

Hardware Information

Reference DesignApplication NotesGerber Data
3D Standard Version (160mm) RX2313D Gesture Demo Set (Hardware) (Standard version) Rev.1.00 (PDF | English, 日本語)3D Gesture Reference Design Standard Version Gerber Data (ZIP | English, 日本語)
3D Small Version (80mm) RX1303D Gesture Demo Set Small version (Hardware) Rev.1.00 (PDF | English, 日本語)3D Gesture Reference Design Small Version Gerber Data (ZIP | English, 日本語)
3D Slim Version (100mm) RX1303D Gesture Demo Set Slim version (Hardware) Rev.1.00 (PDF | English, 日本語)3D Gesture Reference Design Slim Version Gerber Data (ZIP | English, 日本語)
2D Gesture (300*50mm) RX1302D Gesture Solution Demo Set Hardware Rev.1.00 (PDF)2D Gesture Reference Design Gerber Data (ZIP | English, 日本語)
3D Gesture Electrode Board3D Gesture Electrode Board (Hardware) (PDF | English, 日本語)CTSU 3D Gesture Electrode Board Reference Design Gerber Data (ZIP)

Software Configuration

FirmwareContentsCode Size
3D Standard version (160mm) RX231
CTSU 3D Gesture Demo Set Sample Software (Standard version) - Sample Code (ZIP | English, 日本語)
Gesture recognition binary code
Coordinate detection middleware
Touch API
ROM: 34.2 KB
RAM: 5.8 KB
3D Small version (80mm) RX130
CTSU 3D Gesture Demo Set Sample Software (Small version) - Sample Code (ZIP | English, 日本語)
Gesture recognition binary code
Coordinate detection middleware
Touch API
ROM: 27.4 KB
RAM: 4.8 KB
3D Slim version (100mm) RX130
CTSU 3D Gesture Demo Set Sample Software (Slim version) - Sample Code (ZIP | English, 日本語)
Gesture recognition binary code
Coordinate detection middleware
Touch API
ROM: 27.3 KB
RAM: 4.9 KB
2D Gesture (300*50mm) RX130
CTSU 2D Gesture Reference Design Demo Set Sample Software - Sample Code (ZIP | English, 日本語)
Sample Program
Touch API
ROM: 38.8 KB
RAM: 3.8 KB
3D Gesture Electrode Board
RA2L1 Group 3D Gesture Electrode Board Sample Software (PDF | English, 日本語)
Sample ProgramROM: 31.2 KB
RAM: 5.4 KB

*Gesture recognition, coordinate detection middleware is the same except electrode placement, USB presence/absence etc.

PC SoftwareContentsCode Size
3D Monitor Tool
CTSU 3D Gesture Demo Set Evaluation Tool '3D Monitor' Rev.1.00 - Sample Code (ZIP | English, 日本語)
Three-dimensional coordinates, gesture motion, electrode sensitivity, etc. can be evaluated
Executable EXE file
2D Monitor Tool
CTSU 2D Gesture reference Design Evaluation Tool '2D Monitor' Rev.1.00 - Sample Code (ZIP | English, 日本語)
Simplified gesture operation, electrode sensitivity, etc. can be evaluated.
Executable EXE file

Applications

Documentation

Type Title Date
Application Note PDF 522 KB 日本語
Application Note PDF 4.53 MB 日本語
Application Note PDF 440 KB 日本語
Application Note PDF 435 KB 日本語
Application Note PDF 1.42 MB 日本語
Application Note PDF 979 KB 日本語
Application Note PDF 842 KB 日本語
Application Note PDF 3.91 MB 日本語
8 items

Design & Development

Software & Tools

Software Downloads

Type Title Date
Software & Tools - Other ZIP 341 KB
Software & Tools - Other Log in to Download ZIP 106 KB 日本語
Software & Tools - Other Log in to Download ZIP 46 KB 日本語
Software & Tools - Other Log in to Download ZIP 194 KB 日本語
Software & Tools - Other Log in to Download ZIP 474 KB 日本語
Software & Tools - Other Log in to Download ZIP 894 KB 日本語
Software & Tools - Other Log in to Download ZIP 1.04 MB 日本語
7 items

Sample Code

Lab on the Cloud

Lab on the Cloud

Use our PC-based GUI to instantly start configuring and testing designs in our virtual lab, no physical board needed.

This solution demonstrates multiple capacitive proximity sensors used to detect hand gestures using a robotic arm. Up, Down, Right, Left, and Tap gestures can be tried by users.

Image
Lab on the Cloud

Lab on the Cloud

Renesas' Lab on the Cloud is an online environment where Renesas solutions, including popular evaluation boards, winning combinations and software, are hosted in a remote lab that customers access and test online.

This solution demonstrates multiple capacitive proximity sensors used to detect hand gestures using a robotic arm. Up, Down, Right, Left, and Tap gestures can be tried by users.