Raspberry Pi Gesture recognition module - Jetson NANO Gesture recognition User Guide

• PAJ7620U2.py

Gesture recognition

1. Purpose

In this course, we mainly learn to use Jetson Nano and gesture recognition module.

2. Preparation

Wiring diagram as shown below.

Before use this module, we need open I2C service of Jetson NANO. 

2.2 You need to open the IIC service of Jetson NANO board.

2.3 Install I2Ctool

Input following command in command terminal,

sudo apt-get update

sudo apt-get install -y i2c-tools

Wait patiently for the successful installation to complete.

2.4 Check whether the installation is successfully

Input following command in command terminal,

apt-cache policy i2c-tools

If system output is as follows, the installation is successful.

i2c-tools:

Installed: 4.0-2

Candidate: 4.0-2

Version list:

*** 4.0-2 500

500 http://ports.ubuntu.com/ubuntu-ports bionic/universe arm64 Packages

100 /var/lib/dpkg/status

2.5 Scan all i2c devices on a certain bus, and print out the device i2c bus address.

sudo i2cdetect -y -r -a 1

2.6 Install smbus

Input following command in command terminal,
sudo apt-get update
sudo apt-get install -y python3-smbus

3. About code

Please check PAJ7620U2.py file.

3.1 Define the device address and register address of the module.

3.2 Define initialization array, register array, gesture register address.

....

3.3 Through I2C, the value of the initializing array and the initializing array of gesture register are written into the corresponding registers to start and initialize the gesture recognition module.

3.4 Gesture recognition function: judge the currently recognized gesture by reading the value of the gesture recognition storage register and print out the corresponding gesture name.

3.5 After successful initialization, the gesture recognition function is cycled to judge the current gesture.

4. Running code

Input following command in command terminal of jetson nano.

python3 PAJ7620U2.py

5. Experimental phenomena

After the program running, if the module is initialized successfully, Jetson NANO system will print "Gesture Sensor OK", otherwise it will print "Gesture Sensor Error". If the initialization fails, we need to run code again.

After the initialization is successful, the module will start judge the value of gesture recognition, and different gestures will print out different action names through the serial port.

Put the gesture recognition module in the vertical direction, open your palm to face the module, Swing over your palm from left to right in front of the module, Jetson NANO system will print "Left".

Swing over your palm from left to right in front of the module, Jetson NANO system will print "Right".

Swing over your palm from bottom to top in front of the module, Jetson NANO system will print "Up".

Swing over your palm from top to buttom in front of the module, Jetson NANO system will print "Down".

Approach from back to front directly in front of the module, Jetson NANO system will print "Forward".

Approach from front to back directly in front of the module, Jetson NANO system will print "Backward".

Make a fist and stretch out two or three fingers to point to the front of the module, then circle it clockwise for a while, Jetson NANO system will print "Clockwise".

Make a fist and stretch out two or three fingers to point to the front of the module, then circle it counterclockwise for a while, Jetson NANO system will print "AntiClockwise".

Wave your hand in front of the module for a while, Jetson NANO system will print "Wave".

Arduino

• Gesture control RGB lights

Micro:bit

• 1.Gesture choose music
• 2.Gesture control fan
• 3.Gesture control omnibit

Jetson NANO

• Gesture recognition

Raspberry Pi

• Gesture recognition