How is hand gesture recognition used in robotics?

How is hand gesture recognition used in robotics?

Let’s use image processing, machine learning and command control to move a robot with hand-gesture controls. Hand gesture recognition can be done using different types of input sensors: wired gloves, a stereo camera, a depth camera, or a standard camera which is the one we are going to use.

How does an Arduino recognize a hand gesture?

The gestures/motion made by hand is recognized by an acceleration measuring device called accelerometer (ADXL335). Here the accelerometer reads the X Y Z coordinates when we make gestures by hand and send the X Y Z coordinates to the Arduino (here we don’t need the Z-axis we need only two coordinated X and Y So neglect the Z coordinate).

How is machine learning used in robot control?

Hence we are goin g through different technical fields: image processing for features extraction, machine learning for gesture classification, and command control to determine the robot motors speed depending on the recognized gesture: Here are the three hand gestures we are going to use:

How does a hand gesture work on a smartphone?

Almost all smartphones now have accelerometers (even though we are not going to take it from a smartphone). You definitely played motion games in your mobile (e.g Temple run) where the character in the game moves left and right when you tilt your phone left and right respectively it is done by the accelerometer.

What kind of sensors are used for gesture recognition?

Hand gesture recognition can be done using different types of input sensors: wired gloves, a stereo camera, a depth camera, or a standard camera which is the one we are going to use. We could directly implement gesture recognition using a Convolutional Neural Network.

How are hand gestures used in human interaction?

The use of hand gestures provides a better solution than conventional human-machine interfaces. Furthermore, translations of hand gestures can help in accomplishing the ease and naturalness desired for HRI. This has motivated a very active research concerned with computer vision-based analysis and interpretation of hand gestures.