Arduino Gesture-to-Text Glove

by ejcerm in Circuits > Arduino

583 Views, 2 Favorites, 0 Comments

Arduino Gesture-to-Text Glove

asl.jpeg
Screen Shot 2021-12-18 at 12.28.36.png
adxl335.jpg
flex sensor.jpeg
hc051.jpg
1kohmresistor.jpg
finishedglove.jpeg

My first thought was to create some sort of cosplay item and that’s where the Infinity gauntlet idea came in. However I decided to bring this idea further as I was faced with the question of what concern this project touched on. I still liked the idea of a gauntlet/glove so I continued searching for and thinking of different ideas that could benefit others. I thought about my sister and her sign language learning phase so I combined that thought with the glove idea and began searching for other people who had a similar idea.

My concern was the language barrier between ASL or any sign language speakers who are hearing and speech impaired and people who cannot communicate with them because they cannot speak sign language. And since sign language is spoken with our hands, I figured the best option would be to use a glove that can somehow detect the motion and gestures of the hand and transmit that information onto a screen.

Supplies

1x Arduino Nano R3 https://www.newark.com/arduino/a000005/dev-board-a...

1x HC-05 Bluetooth Module https://www.amazon.com/Wireless-Bluetooth-Receiver...

5x 2.2 in. Flex Sensors https://www.sparkfun.com/products/10264

1x Adafruit Analog Accelerometer ADXL335 https://www.adafruit.com/product/163

5x 1k ohm Resistors https://www.sparkfun.com/products/14492

Soldering kit

Hot glue gun

Details About the Glove

wriring diagram2.jpg
finishedglove.jpeg

The original code provided was made by Manmohan Gupta

This glove works because the code is programmed so that when the flex sensors are bent at a certain angle, and the accelerometer is detecting tilt and motion from the hand, the glove will transmit information to the bluetooth module and onto a screen that is connected to it. In addition, the wires coming from the flex sensor are going to analog pins, because the flex sensors will be “flexing” creating electrical signals back to the Arduino, and the Arduino sends that data to the bluetooth module. The glove will provide more efficient communication between mute/deaf individuals and people who are not fluent in any form of sign language. The code for this particular glove translates each individual letter in the alphabet, but if the code is modified it could be used to translate certain phrases to reduce the amount of time it takes to spell out a word. A lot of times, people wish to communicate with others but cannot because of a language barrier. This glove can aid in this issue and also provide more inclusivity for the hearing-impaired and mute communities.

Downloads