ASL Interpreter
ASL Interpreter
Supplies
Software Requirements
Python: 3.11.7
You must have the following packages installed:
Raspberry Pi OS 64 bit (the Debain port of Bookworm) - Beware of 32 bit OS images, Mediapipe, even Mediapipe-rpi4 has issues installing and running
Just Mediapipe, Mediapipe-rpi4 has lots of compatibility issues so your milage may vary
Picamera2
The user must take the zip file and unzip it.
Run the python asl_system.py.
Circuit Design
Start with the Raspberry Pi. Similar to the Arduino we have used in class, insert the connection ports into the breadboard.
Next, connect the Camera module (Bottom most component on the left). The camera module has a specific port on the Raspberry PI labeled CAMERA. In our diagram, it is labeled GPIO19.
Next, wire the piezo speaker(Top component on the left). Connect the speaker to 5V, then Connect the speaker to ground. Finally Connect the speaker to a GPIO of your choice, we used GPIO5
Next, wire the proximity sensor(Bottom most component on the right). Connect VCC port to 5V. Connect the GND port to ground. Connect the TRIG port to a GPIO of your choice, we used GPIO21. Connect the ECHO port to a 1K Ohm resistor, Then split the wire, with one end going to a GPIO of your choice, we used GPIO 20, and the other end going to another 2K ohm resistor, which you then connect to ground
Next, wire the potentiometer(Middle component in the circuit diagram, to the right of the Raspberry PI). Connect the potentiometer to GND. Connect the potentiometer to 5V power. Connect the potentiometer to a GPIO of your choice, we used GPIO16
Next, wire the LED screen(upper component in the circuit diagram, to the left of the Raspberry PI). Connect the power component of the LED screen to 5V, port A in our diagram. Connect the ground component of the LED screen to the ground in the Raspberry Pi, port B in our diagram. Connect the DIN port of the LED screen to GPIO27 on the raspberry pi, port C in our diagram. Connect the clock port of the LED screen to GPIO11 on the raspberry pi, port D in our diagram. Connect the CS port of the LED screen to GPIO8 on the raspberry pi, port E in our diagram. Connect the DC port of the LED screen to GPIO25 on the raspberry pi, port F in our diagram. Connect the RS port of the LED screen to GPIO27 on the raspberry pi, port E in our diagram. Connect the BL port of the LED screen to GPIO18 on the raspberry pi, port F in our diagram
Soldering the Prototyping Board
The soldering can be done as shown.
Assembly
Given the soldered final board, plug the Raspberry Pie into the headers.
Operating Instructions
The operation of our ASL Interpreter is simple. Move to within 2cm-2m of the proximity sensor. You can product a sign facing the camera, and a music note will play to indicate it has been completed correctly. The letters that were received will be printed on the LCD screen for viewing by the user.
Potential Improvements
Our project made use of a Piezo speaker, which is not necessarily ideal for the output. This is because while we are able to play music notes to indicate a reading being made, and having been executed. Having a speaker would allow us to play audio that would resemble human speech and allow us to have true discourse between both users of the device. Having the ability to capture video rather than just pictures would allow us to implement more gestures, specifically those that require the use of motion. Finally, correctly showcasing the LED screen outputs, instead of simple terminal outputs, would be great.