AI Tutor 1.0 2.0 3.0

Introduction:

In order to cater for the needs of the students, we developed AI TUTOR 1.0, 2.0 and 3.0. We continuously improved the functions of AI TUTORS to meet the needs of students.

Creative Elements:

AI tutor 1.0: Musical Master (drum set) + AI Tutor

AI tutor 2.0: Become portable (open pipe) and wearable

AI tutor 3.0: Adding the eye to AI tutor (piano) which read the passage and the musical sheet (chord).

Components:

1. raspberry pi 3B
2. Voice kit v1
3. ARDUINO MEGA 2560
4. Capacitor sensor x 7 pieces
5. 3D printed pianos
6. 12 inch plastic pipe
7. wires
8. copper adhesive tapes
9. paper box - 20cm(L) X 15cm(W) X 6 cm(H)
10. Raspberry pi lens v2
11. SP 1 PIT 1.5A 250VAC button
12. 3D printing stands
13. SPARKFUN MUSICAL INSTRUMENT SHIELD
14. BELT
15. Adafruit 12-Key Capacitive Touch Sensor Breakout - MPR121

Software:

1. Arduino programming
2. Python programming

https://aiyprojects.withgoogle.com/voice-v1/

Follow the instruction of the above links to build AI tutor1.

1. Using Wood grain stickers to cover the google voice kit V1.
2. Using USB cable to connect the google voice kit v1 to Arduino Mega with musical shield.
3. Loading the Arduino program to the Arduino Mega.
4. Running the python program in the google voice kit v1.
5. Google voice kit and Arduino Mega communicate with each other through the USB cable.

We used Arduino Mega as the musical master since Arduino Mega provide more pins for the drumset. We combined these two components as a single module which will connect to AI tutor 1, teaching music.

We used the jumper pins as a connector which connected the drumsets to the musical master. So, the device could be expendable. In addition, other musical instrument can be connected to the musical master.

AI Tutor 1.0: Students are playing piano.

AI tutor 1.0 demonstration

1. Use the pipe and screw the hole by screw driver.
2. Use copper adhesive tapes as the tone finger plate.
3. Use Adafruit 12-Key Capacitive Touch Sensor Breakout - MPR121 for connecting the copper adhesive tape and arduino mega. The idea was reducing the complexity of circuit design and making wearable AI tutor 2.0.
4. 3D printing: make the protective shield of three main components, Arduino Mega with musical shield, Goggle voice kit and Speaker.
5. Attached three components to the belt.
6. Use the USB portable battery as the power supply.

1. Use the pipe and screw the hole by screw driver.
2. Use copper adhesive tapes as the tone finger plates.
3. Soldering each tone finger plate to the dupont wire.

1. 3D printg to make the connector socket.
2. Put all the dupont wires from the tone finger plates into the connector socket.
3. Insert the connector socket into Adafruit 12-Key Capacitive Touch Sensor Breakout - MPR121
4. 3D printing to make protective box (orango color).
5. Use USB type A wire connect the musical master module to google AIY voice kit 1.

1. 3D printing to make a protective box (white) for AIY voice kit 1.0.
2. 3D printing to make a protective box (yellow) for the speaker

AI tutor 2.0 demonstration

AI tutor 2.0: The player is playing the music

Practice : AI tutor 2.0 "next" command

Additional Functions:

AI Tutor 3.0 can read the passage and simple musical sheet.

1. Use the hard mouse pad as a piano.
2. Attach copper adhesive tapes on the hard mouse pad.
3. Soldering the dupont wires to copper adhesive tapes.
4. Attach all the heads of dupont wires altogether as a connector.

Long cable for the raspberry pi lens V2.

1. Soldering the 12 capacitive touch sensors to the Musical Shield.
2. Soldering the 12 capacitive touch sensors to the the finger pin of piano.

Reference: PiTextReader Document Reader for Impaired Vision - R.Grokett

1. Connect the 24" camera cable to the camera.
2. Connect the button to the Raspberry Pi 3.0 B+ which controls the OCR speech.

1. Microphone module from AIY voice kit V1.0 connect to the voice hat.
2. Make a hole for microphone.

AI tutor 3.0, likes a transformer, is a paper box. All the components stands, the camera cable, speakers, wires and the lens can be put into the paper box.

In order to increase the data processing power, we used two raspberry pi 3B+ for making the AI Tutor 3.0.

In addition, we make use of "PiTextReader, Document Reader for Impaired Vision, R. Grokett" to integrate into AI tutor 3.0.

The AI Tutor 3.0 can read the passage and recognize each words. In addition,AI tutor 3.0 can read the simple musical sheet and play the music accordingly and AI tutor 3.0 likes a music tutor, the player can play the music with different type of musical notes, For example, organ, violin and sax phone. Finally, AI Tutor 3.0 can be a Maths tutor and a English tutor.

AI tutor 3.0 are playing music with reading the chords.

AI tutor 3.0 - "music" command and " Next" command

AI tutor 3.0 "exercise 1 " command

AI tutor 3.0 are reading the passage

AI tutor 2.0 and 3.0 demonstration