Markov Crawler

by JanB5 in Circuits > Raspberry Pi

1258 Views, 2 Favorites, 0 Comments

Markov Crawler

crawler-4-sideView.jpg

Crawler can execute a reflex agent or Q-learn optimal policy using Markov decision process.

Raspberry Pi runs CS188 AI Python software controlling crawler 2 servo motors for arm and hand, acquiring crawler position from optical mouse.

Overview of the Project

Downloads

Assembly Instruction

Usage Instruction

Q-learning Process

3)  q-learning

https://youtu.be/Ex3Hbc69Aps

Execution of Q-learned Policy

4)  q-policy executed

https://youtu.be/C7HSPhb4rQ4

Synchronization of Simulator and Physical Robot

1) basic controls

https://youtu.be/xYO9BCDn2AA