Raspberry Pi Smart Robotic Assistant

by zhouvp in Circuits > Raspberry Pi

585 Views, 8 Favorites, 0 Comments

Raspberry Pi Smart Robotic Assistant

IMG_2969.JPG

This is a smart Robotic Assistant that sits on your desk or home. It is based on Raspberry pi. A two DoF gimbal with on-board wide angle night-vision camera for face tracking and streaming surveillance videos. There is also a 2-inch SPI LCD display for expressive eye animations. USB microphone and speaker provides voice interaction with the assistant and it handles your daily tasks! The functionality are fully modular and expandable.

Supplies

  • Raspberry pi 4 B+ (model 3B+ or later)
  • 2 DoF serval gimbal module (2 9g servos and its holder)
  • Night vision camera
  • 2-inch SPI LCD Display
  • USB Speaker
  • USB Microphone
  • 5v 3A Power supply
  • Ice Cream Sticks
  • Glue Gun

Assemble the Servo Gimbal

WechatIMG402.jpeg

The servo gimbal should look like this when assembled. The complete assembled kit are available on Adafruit website or other equivalents.

Ice Cream Sticks

WechatIMG400.jpeg

Use glue gun to mount two ice-cream sticks on the side like this. The sticks will act as a structural holder for the camera and the display

Mounting the Camera Module

WechatIMG403.jpeg

Mounting the camera module onto the structure like this, secure it with glue gun

Mounting the Display Module

WechatIMG401.jpeg

With a glue gun, mount the 2-inch display to the gimbal like this. Right above the camera module. Upon completion, ensure that the wires are free to move.

Mounting the Gimbal Assembly and Wiring

WechatIMG398.jpeg
WechatIMG397.jpeg

Glue the completed gimbal assembly to the raspberry pi casing. Connect the camera wires. Connect the x servo to GPIO 2 and the y servo to GPIO 3. Refer to this link for the connection of the LCD module: https://www.waveshare.com/wiki/2inch_LCD_Module

Setup and Run the Assistant Python Scripts

Properly Setup raspberry pi with the latest software.

acquire pre-written code at https://github.com/YifanZhou1999/PyAssistant.git

start by running popcorn_main.py to test for installation and functionalities.

Follow on-screen prompt to begin interacting with the smart assistant!