Mix Reality Headset With Machine Learning

I deciced recentely to build my own Mix reality Headset with Hand gesture Tracking system like Magic Leaps or hololens since i could not afford one for myself .

To build this project , you will need :

• PandaBoard or any Single Arm Computer capable of running on Win10 or 11
• 3D printer
• USB Camera
• Leap Motion
• Li-Ion Battery : 3.7 V

For this project , i used an ARM Single Board Computer running on Windows 10 and used a dual TFT Lcd screen connetcted the HDMI port of the computer .

The biggest challenge i faced during this project was to run properly the Leap Motion sensor with the Single Board Computer since the processor was very slow to handle and compute datas from the sensors with a limited RAM memory .

However , I decided to overclocked the tiny computer and finally added a small Fan to cool down the processor , and then it works pretty much well .

To test, I built a simple Interactive Apps with unity to be able to grab some 3D Objects with my fingers , with the leap motion sensor .

Now has come the time to design , to 3D print , to assemble and to put everything inside the goggles . It was the most difficult steps on this project, since i had little space to add some extra components , although i had to add some extra modification on my design .

Finally my Headset was almost done , but was not running successfully as i expected since i noticed some latency with my leap motion .

On my next Instructable , i will upgrade and fix the hardware and the software then share some STL and codes on GitHub .