Simplest Augmented Reality

by JuliaL5 in Craft > Digital Graphics

3866 Views, 30 Favorites, 0 Comments

Simplest Augmented Reality

Screen Shot 2016-08-28 at 3.25.44 PM.png
Screen Shot 2016-08-28 at 3.25.19 PM.png
serendip

Don't believe the hype! In its simplest form Augmented Reality or Computer-Mediated Reality can be achieved using any live input source connected to a computer, such as any webcam. This tutorial will show you how to put together some libraries for visual augmentation (using Processing + OpenCV) and open up a world of new possible worlds.

A video feed contains a lot of information in its pixels so we will use simple color tracking from OpenCV for our augmentation. We will use Processing since it is versatile and developed.

Step 1: Download Processing.

Follow instructions at https://processing.org/download/

Step 2: Download OpenCV for Processing:

Link is here:

https://github.com/atduskgreg/opencv-processing

CV stands for Computer Vision! So we can sound fancy.

Step 3: Download ToxicLibs for Processing

Link is here:

https://bitbucket.org/postspectacular/toxiclibs/do...

This will help us with our visuals and the physics-behavior of the visuals. Any other libraries you like for visuals might also allow interesting combinations!

Step 4: Integrate sketches

It may be useful to play with what OpenCV offers you in the example sketches, particularly the ones using live input. I used BlobDetection to get the Pixels from the incoming video stream and triangulated the blob to create a planar mesh.

See Attached Files for the code used.