Augmented Reality 3D Nomad Space Probe

Augmented reality is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data [wikipedia].

In previous instructables I showed how to make a 3D Nomad Space Probe out of cardboard using a laser cutter and out of plastic using 3D printing.  Taking it to the next level, this instructable shows how to make a 3D Nomad Space Probe in augmented reality.

I made this at TechShop.

To make a augmented reality model, all you will need is a computer with Computer Aided Design software like Autodesk Inventor or 123D Design that will let you save your model in .STL format, a handheld device with a built-in camera like an iPod Touch, iPhone, iPad, or Android phone or tablet, access to the Internet.  You will also need an inkjet or laser printer and a few sheets of paper.

Using plans I found on the web as a guide, I created a simplified 3D model of Nomad with Autodesk Inventor at TechShop.  I created a Inventor part for each section of Nomad as shown in the first diagram.  Screen shots of each of the parts from Inventor are shown in the second through fifteenth images.  Each part has a hole in its center that I used to align ("constrain" in Inventor terminology) the parts during assembly in Inventor.  Next I assembled the parts in Inventor to create the full 3D model of Nomad as shown in the last two diagrams.  I then exported the assembled model to STL format which will be used by Augment in step 4.  The Inventor files and the resulting STL file are attached to this step.

Next you will want to install the augmented reality app from Augment on your device.  I used a iPod Touch so I searched the iTunes App Store and installed the free Augment - 3D Augmented Reality application.  The app is available on Google Play for Android devices.

With the Augment app installed on your device, the next step is to add your model to the Augment web site.

1. Open the home page of the Augment web site using your web browser.
2. Register with Augment by providing a user name, email address and choosing a password as shown in the first screenshot.
3. After you've registered, start the process of adding your model by clicking on the "Add your 1st Model" button on the welcome page.  See second screenshot.
4. On the "Add a Model" screen (shown in the third and fourth screenshots):
   • Enter a name for your model
   • Use the "Choose File" button next to the "Upload a Model" to select your STL file.
   • If you have a thumbnail image of your model you can upload it using the "Choose File" option under "Add a Thumbnail"
   • Select whether you want your model to be private or public using the "Privacy" pull down.
   • Set the dimensions that you want your model to be in augmented reality under "Set Dimensions"
   • Provide a short description of your model in the text box under "Describe your Model"
   • You can optionally provide a link to a web page about you or your model under "Link to Web Page"
   • Provide some keywords so when people search they can find your model.
   • Lastly, if you have a product ID or SKU for your model you can enter that information.
5. Click the "Upload Model" to upload your STL file, the thumbnail, and the information about your model.

The way the augmented reality reality software knows where to place your model in reality is to use a "tracker".  A tracker is a piece of paper with a unique design that would not be found anywhere except on the tracker.  When the software "sees" the tracker in your device's camera view, it will display your model above the tracker. 

To print the tracker:

1. Open the home page of the Augment web site.
2. On the bottom left of the page click on "Print Tracker" as shown in the first screenshot.
3. There are several sizes of trackers available to print as shown on the second, third, and fourth screenshots.  For large models, I use the Big Tracker, for small models I use the Medium or Pocket Tracker.   Click the "Print" button next to tracker you want to print your tracker. 

The medium and pocket trackers are shown in the last two images.

You now need to generate a "flash code" for your model.  The app on your device will use this flash code to load your model into the device.  Make sure you're logged in to the Augment web site and click "View" next to your model (first screenshot).  A new page will be displayed for your model with a QR code for your model (Augment calls this a flash code).  Leave this page open for the next step.

On your device, launch the Augment app.  Point your device at the QR Code on your screen and click the app's "Scan QR Code" button.  The app will now load your model into your device.  Click the View now button to confirm you want the app to display your model in augmented reality.  The app will now load your model.

Note: Since the time I captured the Augment applications screens on my iPod Touch for this instructable, Augment updated the application so the screens are a bit different but the process is still basically the same.

Voila!  The 3D Nomad Space Probe is now in augmented reality at TechShop Menlo Park!