The Ultimate Guide for Easy Awesome VR Panoramas
by andrea biffi in Circuits > Cameras
41681 Views, 459 Favorites, 0 Comments
The Ultimate Guide for Easy Awesome VR Panoramas
My passion for immersive photography has born some years ago on the same wavelength, so after a few researches about nodal point, stitching techniques and gears, I've decided to build my own wood panohead and I started the journey which led to an impressive huge 360° images gallery.
Now you have the chance to travel through these steps together. Some of them could be boring, and probably you already have a good experience with many of the described concepts, so I'll try to be more concise and less theoretical as possible.
I want to highlight that this instructable is not supposed to be a personal gallery of my best work, but my ego didn't let me choose ordinary photos ;-)
A Little Bit of Theory
The concept behind the spherical panoramas is nothing complicated, this technique is meant to reproduce in virtual reality (VR) the first person view taken in any direction at a certain instant. In simple words you have to take a lot of pictures all around, at full 360° on the horizon and also up (zenith point) and down (nadir point), and merge them into a single image.
Problems appear when you try to merge the pictures together, indeed they have to be warped to match each other. A software could do that easily, but to do that it has to recognize the identical details in different images to overlap them. These identical details are named "control points" (CP). The more you overlap sequential images, the more CP you'll have. To be fair the number of CP is not as essential as their "quality". Years ago I created this panorama of Milan Gallery adding manually 5 CP for each couple of the 16 picture, and the final equirectangular image came out very precise. In case you wondered what equirectangular means, this projection type is the most used way in VR to display a sphere on a plane, and if you'll manage to load it in a panorama viewer it will be certainly supported.
Stitching a set of photos in a uniform single equirectangular image is totally a mathematical issue, and it has been possible thanks to the efforts of Prof. Dr. H. Dersch (who created Panorama Tools) and Andrew Mihal (who created Enblend and Enfuse tools).
If you want to study in depth the subject there are a lot of forums managed by skilled people where you can find really interesting discussions about this process, the most popular are panotools.org and www.kolor.com.
The Parallax
If the software will run into these little differences between images, it will have two types of difficulties:
- an harder work will be needed to find exact identical control points between images
- it will be much more difficult to build a perfect transition between an image and the adjacent one
The Lens
You can also use a 50mm or a telephoto lens, in that case you'll create an impressive gigapixel panorama. The principle is the same, but you'll need some specific equipment and probably it wouldn't be worth to take a full 360°, because usually details on the sky and on the ground are less interesting.
The Leveling
A simple and effective solution is to keep a small bubble level on the flash slide to keep the first shot perfectly horizontal, and let the program straighten all the other images consequently.
The two examples show this typical situation: the few subjects that help to straighten the image are trees and the mist, but they're not precise.
The No-Parallax Point
There are many debates about NPP location and a lot of confusion with "nodal point", read the article by Rik Littlefield to take a deeper dive into the issue.
Anyway you can find NPP making certain of the exact alignment of near and distant objects as you see in the animation. For wide angle lenses NPP is very close to the external glass of the lens, for this reason classical tripod heads are ineffective in making precise panoramas, indeed they make the camera rotate around its body, and the NPP will inevitably change position. Also the choice to utilize a tripod mount ring will barely improve the situation, usually tripod mount rings for short lenses don't exist, and however they wouldn't correct the vertical shift.
The Panorama Heads
It goes without saying that changing lens will change distance between NPP and tripod joint on the camera body. So you have to build your panorama head referring to a certain lens, or adjust the parameters of any universal pano-head when changing lens.
To build a simple panorama head you can refer to my instructable "Light and Cheap Wood Panohead", athough it is not a real step-by-step tutorial because I had already built it at that time.
The Cheap Alternative
You'll have many benefits using the plumb line, in addition to the money saving:
- you can easily keep it in your shirt pocket and mount it in less than a minute
- you can use it with any lens or camera
- you can build it very quickly in place if you forget it at home
- people will not have time to get scared, seeing you mounting the gear, and to run away
- you can move away if you need, and come back in position with no consequences, e.g. taking a panorama in the middle of the street
- you can use it in museums or other places where tripod is forbidden, altough taking pictures without a flash will give you a hard time
Cheap Way Downsides
- you obviously will not able to shot gigapixel images, you can use a lens not longer than 20mm
- you need a lot of light to shot handheld, so you can't use it in low light conditions, nevertheless you can sometimes use the flash
- you'll surely have big alignment errors, so it works better on open spaces, as a square, without any subject close by
- you'll be susceptible to strong wind which will make your plumb line an oblique useless plumb line, so you can use a more heavy (and cool) plumb as in picture
- people who unfortunately hadn't time to run away will look at you as an insane man
- you are going to waste some minutes explaining to the bravest what you're doing, but they won't understand anyway
- sometimes you'll stumble on it and it'll take about 20 minutes to untangle the knots, in that case the cool new plumb becomes very useful
Overlooking the Scene
- an higher place will let you show much more interesting subjects and avoid to waste half panorama photographing the ground
- if the ground has a geometric symmetrical motif you can make the image more interesting choosing its central point
- if you can, try to stay in a shady place, because sun will otherwise be in at least one of the pictures and will create bothersome reflections, with different artifacts in adjacent photos
- try not to stay too close to any subject, like utility poles, traffic lights, trees, and regular people passing while you're shooting
- don't forget to pay attention to the electricity cables over the streets, because you will need to check they're aligned in the final panorama
- audacious locations like the edge of a cliff, the top of a stone, the center of a traffic congested square, the bow of a ship, would give a unique feel to the astonished visitor, but I'm not suggesting you to try to kill yourself!
- also less dangerous unique spots should make the panorama more interesting, like the center of a drain on the street, a chair in a church, a motorcycle seat, anything that isn't a boring empty space
Planning Your Shots
- the method you use to take the pictures: if you're using an automatic pano-head you can easily avoid blind areas, so you can reduce overlapping to 10-15%
- the type of subject: if there are many uniform areas (like sky, fog) or changeable surfaces (like water, flags, animal herds, people crowd, fast clouds) or also recurring elements (like in four cardinal points of Milan Gallery) you'll need a wider overlapping to give the program more CP and maybe more chances to avoid half-body or double-head humans (!!)
- the variability of light conditions and of the colours: the more you overlap the pictures, the wider the graduated shading between them will be (fast changing cloudy weather, a disco-party with coloured lights...)
Using Flash
Another way could be lighting up the full scene with an indirect light from one or more fixed flashes, that would work very good. I've built a DIY flash diffuser to spread light all around the room, you can keep it under the tripod paying attention to the tripod legs shadows.
How to Become a Ghost
Obviously you'll surely expect to find the tripod or the photographer feet at the bottom side of any 360°panorama... and indeed you'll find it in many cases. But any professional and meticulous photographer will abhor that! So it's essential to find a way to hide these unrelated elements. You have three possibilities:
- you can replace them with a more professional element, like a circle or a sphere with your contact data:you've to elaborate the final image to do this, and we'll see that in last steps
- you can recreate the ground or the pavement with some postprocessing work: we'll see that too
- you can try to empty the area under your camera when you shoot the nadir: in this case you have to take more shots (maybe 4 instead of one if your're using a wide-angle lens like mine) moving away your feet or tilting the tripod so that neither shoes or tripod legs will appear in images
The last technique is obviously the one that lets you stitch the images faster, but it's not always possible.
I bet that if you are a diligent student you have already noticed that ghosts have no shadow, hiding your own shadow needs the same trickery as the nadir cleaning, look the following animated gif to see how to take two different shots so that the software hide the most part of the shadow, then you have to hide the remaining part by hand.
Setting Up the Images
In this case I shot a bracketing sequence of pictures, but then I decided to keep only the lighter set, and discard the other two. Of course feel free to follow my "exposure bracketing for spectacular panoramas" instructable to add appeal to your panorama.
I also tried to use polarized filter this time but as you can see, it creates an unsuitable variation of the sky tonality, due to the different angle between the filter and light rays in adjacent photos, even though I tried to rotate it properly for each shot. Result: don't use polarized filter to make panoramas.
Lightroom is a professional but very intuitive program to develop RAW images to obtain the maximum color quality and detail. Here you can see the three main steps to use it:
- importing raw files into library
- developing them adjusting color, exposure, contrast, etc.
- exporting them as jpg files (your stitching program will need less time to transform jpeg files, but in case you don't care about time, you should save them as 16bit tiff)
Ready to Be Stitched
I prefer not to examine in depth the process of stitching pictures using a program rather than another. This is because I don't want to limit the choice to a single software, and you can find hundreds of guides about this around the web.
So I decided to explain you just the basics of two great programs: Hugin and Autopano. Autopano is a more recent and professional powerful program, but Hugin lets you understand the stitching technique in a better way, and you can set many parameters of the process, plus it's free for commercial use, and it has a long story in his past.
You'll have to try them a little before deciding which one is the best choice for you. The stitching method may vary depending on personal liking, I believe that merging pictures and obtaining the equirectangular final image has to be fun other than efficient, this way you can feel inspired and create wonderful pieces. The fact that these two panoramas are not masterpieces will prove my thesis: I quickly made them just to illustrate my tutorial, but I wasn’t very inspired ;-)
Hugin
Hugin is not an intuitive program, this is because it leaves you a large choice for most calculation parameters. I’m not going to explain you advanced techniques here, you will be able to enhance your understanding with time. Original settings should be enough for beginners.
Autopano
Fixing the Nadir
If you want to go for the easy way you can simply use Photoshop to fill the empty bottom area of the equirectangular projection with the specular image of the same view, and your can add you website address too. This is quite professional, because you cover the less interesting part of the panorama with the logo, and people are usually happy to find something more interesting there. Follow the tips on the images to better understand the entire process.
The Specular Dome
But if you're a real obsessive perfectionist, you need to convert the pole to an ordinary view, modify it (recreating the pavement, copying the grass, deleting your shadow, etc.) and converting it back to equirectangular.
To do that without specific filters in Photoshop, you can flip the image vertically and apply the Polar Coordinates filter (in the Distort group) with Rectangular to Polar selection, although this will deform your image a little. However, you can clone the grass or dirt and apply the same filter with Polar to Rectangular selected, and of course mirror the image again.
Perfect Geometric Motif
The most intuitive tool to extract a parallel view of any part of your spherical panorama is PTEditor. This is indeed a Java application included in Panorama Tools, and you need JRE to run it (in my case it worked with "jre-7u5-windows-i586" on my Win7 64bit, but many people have incurred in problems, read here for alternative methods...).
This application is very easy to use, and it's made exactly for that purpose:
- If your panorama is wider than 8000 px you have to make a smaller copy to load into PTEditor, in my case it crashes when I use bigger images, but keep your original file, you'll need it!
- After opening your reduced panorama into PTEditor you can turn around the view dragging on the image, and zooming in and out with shft or ctrl+left click.
- When you have the exact frame, including the zone you want to modify and an additional sample pavement around that, you can Edit -> Extract Partial View.
- You have a tiff image now (maybe you have to rename it if you opened a jpg in PTEditor) and you can retouch it in Photoshop.
- After you've fixed the floor/ground/pavement/chair you can save the tiff and reload it into PTEditor with Edit -> Insert Saved View, then save the panorama and close PTEditor.
- Now, if you had to reduce the panorama, you should merge the new pavement area on the original file, simply overlay the new equirectangular image (enlarging it) on the original one, and finally hide everything with a mask except the fixed region.
The Result
The Alternative Views
To reach these results you can employ Hugin again, loading the equirectangular file as a singular image and assigning the right properties (equirectangular projection type, 360° horizontal field of view). In the preview, you can change the resulting projection type into fish-eye, architectural, Mercator, etc. and drag the image to change the view direction.
Attached pictures are in this order: a mini-world panorama taken on the biggest lake of Italy, a view of a castle on Dolomites, a stereographic view of the Pantheon of Paris, and a similar shot taken in an ancient building in Venice.
I hope you enjoyed this short/long, essential/exhaustive, boring/interesting, useless/ultimate guide about this awesome photographic technique. Write me or leave me a feedback if you wish.