About DBIS   | Story archive   | Contact DBIS  | DBIS home

Taking a Trip in 3D

Computer Scientist Composes 3-D World from Snapshots

September 1, 2007

Computer engineers have designed a program that can stitch together still photos of a the same area to form a comprehensive three-dimensional picture of it. The software looks for small details shared between photos and builds a video game-like 3-D picture. The user can see an entire scene, but also zoom in on individual photos for close-up views.

read the full story...

Science Insider

Science behind the news is funded by a generous grant from the NSF

BACKGROUND: Anyone with a digital camera knows how easy it is to take so many pictures that it can be difficult to find one specific photo later on. New software developed by scientists at the University of Washington helps you sort your vacation photos in a snap. The software goes well beyond simply organizing a photo collection, according to the UW researchers. It recreates a particular scene or location at the resolution of the photos.

HOW IT WORKS: The UW researchers turned to recent advances in computer vision research to solve the problem. They wrote computer software that analyzes each image and calculates where it was taken. To do this, the software looks for small details shared between different photos that can be used to compare them, and stitch them together in three dimensions. The photo is then represented by a small square placed in the appropriate position in a sketch of the original scene. Even though you are sifting through hundreds or thousands of photos, it feels more like playing a video game. By moving right or left, zooming in and out, the computer will fade to an appropriate shot. Highlighting a feature -- such as the statue of Neptune at the center of Trevi Fountain in Italy -- brings up a high-resolution photo of that object. The current user interface presents each photo as a little box, and photos fade into one another to give the impression of a 3-D zoom. The next version will create an even more fluid, game-like interface so that users feel they truly are navigating in a 3-D world.

WHO COULD USE IT: Real estate agencies, restaurants, museums and hotels might find it useful as a means of presenting a virtual tour, because viewers could zoom in to read a restaurant menu or to view a painting, for example. Archaeologists and biologists would be able to create realistic visual representations of their research sites. Military and surveillance organizations also would like to organize photographs in a more intuitive fashion. Sports fans could even recreate their favorite game by combining all the photos taken at an event. By far the most promising potential application is organizing the millions of photos that currently exist on the Internet -- sort of a visual Wikipedia. Contributors could upload photos and the program would combine them to create an increasingly comprehensive picture of the world. Further in the future, combining the photos with a digital map like Google Earth would mean users could keep zooming in closer without the image ever going fuzzy.

Video help

Latest stories

  • A Satellite Named Violet and a Student Named Amanda
  • Behind the Scenes with the K-Team
  • Deep Space Discoveries
  • Dogs Fighting Cancer
  • Earthquake! What's Your Risk

Did you know?...

Companies such as Google and Microsoft recently have begun to create 3-D models of cities by painstakingly gathering photos taken from different angles and then stitching them together.

More information on this story

Noah Snavely
Department of Computer Science and Engineering
University of Washington
snavely@cs.washington.edu
206-669-7097


© 2011 American Institute of Physics