Print 34 comment(s) - last by ElFenix.. on Sep 13 at 5:29 PM

Photosynth composing a scene from many photographs

Complex algorithms analyze photos and stitch them together with amazing accuracy

Don't know what something is? Take a photo of it and have Photosynth find information for you
Turning photographs into 3D spaces and more

Imaging technology, in both physical media such as print and in digital have come a long way since the pencil and paper. Consequently, photos and online websites dedicated to hosting and displaying photos and images have also become extremely popular and in some cases made some revolutionary steps forward. Sites such as Flickr, DeviantArt and others are all contributing to moving digital imaging as well as digital photography forward. Interestingly, Microsoft also has something that's sure to stir up the hornet's nest in online and offline visual media.

Microsoft is currently hard at work on a project it calls Photosynth. Currently, the project is under the Microsoft Live development team, and no release date has been planned. However, what is known about Photosynth is that it will attempt to revolutionize the way people view their photo collections as well as change the way people take photos. Incorporating exciting new technology, Photosynth can take a collection of photos, analyze them, and model them into a 3D virtual scene, placing each photo in their perspective-correct position -- users can see where one photo was taken in relation to another photo!

The technology is indeed a big step forward over the traditional slide show. Say for example a photography enthusiast visited Las Vegas. Over the course of a few days, the user has taken several hundred photographs of the Las Vegas strip. With Photosynth, the user can catalog all the photos and build a virtual world out of them, modeling Las Vegas as he saw it. Photosynth allows users to move around in the 3D world, viewing scenes from any angle -- regardless of how the photos were taken. Photosynth's powerful algorithms do all the background work. According to Microsoft:

Each photo is processed by computer vision algorithms to extract hundreds of distinctive features, like the corner of a window frame or a doorhandle. Then, photos that share features are linked together in a web. When a feature’s found in multiple images, its 3D position can be calculated. It’s similar to depth perception—what your brain does to perceive the 3D positions of things in your field of view based on their images in both of your eyes.

Of course, Photosynth can perform traditional photo collection management duties too. Using its analysis engine, Photosynth also allows users to search their collection for "similar" photos, perhaps of a particular person or scene. The possibilities right now sound very exciting.

In February of this year, Microsoft acquired a company called Seadragon Software. Since then, Microsoft has been working Seadragon's imaging technologies into its own projects and Photosynth incorporates a good portion of them. According to Microsoft, Photosynth will allow users to zoom in, pan and fly through any photo or 3D scene without hiccups or pauses -- no matter if a photo is 1 megapixel or 1 gigapixel. Microsoft claims "scaling is near perfect and rapid for screens of any resolution."

Another very interesting and potentially powerful feature of Photosynth is its ability to "DNA" and recognize photos featuring distinct similarities. Microsoft claims that Photosynth will allow users to take a picture of an object, have Photosynth analyze it, and automatically find information about it online. For example, if a user was on a trip and took a picture of the Petronas Towers in Malaysia, they could import it and have Photosynth correctly identify the image as the Petronas Towers and automatically do an Internet search for information on the towers.

With Photosynth you can:

  • Construct a virtual 3D scene composed of several photos
  • Walk or fly through a scene to see photos from any angle
  • Seamlessly zoom in or out of a photograph whether it’s megapixels or gigapixels in size
  • See where pictures were taken in relation to one another
  • Find similar photos to the one you’re currently viewing
  • Find information on an object in a photo
  • Explore a custom tour
  • Send a collection to a friend

Clearly, Microsoft has some very large plans for Photosynth, and it's also clear that Photosynth incorporates some very interesting and powerful technologies. From the looks of it, it also appears that Microsoft is also planning to allow users to construct virtual scenes online, for other viewers to browse "fly" through and experience.

As of right now, Microsoft says that Photosynth will be arriving soon, and we hope so because we can't wait to try it.

Comments     Threshold

This article is over a month old, voting and posting comments is disabled

By Calin on 9/4/2006 8:34:51 AM , Rating: 3
Once in a time, Microsoft comes with something really really interesting - I hope this will be something well done.
Never used much graphic image processing programs, but it looks like this will be very nice.

RE: Revolutionary
By Laitainion on 9/4/2006 9:39:36 AM , Rating: 2
Yeah, I for one will be *really* impressed if they can deliver.

RE: Revolutionary
By therealnickdanger on 9/5/2006 8:52:22 AM , Rating: 2
I remember reading about this in Wired (or something) a couple years ago. The article had to do with Microsoft's China labs and things they were working on there. An "unannounced photo-to-3-D tool" was one of the projects alongside "top secret Xbox technology".

The 3-D conversion thing is cool, no doubt, but it's the integration with search and geography that I find most interesting. More likely than not, this technology will find itself in two locations: and part of future versions of their photo editing suite. You know all those pictures posted on Well now you can search for other people that have been to Vinny's Pizzaria in Bakersfield, TX.

I took an extensive hiking trip to The Big Island (Hawaii) and spent considerable time trying to make a "photo journey" using Google Earth to share with other peeps. I can only imagine how much cooler it would be if Microsoft's application used its GIS powers to geographically link my photos to a map, let me walk around certain spots, bring up the history of each location, and find additional photos or video of the area...

Sure beats the hell out of traditional family slide shows (you know - with actual 35mm slides and the smelly, slightly water-damaged screen).

"So if you want to save the planet, feel free to drive your Hummer. Just avoid the drive thru line at McDonalds." -- Michael Asher
Related Articles

Copyright 2016 DailyTech LLC. - RSS Feed | Advertise | About Us | Ethics | FAQ | Terms, Conditions & Privacy Information | Kristopher Kubicki