July 27, 2006

Welcome to ‘Photosynth’, Microsoft Live Labs first major Technology Preview. The team is very happy to give you a sneak peek at our latest work which we’ll be demonstrating next Wednesday 8/2 at SIGGRAPH 2006 in Boston.

Photosynth takes a large collection of photos of a place or object, analyzes them for similarities, and displays them in a reconstructed 3-Dimensional space. With Photosynth you can:

  • walk or fly through a scene to see photos from any angle;
  • seamlessly zoom in or out of a photograph even if it's gigapixels in size;
  • see where pictures were taken in relation to one another;
  • find similar photos to the one you’re currently viewing;
  • explore a custom tour or see where you’ve been; or
  • send a collection to a friend.


We plan on releasing some collections for you to see and experience yourself in the very near future, so add us to your RSS reader and check back often for updates. We’d love to hear your ideas and suggestions and help us shape Photosynth over the months and years to come. In the meantime, take a look at the videos and learn a little bit more about how Photosynth works.

Curious about who we are? We’re a team of Microsoft scientists and engineers on a mission to fundamentally rethink the internet experience, experiment with entirely new paradigms and change the world through ideas and software. Our founder Dr. Gary Flake, started Live Labs in February 2006 and since then many members of the team have been working around the clock to develop their concepts into a reality. Photosynth is just the start of what we hope will be a series of technologies that will change the way you use the internet.


Thanks for visiting!
The Photosynth Team.

7/29/2006 9:25:30 AM UTC
Cool
7/29/2006 9:30:46 AM UTC
THIS IS THE COOLEST THING SINCE SLICED BREAD! If you need somebody to test out the beta, ill be the first one to raise their hand!
- Scott Springer
7/29/2006 1:31:41 PM UTC
Seen the videos, the interviews on 9 & 10... simply unbelievable. Can't wait to test it on my shots :D.

Hope to see soon more technical details on it ;).

You did an awesome job, one of the most cool things i've seen around for a while.

BTW since it's a Microsoft "product" is it plausible to see integrations with MSR's Media Browser we've seen some time ago?
7/29/2006 2:04:11 PM UTC
Amazing work, cant wait to see its online integration!
7/29/2006 4:51:49 PM UTC
Thanks for the comments folks. We're all as excited about the potential of Photosynth as you are. It's still early days but we're working hard on refining the core experience and will have something that you can run on your own machine in the near future.

Siggraph on Wed will be the next opportunity to see Photosynth in action!

Adam Sheppard
Group Manager
Microsoft Live Labs.
Posted by: Adam Sheppard
7/29/2006 6:33:15 PM UTC
Any chance this will work for pics of a supermodel? :)
Posted by: Anonymous
7/29/2006 7:39:16 PM UTC
Reminds me of Paul Haeberli's early work in this area at Grifica Obscura

7/29/2006 8:31:40 PM UTC
That's incredible, looks fast and very usable too.
7/30/2006 1:54:45 AM UTC
Just looking and thinking about this, there's so much more that could be done with it.

For example:

Taking a video tour, extracting the individual frames, and importing them into Photosynth to make a 3D model of the area.

Using photographs from 2 (or more) different perspectives to make a texture-mapped model. So, in the example given in the videos, not just display a "Point Cloud", but actually making and rendering a full seamless 3D model of the buildings, which you can then move around and fly through/into, to get to see the buildings in angles and details that would be impossible (or at least difficult) from the ground.

The latter would be especially useful for protected landmarks like Stonehenge, which you can no longer walk through. With this you could circle the stones, capturing images (Or one long video segment, which is then split into images) and when you get back assemble a full 3D model of the stones, to sit in the middle of them and look out, etc.

Just a few ideas.
7/30/2006 8:35:11 PM UTC
This seems to be a huge challenge for software like elcovision, rolleimetric or photomodeler. Is there any measurement tool planned for this software, or how accureate are the 3d models?
7/31/2006 9:37:59 AM UTC
A very usefull tool for travelers and the tourist industry.
7/31/2006 3:08:22 PM UTC
What's exciting about this technology is that one day it might be possible to run this with a large photo repository, such as flickr, where there are millions of photos of places all over the world.

I wrote a bit about this on my blog (click my name).
7/31/2006 3:36:34 PM UTC
I just hope the technology will meet the expectations and the hype. It would indeed be cool for the entire travel industry and might even improve the "virtual tourism" trend. Virtual Beirut seems a lot safer than the real one...
7/31/2006 3:39:44 PM UTC
Wow looks fantastic guys! Love the idea of being able to lookup information about an object in a photograph. Looking forward to seeing Photosynth live...should be all the rage at Siggraph.
7/31/2006 4:09:17 PM UTC
Wow. This is a really impressive project with a lot of potential uses. Have you folks in Live Labs considered the possibility of using this technology for historical recreation and change detection? The demos online seem to focus on 3D analyses, placing images in context with each other under the assumption that things are relatively static, but what about bringing in the 4th dimension of time?

Think about it – you could use this system to not only create a 3D map of a city, but with enough historical photos you could watch that city grow over time. My own background is in environmental analysis, and I think that this technology would be a great tool for analyzing natural phenomena such as erosion, vegetation change, the advance and retreat of glaciers, etc. I bet that a partnership between Microsoft, USGS (you've already got TerraServer), the National Park Service, and others could create a wonderful visual historical repository of our natural and manmade landscapes. It might not be as profitable as the ideas you talk about here, but it would be a great contribution to our national heritage and a wonderful educational resource.

I’ve actually pondered the possibility of creating a tool such as Photosynth for visualization of environmental change over time, only with manual alignment of images with each other (and with digital terrain models), but I could never get anyone else excited about the idea. I’m glad you folks came up with something similar...in fact, more advanced...and had the resources to bring it to life! I look forward to seeing where you go with this project.
7/31/2006 5:50:01 PM UTC
I'm curious: during the interview it was stated that the technology was originally written using OpenGL, then moved to DirectX. In the same breath it was said that it was intended for as large an audience as possible. Wouldn't OpenGL be better in that regard, since DirectX is a Windows only technolgy? OpenGL aslo opens things up to MacOS, Linux,, and others...
7/31/2006 6:23:06 PM UTC
This is great stuff. I saw it demoed at TechReady and can't wait to try it. I have also posted a link to your site off of my blog
7/31/2006 7:55:09 PM UTC
What Obscene or inappropriate words ?
Posted by: frustrated surfer
7/31/2006 10:47:23 PM UTC
This is really impressive!
I can easily imaging a whole virtual earth created with all the images that can be found on the internet.

Photosynths technology could be used in various programs and systems like navigation systems, MS Virtuals Earth like programs, games, etc..

Keep up the good work!
I can't wait for the beta release and to start photographing my home town.. ;)

Elja
8/1/2006 3:25:59 AM UTC
I'm really curious how the SIGGRAPH presentation will go, but there's no way for me to be there. Will there be any type of live stream or archival footage available?
8/1/2006 6:48:36 AM UTC
foresmac brings up OpenGL and cross-platform compatibility. In a nutshell: we have rendering abstractions that decouple our code from the graphics library. Rather than rip out the OpenGL, we've simply made an instance for DirectX, and thus in principle still have OpenGL support. I can't yet make any firm predictions about which platforms we'll support (other than that Windows will be one of them :) ) but we're leaving our options open. My personal preference, and one shared by many of us at Live Labs, is that the more platforms we support, the bigger the ecosystem, the better. We're also a small team with limited resources and concerns about multiplying our test matrix and bug count, though. Our tech preview will therefore almost certainly be Win-only, but I hope that's not the last word.
8/1/2006 9:08:47 AM UTC
Amazing program. Wish I could help testing.


T
8/1/2006 10:43:50 AM UTC
OOH LA LA...all that fuzz for what? is it anything other than the obvious turned `genius`...it is a joke to imagine such people static in surprise and easly entertained!!! Could we call it `deja-vue` or shall you folks get down to your knees and try hard to be humble and simple at once?!
8/1/2006 12:10:40 PM UTC
hello

very impressive function in ...

BUT WHY don't use the cloud of point for RECOMPOSE AN 3D ?!?

very usefull for my job!!
using to scan quickly an old or existing building...
integrate 3D view with 3d or Architectural software !?!

"Bonne continuation et bonne chance"

N.C.
8/1/2006 1:13:38 PM UTC
check out the java demo, and another amazing video that showes even more:
phototour.cs.washington.edu
Posted by: Doron
8/1/2006 4:02:50 PM UTC
WOW! I'll love to test it out on our more than 10.000 high-resolution facade- and aerial photos of our City. Let me know if you want to put it to the test ;-)
As Cedric mentions, I'd like to see you take it further to construct 3D models as well...
8/1/2006 4:32:02 PM UTC
Hmm, O.K. interesting. Processing time? The video was amusing, it spends half of it in describing nothing at all but psycho-babble - then the rest being extremely vague, a sort of technology desperate for a market thing. with people nodding it's uses with 'I don't believe in what I'm saying either' looks.
If I took photos of something inanimate, it probably won't be major landmarks because you can get those pictures anywhere on the internet.
Yeah, I'm playing devil's advocate. :)
I should imagine there's a market for the computer games industry modelling, or even medical imaging.
Posted by: Dave H
8/1/2006 4:40:57 PM UTC
This looks amazing and can only get better and bigger !

Will be interesting to see how images taken will different cameras at times of the day/year would mesh together. I guess eventually we'll have the choice of seeing a version of every building/scene in the world in the Sun, or in the rain, or at night, under snow ... beaches at high-tide, low-tide ... and for our kids, maybe : 'Today', 'One Year Ago', 'Five Years Ago'... 'The Year I Was Born' !!! can't wait !


( BTW couldn't find an direct email address, so I'll add this here .. the video page has "320x180 (255MB)" .. I'm guessing this should be '25MB' )
Posted by: Phil H
8/1/2006 5:06:35 PM UTC
Very well done, and I love all the suggestions for how this can be extended, and I have a couple of suggestions that I would personally love to see.

1. Could you consider adding something to the algorithm that allows users to remove parts of an image. Professional photographers are often given access to 'behind the fence' whereas regular tourists often find their photos are obscured by these objects or by other tourists getting in the way.

2. Is there any possiblility that tactile (texture) information could be added to the database so that if a VR headset and glove were to be worn then the experience could become more than visual?
Posted by: Carl Galloway
8/1/2006 5:22:06 PM UTC
I have not seen any demo of this process, but as I understand stereoscopic photography, the eyes cannot merge two displaced images without the use of either a lenticular screen or special glasses. Real 3-D wihtout the glasses, screen or special stereoptic viewer is not possible.
8/1/2006 6:37:39 PM UTC
***AMAZING!*** Have you considered merging this with websites like the one below which give an inter-active streetscape panorama from famous streets? May be a perfect moment for your companies or whoever to put your heads together.
Posted by: Shakrah
8/1/2006 6:44:17 PM UTC
(click my name to see a suggested site)
Posted by: Shakrah
8/1/2006 6:58:21 PM UTC
Why not use video? That should generate even more data? Thousands and thousands of frames!
8/1/2006 8:43:35 PM UTC
Really interesting work.
It is clear that as more and more of the "real" world gets digitized then there is going to be vast amounts of data out there to manipulate.

What would be truely groundbreaking would be to re-construct an event. For instance in London recently there was a street theatre event called the "sultan's elephant"

There are at least 10,000 photos of this on Flickr alone.


Applying technology like this to data sets like that (with time stamping / GPS) it would be possible to create a complete 3-d record of the event after the fact.

8/1/2006 9:11:20 PM UTC
As a consistent Linux user for the last four years, this is the only reason I've seen in years to run Windows on a computer.

Two things that I'd personally find to be extremely useful to researchers across the board. First, the ability to build a textured CAD model from photographs would revolutionize everything. I know that the concept itself is incredibly obvious, but implementing it is, I imagine, very difficult. Well worth a dedicated computer running Windows if that functionality existed.

Second, the ability to change perspective in an image, and in particular the ability to draw a series of origins and vectors from which the program would automatically render and output new images of what the picture would look like from that angle. This would be particularly useful for some photography I'm doing, as well as for any people wanting to do things like make stereograms, slideshows, etc.
8/1/2006 9:39:18 PM UTC
This is going to change the way you buy an airline ticket, to selling your house. Revolutionary is the only word I can find to sum it up. In the last 5 minutes I've thought of dozens of applications for this covering business, entertainment, education, leisure....
8/2/2006 1:56:42 AM UTC
Preview at Siggraph? Where and what time?
8/2/2006 4:08:27 AM UTC
Wow this is the coolest thing I have seen from Microsoft in a long time. I cant wait to try this out.
Posted by: Novaoblivion
8/2/2006 4:14:57 AM UTC
ปัญญาอ่อน
8/2/2006 5:13:59 AM UTC
Hi I have some questions.

The java applet keeps on flashing, and I dont see a triangulated, textured mesh, if there is one... I am on jre 1.5.02. Tried IE,firefox,Opera.

I would very much like to see a wire frame version.

And how much is the expected price.

Thanks
8/2/2006 5:23:17 AM UTC
This is AWESOME!!!
If only I had it a few years ago... it would have made my art project so much easier...

I was wondering if you could somehow paint (or create in one way or another) images to 'trick' or 'manipulate' Photosynth to create a piece of art or some sort of illusion?

Also - how 'similar' is 'similar'? Could you somehow adapt this technology to help evolutionary scientists categorise/date/relate various specimen?

This is just super cool.
8/2/2006 6:48:53 AM UTC
Very impressive if it actually works. Can it be done "live"? or in other words could you use two or more video feeds to create a virtual camera? If so it would greatly improve video conferencing because it would allow you to see eye to eye with people over an internet connection. Usually people look at the screen, not the camera so people look like there always looking away from you... not as intimate as eye to eye.
8/2/2006 8:35:34 AM UTC
Imagine every frame from every video ever shot, every photgraph ever taken, all linked in three dimentions. A point cloud of the entire planet. Utterly revolutionary.

Incorporating time into this model just boggles the mind. Wander around a high resolution model of the entire planet. It's raining in St. Marks Square? Go back to yesterday - it was probably sunny then. Want to see Big Ben at sunset? In the snow? At a solar eclipse? The possibilities are literally endless.
8/2/2006 10:58:52 AM UTC
Amazing, stupendous.............
So are we in for a very advanced version of Virtual reality?
Can't wait to put my hands on the beta version....atleast for the time being.

Need more documentation on the functionalities and technical knowhow of this houdini.

So long......
8/2/2006 12:09:52 PM UTC
I've seen the c9 vidoes and those on the official site and I am very excited about this technology, you have done fantastic work. I do however have a question:

How do you handle information collision? Lets say a crawler collects 2000 images of Piazza San Marco in Venicia / Italy. Now you build these into the database and can navigate. Now what if something happens here? Lets for the sake of argument say that the tower falls down during renovation. Subsequent photos that enter the database will now be missing a key feature. How do you handle things like these as the database grows?

Oh, and an aditional question: Do you have plans to implement this technology in "personal photo" software? IE, will I be able to arrange my own vacation pictures like this for my own amusement or will everything have to be uploaded / collected by a central server?

I hope you have time to answer these questions. Anyway, you have all done brilliant work and I cant wait to see where this is going!
Posted by: Kim Robert
8/2/2006 12:15:45 PM UTC
Another possible application would be to use this in forensics. Imagine stitching up all the crime scene pictures both overview and close up and getting an overview of a crimescene like you never had before. All in all this has so many interesting applications I hope it doesn't remain closed to only Microsoft applications.
8/2/2006 1:16:33 PM UTC
so i presume you could tie in webcam feeds from the internet? most web-based ones are simply a refreshing jpg - imagine a series of webcams providing a realtime video feed via refreshing jpgs for an area. Uber cool my friends.
8/2/2006 1:31:17 PM UTC
Along the lines of the previous post. Colleague of mine pointed out that a Dutch company (name unknown) currently uses technology like this to combine multiple pictures of limbs in such a way that they can get exact measures to make certain prostetics. I don't know if this is already in 3d, but you could imagine using this technology as a basis for further modelling. The application would be that you take pictures of the person and use it to accurately 3d model that person for for instance . It might save money on laser systems. (would also be something for made to measure suits?)
8/2/2006 1:32:08 PM UTC
Hello this is an amazing thing.

I thought about something similar, but I´ve never figured out how to work with the factor TIME in an application like photosynth. Are you planning features, that solve this factor TIME? The photos of places in the realworld wouldn´t after one week. Different people, weather and a few more objects will be changed then. I guess you could add a timeline, that allows the user to switch from one timemark to another. And this gives you more potential, because there could be videos. I´m curious of your development.
8/2/2006 2:30:00 PM UTC
This software sounds fantastic!
and will make my job a hell of lot easier! My company has been tasked with building a virtual version of a city, by the city's council.
As I am photo-texturing all my models, I have hundreds of photographs of the architecture around the city. Can't wait to try this software out! Looking forward to trying out the Beta version!
Wishing you all good luck!
Ben.
8/2/2006 2:50:25 PM UTC
i work for a survey company that specialises in non contact accurate survey photogrammetry. This product, with careful manipulation could revolutionise the non contact surveying industry as we know it.

i would also like to see a 3d textured model generated from the results.

You must be using a powerful sift algorithm.

I also like the way you can work with large picture bundles easily. Nice.

Excelent work.

If you need any beta testers. i'm ready........
8/2/2006 3:59:10 PM UTC
Uau thats amazing.... hi im from argentina and im studying system engineer and I love all this stuff... i dont have words to describe the amazment while I was watching the video...
CONGRATULATIONS!!!
8/2/2006 4:00:41 PM UTC
I would be very proud if I could test it... thanks!!!
8/30/2006 4:03:40 AM UTC
is the furture going to be great! what a ride we are on, i have a 50 inch plasma running vista took 8 trys to load, put my name on beta list!! i have 6000 jpegs!
8/30/2006 2:43:06 PM UTC
DEB RAY RULES!!!
Posted by: Oz
9/6/2006 2:16:15 PM UTC
When can i get my hands on a beta version?
9/16/2006 1:45:58 PM UTC
To Blaise Aguera y Arcas:

I watched the PhotoSynth preview show, without blinking.
The Noble of physics should be yours, honestly!
Years I was dreaming about sorting pictures by appearant similarity, but just a dream!
I am looking for the day I can install PhotoSynth on my this very machine!
10/21/2006 7:26:45 AM UTC
i would like to see the Beta soon and beable to test it for my self
i can do a full review i was wonderind if ther is a beta or demo of the program out there
i realy would like to see it for my self i will pay for it if it is down payment on the full thing
11/10/2006 9:41:33 PM UTC
This NEEDS to be merged with google maps...
12/7/2006 4:22:59 PM UTC
This is totally amazing ... absolutely stunning work!!! It seems to just jump out of one of those sci-fi movies... Great job at putting this app and taking the pains of having a demo with images preloaded so we can explore the full capabilities of the app..
4/4/2007 12:48:06 PM UTC
After reading about photosynth and as a person who can visualize the Internet timeline.
I want companies like Microsoft, Yahoo and others to come together and work on projects of this magnitude.

Why you should do this is because by yourself, you will not be able to finish this and make it look good. Its like making a car on a assembly line and with respect to time vs innovation, it will soon be impossible for a company to make a complete car which will be accepted and could be sold on time!
9/10/2007 8:23:49 AM UTC
the next image in a tour that will take you through every photo in the set.
9/13/2007 1:07:48 PM UTC
I find the idea interesting, when did it all started ? back in the days when the 360 rotating pictures were born ?
10/6/2007 4:41:03 PM UTC
Seems very savvy - great reviews are bound to follow I'm sure!
10/10/2007 9:58:46 AM UTC
Very useful. I found this to be a joy to browse in.
11/6/2007 1:47:33 PM UTC
This is a great idea. It's very useful.
11/12/2007 6:43:36 PM UTC
THXX
1/18/2008 3:15:43 PM UTC
very nice indeed
1/18/2008 3:17:50 PM UTC
Superb idea. Nice one MS
1/29/2008 6:32:48 AM UTC
such a concise explanation..
2/9/2008 6:33:02 AM UTC
Hi,

A very good idea.Any update ?

Thanks


2/16/2008 6:36:40 AM UTC
good!
2/17/2008 5:58:08 PM UTC
wow - interesting stuff
2/22/2008 5:22:41 PM UTC
so good!
2/22/2008 5:23:40 PM UTC
This is a great idea. It's very useful.
2/28/2008 8:04:58 AM UTC
This is a great idea. It's very useful.
3/29/2008 8:57:59 PM UTC
Preview at Siggraph? Where and what time?
3/29/2008 8:59:17 PM UTC
This NEEDS to be merged with google maps...
3/29/2008 9:00:18 PM UTC
the next image in a tour that will take you through every photo in the set.
Thank you
3/29/2008 9:01:28 PM UTC
Great job at putting this app and taking the pains of having a demo with images preloaded so we can explore the full capabilities of the app
4/2/2008 6:12:00 PM UTC
great post thanks
4/4/2008 9:09:02 PM UTC
I love all this stuff! Great work
4/4/2008 9:14:10 PM UTC
PhotoSynth preview is amazing. Excelent work!
4/10/2008 12:15:28 AM UTC
thanks nice text
4/10/2008 3:53:49 AM UTC
good that we cat try it in full
4/10/2008 3:55:11 AM UTC
if this soft would be connected with google maps... would be beatifull
4/10/2008 3:57:00 AM UTC
fun application to play with
4/10/2008 3:59:10 AM UTC
amazing, like came from future.
4/10/2008 4:00:58 AM UTC
having rendering abstractions that decouple our code from the graphics library - just love it.
4/12/2008 3:53:28 PM UTC
thanks!
4/16/2008 11:09:16 AM UTC
I must say Im quite impress with this new toy from MS :)
4/18/2008 4:15:53 AM UTC
I must say Im quite impress with this new toy from MS :)
4/18/2008 1:24:44 PM UTC
That's relatively good, but still needs to improve.
4/21/2008 3:05:07 PM UTC
Thank you v good information
4/21/2008 3:07:32 PM UTC
GREAT info thanks
4/24/2008 6:59:49 AM UTC
Share my page!
4/26/2008 7:26:50 PM UTC
Order Fioricet
4/26/2008 7:31:48 PM UTC
Ordering Wholesale Tramadol
4/28/2008 6:51:20 PM UTC
thanx for this good information.I like This Blog.
4/28/2008 6:52:48 PM UTC
thank you very nice good point.
4/28/2008 6:54:57 PM UTC
Yup I like this
4/28/2008 6:56:22 PM UTC
Thnak you I like this post.
5/14/2008 1:40:59 PM UTC
thanks alot
5/15/2008 6:32:51 PM UTC
thank u
5/15/2008 6:33:50 PM UTC
thank u
5/15/2008 6:35:03 PM UTC
thank u

Post a new comment

Name
E-mail
Home page
 
Comment (HTML not allowed)  
Enter the code shown (prevents robots):


© 2006 Microsoft Corporation Privacy Terms of Use