November 9, 2006

It’s been just a few short months since we announced Photosynth at SIGGRAPH 2006 in Boston and boy have we been busy!

Today we’re very happy to announce the first public release of our Photosynth Technology Preview. For those of you who’ve provided encouragement, ideas and spread the word we thank you. We hope that you’ll enjoy our current work and continue to help us shape the technology as we push onwards. For those of you who found yourselves here after your buddy sent you a link to our website saying, ‘You’ve got to check this out!’, read a little about what we’re doing, try it out for yourself, and obviously tell everyone else you know. :)

We thought you might have some questions about this release and we’ll do our best to answer them. If there’s anything we haven’t addressed feel free to post to the comments in the blog and we’ll get to them as quickly as we can.

  • Q. What does Photosynth do?
  • A. Photosynth combines hundreds or thousands of regular digital photos of a scene to present a detailed 3D model, giving viewers the sensation of smoothly gliding around the scene from every angle. The scene can be constructed regardless of whether the photos are from a single or multiple sources. It’s like a hybrid of a slide show and a gaming experience that lets the viewer zoom in to see greater detail or zoom out for a more expansive view. By viewing the photos in a 3D context you are able to get a better sense for the place where they were captured.
  • Q. What exactly is a ‘Technology Preview’?
  • A. In essence a Technology Preview is a sneak peek at good things to come. Microsoft Live Labs is very much focused on pushing the state of the art of the internet forward and showing what’s possible today. We like to do things quickly and in a very collaborative way. Over time you’ll start to see more and more of our technologies work their way into great products across Microsoft, but in the meantime we want to get your feedback on what we’re doing right, and areas where we can improve. Being on the cutting edge unfortunately comes at a little bit of a cost so if your computer is more than a couple of years old, there's a chance that your graphics drivers may prevent Photosynth from running properly. If weird stuff happens, please install the latest drivers for your graphics card and try again.
  • Q.When can I build my own collections?
  • A. We’re working on it! We want to provide this capability as soon as we can but there are some real technical hurdles to solve before we’re ready for primetime. Today each and every image in a collection needs to be compared against each and every other image in order to see if it’s a match for the scene undergoing reconstruction. Processing to build a collection can take hours or days in some cases. We have lots of ideas on how to improve this processing time but we need some time test some of these ideas and make the tools easy for people to use. In other words, stay tuned and enjoy the collections we’ll be releasing in the months to come until we’re ready for our next big update.

Thanks and enjoy!
The Photosynth Team.

11/9/2006 5:19:17 PM UTC
Wow, great! I've been waiting for this to come! Good job people!
Posted by: xieliwei
11/9/2006 6:30:28 PM UTC
How about using our own Microsoft High Performance Computing offering?
Posted by: Adam
11/9/2006 6:35:18 PM UTC
I've been playing around with Photosynth and I feel that the controls are a little too unresponsive. For example, I have to spin my mouse wheel multiple times just to zoom in a little.

It would also be nice to implement mouse 3D controls (Left+Right click while dragging to shift on the x and y axis, Right click while dragging to rotate around cursor, etc)

I also find it hard to move around only relying on the scatter plots, it would be nice if all the images are slightly visible when not selected (like in the video).

So far the experience with the preview is just great and I love the design of the whole application, imagine the possibilities and uses for such an app!
Posted by: xieliwei
11/9/2006 6:39:56 PM UTC
This is way cool. The 3d view of the whole place was mind boggling. Waiting for more collections
11/9/2006 6:42:46 PM UTC
oups ... wonderfull....

very impressive ....
very usefull for architectural and urban (and landscape) photo ....
can shoot a landscape or a site ...in one collection ...

when can we do it yourself ?
11/9/2006 6:46:07 PM UTC
Okay, I'm posting too frequently but looking at the Grassi Lakes collection, I noticed that the photos were properly sorted even with those of the trees, moutain walls and reflections in the lake. I have dealt with similar applications like bojou before and these things are a headache even on sequential images, was Photosynth able to do the sorting autonomously or did it require any human hinting?
Posted by: xieliwei
11/9/2006 6:52:43 PM UTC
Wow... Really nice, been waiting a while for the preview and it's even better than I hoped.....

Found Steven Hawking in there too, can't post the link here though. :(
11/9/2006 8:03:04 PM UTC
Hey guys. Great job! When I first saw your videos I was very excited. But trying it on my own is much more than than just watching the videos. :)

Greetings from Germany.
11/9/2006 8:59:23 PM UTC
Looks good
11/9/2006 10:53:25 PM UTC
Tried to install this on three machines today. On an XP Pro with IE7 machine running a Matrox card who knows what happened. There were no error messages but it never installed. On an XP Home with IE 7 machine, graphics card not supported. On a W2K machine with IE6, OS not supported. I'm sure it's wonderful...
Posted by: Alan
11/9/2006 11:01:06 PM UTC
Q. What does Photosynth do?

Nothing - at least not on my PC :(

IE7 on XP should work right? just a spinning install logo for little old me.
11/9/2006 11:13:26 PM UTC
Stunning. When I saw the video of this a few months ago I was amazed but thought it would be years before we'd get our hands on anything. To have it available so soon in any form is an amazing achievement. Congratulations to all concerned and I truly can't wait until we can try our own photo collections with this.
Posted by: Mike
11/9/2006 11:31:48 PM UTC
You say that we can't do our own compilation of images as it would take too much processing power...

I'm sure you could limit us to 10-50 pictures instead of the hundreds or thousands you are most likely talking about.

However, good work. I did find it difficult to navigate to what I wanted to see, though.. As someone above said, why not have the images be sort of faded in the background instead of just a point cloud that, to the average user, is entirely nonsensical?
11/10/2006 12:41:28 AM UTC
I'm so impressed, this is amazing! Well done to the Photosynth team, I really wasn't expecting anything so soon =D

I'm most impressed by the lakes collection, I'd image nature to be a very tricky thing for the algorithms to make sense of. I'd also like to know did the software collate it autonomously?

I found naviagtion slightly difficult with only the point matrix, there seems to be a real fisheye effect on it at some positions which is tricky to make sense of as points. I realise an image overlay would be unfeasable on a lot of collections but it would help immensely I'd imagine, the video previews looked fantastic.

I'd also like some more navigation control, is it possible to have right click pan on the X/Y axis and middle click rotate around the current object?

Keep up the good work!
Posted by: Kenny
11/10/2006 1:24:47 AM UTC
Wow! Great job! I'm impressed! I've been itching to see how this goes since I heard the announcement sometime back. This is good stuff. It works fine without a hitch on IE 7, XP SP2 running on AMD Turion machine with Ati X200 chipset.

It dovetails with me being an (unemployed) IT Professional and landscape and architecture photographer. Hope I can lay my hands on the tools to make these soon so I can give it a whirl while I'm free... Hmmm what photo collections do I have... ;) Can you guys give advise on the Best Practices for the photos taken? I can start taking them before your tool to make one of these thingy comes out... I love to be able to show case this!

Keep up the good work!
11/10/2006 7:00:26 AM UTC
Impressive. As an engineer I am looking forward to the day I can visit a site and take only some photos and if needed, a couple of gps points, then, when I am back at the office use software like this to obtain 3D point data. I would then be able to use this model to create a TIN and calculate rough elevation differences, areas, and volumes then undertake preliminary design. I can see great benifits in software such as this and look forward to its continued development.
11/10/2006 7:26:39 AM UTC
there is a js-script error on my system.
i tested it out a little bit and realized that the ie cannot load the following script file
photosynth.js
could you check that please!
Posted by: Sascha
11/10/2006 11:22:37 AM UTC
Buuuuuh!

ActiveX for web applications is so passé!
Posted by: Jonas
11/10/2006 1:30:03 PM UTC
Nice to see MS is still clinging to its own, proprietary platforms. Down with ActiveX.
11/10/2006 1:31:05 PM UTC
Doesn't work in Firefox :( I don't have IE installed. Notice someone said its an active x control, what a no no - but you are microsoft so work with what you have i suppose.

Sounds very interesting though.
11/10/2006 3:51:16 PM UTC
Hey. Just wanted to say this tech preview is very nice. I expected it to be a standalone application but it's nice anyway. Movements are very smooth - even on this old Dell machine! Very impressed and can't wait for any improvements.

I was wondering if you've a high quality logo I can use in a review of the Photosynth tech preview?
11/10/2006 6:23:51 PM UTC
Really brilliant work! I saw some of the early demos, but trying it yourself is a really different experience. The 3D geometries it extracts are gorgeous.

I hope you'll consider providing the ability to export some of the results, perhaps via AVI or even standard 3D formats. I'd love to be able to use this as a tool for creating motion graphics ... and I'd love to VJ with the thing. Microsoft party, anyone?

I know you have a lot to work on in the meantime, of course.
11/10/2006 6:28:40 PM UTC
I've clicked on "Install ActiveX Control" at least 15 times. Nothing doing.
Posted by: Chris
11/10/2006 6:47:08 PM UTC
Unfortunately I have to wait until back in the office to see if it runs on a Acer 3000 with Vista. A Mac mini with Vista doesn't do the job (graphics card not supported). Would have been great to see this app running on a Mac :-) I hope the graphics card on the Acer is good enough, but I doubt it to be honest. Altough I am really looking forward to experience this, I won't be buying a new pc for it.
Posted by: bart
11/10/2006 6:49:42 PM UTC
UNBELIEVABLE! Microsoft finally does something cool. Actually, something VERY VERY COOL!
11/10/2006 7:03:43 PM UTC
Congratulations! This is the nicest piece of software, I´ve used 2006! I know that it is very hard to make such a complex software so smooth as photosynth is!
Posted by: Marcus
11/10/2006 8:25:45 PM UTC
Aww, I run Linux here at work and at home... and it won't run on our Windows machines, either. Maybe make a Linux version soon?

Microsoft's best product, so far. :)
11/10/2006 9:13:47 PM UTC
The first preview was really cool. New version, well, it's a no go on a Mac. God I miss the java version ! And I'm sure you had to work twice as much to do the transition instead of sticking to java !
Posted by: Yann
11/10/2006 11:13:06 PM UTC
Very impressive. I can't wait to upload to upload my own photos ;-)
11/11/2006 12:57:19 AM UTC
Absolutely stunning tool! Can't wait to get it!

Did anyone notice that Stephen Hawkins is in the Piazza San Marco? I found no way to mark the picture, but if you look for pictures that have a blue crane in them, you'll find him seating in his wheel chair talking to a few (3-4)people. If its not him, the similarity is striking.
11/11/2006 3:14:21 AM UTC
I went to the Philadelphia Phillies game on the last day of the home season and took photos all the way around the park to try out Photosynth. The quality is poor due to bad lighting and not using a tripod, but I look forward to using Photosynth to see if it will work with this collection.
11/11/2006 11:44:57 AM UTC
Wow.. I still had doubts from watching the Channel 9 video but this is simply amazing. I would love to have a product to do a similar thing with a slightly smaller set of photos and for doing larger sets, maybe sharing the work load between a number of computers using Vista's new P2P software. Collect together all of your friend's photos from a trip or holiday and build the scenes from all of them on the group's computers with shared processing.
The real gem is the hi-quality photo fast download, the graceful 'swing in to focus' as it downloads is very nice on the eye.
As a silly-cool feature, being able to set a piece of music and timing camera positions and changes between photos based on a timeline would also be neat. The ultimate photo slideshow.
Look forward to more news (and maybe a few more photo sets to play with in the tech preview? :) soon!
11/11/2006 12:43:12 PM UTC
For those grumbling about not being able to mark photos - click the envelope icon to "Email this view to a friend". It's not as handy as bookmarks or placemarks, but it'll do for now. Here's the "Stephen Hawking" picture

&im=images/IMG_3394.sdx&pos=-0.632411:0.0361638:0.0266574&dir=0.61896:-0.78473:-0.0329658&zoom=1&fov=12.1613&offset=0:0

Since we can't post links, just paste it on the end of the address when you're viewing the St Mark's Square collection
Posted by: Rat
11/11/2006 7:34:57 PM UTC
Looking great! I see the performance work really paid off :) Cant wait to see this powered by IIS7!
11/11/2006 8:29:03 PM UTC
Why not look at the technology that powers AutoStitch? It manages to quickly find matching images using SIFT pretty quickly.

Remember, 80% with some room for manual correction would be a good way to kickstart things, and get some great new examples from the rest of us.
11/12/2006 7:30:45 AM UTC
Nice. I've been keeping an eye on these projects over in the "Interactive Visual Media Group" section of Microsoft Research. So many good ideas in there, glad to see another one make it public.
Posted by: Craig Gemmill
11/12/2006 3:14:37 PM UTC
Doesn't work with onboard 256MB GeForce 6150 (ASUS M2NPV-VM) w/ Vista Ultimate RC2 (5744). DirectDraw, Direct3D, and AGP Texture are all hardware accelerated according to dxdiag. Drivers are 10/4/2006.
---------------------------
Photosynth Error
---------------------------
Photosynth couldn't acquire sufficient graphics resources to run properly.
---------------------------
OK
---------------------------

Any suggestions?
Posted by: John McGee
11/13/2006 10:16:42 AM UTC
Incredible. Now we just need cameras with built-in GPS and compass, so position and direction can be stored in the EXIF data. A few quadrillion images indexed and linked, in combination with services like Google Earth and we have the future.
Posted by: Øivind
11/13/2006 4:54:01 PM UTC
Impressive in it's preview form, can't wait to see where it goes. I'm thinking some way to go back/forward in time assuming pictures were taken different seasons/years etc.

Performance for the matching work might be something that the general purpose GPU programming library (MS's "accelerator" project) or compiler (eg Nvidia CUDA) to see if it could get those 10-40x perf improvements compared to CPU that Nvidia speaks about.
11/13/2006 9:48:02 PM UTC
This is the greatest thing I have ever seen Microsoft do. I can't wait to really use this. I do a lot of 3D CAD work and I see all kinds of potential for this software. After pictures have been loaded into Photosynth would it be possible to take dimensions off of the 3D point cloud? This would make my job a lot easier since we do a lot of custom reverse engineering projects. And will Photosynth only be a online program or will this be software you can install on your own computer?
Posted by: Todd
11/14/2006 9:39:40 AM UTC
This is a very interesting thing. It may redefine what is currently called Virtual Tour. All people think that virtual tour is what is presented on my site: ( I am prevented from posting the link, but visit my home page, and you will find it ), a software where you can visit a place and view it from different angles, look closer at items, a similar goal the Photosynth invention does. The Photosynth is great, but the main concern of introduction of it into practice is not the technology, but the quality of artistic work. Doing similar things for many years, I have learned that the presentation like in Photosynth open a lot of amazing new opportunities for photographers, probably never explored before.
The current program can not replace the vision and methods of an artist. Unfortunately most of the comments here are left by technical people while the real challenge is in creative work of the photographer. Even such sophisticated program like Photosynth will fade away its hype if there is no matching quality of the artistic photographic work. I'd like to give you several examples of mine: Las Vegas Virtual Tour and Alcatraz Virtual Tour.
It is probably for someone not as sophisticated technically as the example here since it does not have that flying effect, but tell me, is the content interesting?

Up to this time, it is naive to belive that any technological innovation can replace mind power of a human expert. At least not for a couple of years.

See you around!

Igor Polk, aka San Francisco Click.
PS. Search for me on San Francisco Virtual Tour and Alcatraz Virtual Tour.
PSS. Thank you guys for making such a sophisticated script. Fighting bad people with such intensity you disfunction the web.



11/15/2006 6:34:27 AM UTC
Looks great! Just wondering, what's language(s) and technologies are used to write this? I heard on the Gillmor Gang that there's an ActiveX in there somewhere?
11/15/2006 6:07:16 PM UTC
It's great, but when are we going to see a demo of Sea Dragon? I hope it's not being put aside in favor of photosynth. It's an equally promising product.
11/16/2006 6:08:00 AM UTC
does this work in XP64 and IE764 bit versions?
Posted by: ray
11/22/2006 1:42:32 AM UTC
It's quite cool. Seems very sensitive to external conditions, however, very prone to image corruption. If you're doing anything else on the system, with the window minimized or whatever, the thumbnails have all kinds of green and purple splotes, and sometimes half missing. If you happen to be covering up the window when the full image is loading, that too will get disrupted.

Are there controls for zooming waaaaaaaaay into a single image? Or is that as large as those ones get?
Posted by: foxyshadis
11/22/2006 6:47:31 PM UTC
"Processing to build a collection can take hours or days in some cases."

I don't mind at all! :-) I'd really like to give it a try...
11/22/2006 10:52:32 PM UTC
This is really awesome. I am following the updates on your blog and website for a while and was looking forward for this preview.

I think this has a huge potential for a wide range of disciplines. Specifically I would like to explore its use in historic preservation and the ability it provides for cultural heritage management. I am a PhD Candidate and for my research I am working on methods of documentation in cultural heritage and the process of their selection. I believe this could be a very efficient method of documentation both in terms of time and money.

I would love be involved and to see more and appreciate the opportunity.
11/29/2006 3:39:34 PM UTC
The technology is nice but it would really suck if to work with it you had to upload all photos. What about making it available for download and homeinstallation? Or even as free software? MS should finally take that step, only then this technology will have a real impact.
Posted by: man
12/6/2006 3:26:11 PM UTC
I'm very curious when a first public version will be released. Why not have everyone test it as beta like Adobe is doing with Lightroom? I see a lot of possibilities in the software and hope it will be launched in the first trimester of 2007.
If you guys would be looking for some more testers, i'll be happy to do so :-)
12/14/2006 2:43:09 AM UTC
Can you make it so that photsynth displays multiple photos at the same time? Point clouds are nice, but wouldn't a real 3d space be better?
Posted by: Peter
1/5/2007 8:18:33 PM UTC
What can i say.. wow.. it was an awesome concept and you carried it out flawlessly. an amazing project, i can't wait to photosynth my home town!
3/7/2007 3:20:25 PM UTC
There is a much larger picture here (no pun intended). This technology has both strategic and tactical significance to intelligence agencies, government or private. I'm surprised that the US government has not jumped on this with all fours. Just imagine, with a sufficiently large collection/database, a picture from an unknown source could , in theory, be located instantly. In essence, there would be nowhere to hide. And lets not forget that other technologies can "plug" into this. For instance, Googles earth maps, the Terraserver. In effect, you have created the beginnings of a framework for a holographic universe. Break off a section of a hologram and you still have access to a complete picture. Same goes for Photosynth. A photo, once in the Photosynth database, would have a connection to every other part of the whole. This technology has potential almost beyond rationality. And why limit yourself to photos of the earth? Why not apply this to medical applications. You see I a just brainstorming here, but the point has been made. This is a technology that will revolutionize the way we perceive our world.
6/1/2007 8:28:34 PM UTC
What is the most important information I should know about levitra? You can buy cheap levitra at my homepage :)
6/7/2007 2:02:32 AM UTC
It doesn't work on x64 with XP64 in firefox, IE, IE64??
6/14/2007 12:01:59 AM UTC
This is one awesome setup. I look forward to using this in the future. What is the timeline on availibility? I would also like to know if this works with ANY image file tag?
8/3/2007 10:47:51 AM UTC
good website
9/5/2007 8:00:05 PM UTC
I know that the Duet applications are built using metadata definitions that are interpreted during runtime and drive the different application's workflow and UI.
How is Duet's metadata defined and used? What are the advantages of this model?
9/10/2007 8:19:20 AM UTC
the next image in a tour that will take you through every photo in the set.
9/17/2007 3:34:03 PM UTC
How much would this product cost ? the enterprise version, if there is one.
9/20/2007 7:04:16 PM UTC
cool site, thanks
10/31/2007 3:26:20 PM UTC
Great post.....I will use it too.
Posted by: Sedona Tours
11/12/2007 6:46:09 PM UTC
THXX
2/16/2008 6:34:19 AM UTC
good!
2/21/2008 2:10:08 PM UTC
Hoooooo! great! I've been waiting for this to come! Very good job, thx.
3/5/2008 9:09:06 AM UTC
Photosynth is going to be awesome
4/18/2008 4:03:00 AM UTC
Photosynth is going to be awesome
4/22/2008 3:26:27 PM UTC
I'm agree with you.
4/24/2008 6:35:02 AM UTC
I join you guy here!
4/24/2008 6:36:09 AM UTC
good place for links
4/25/2008 9:59:48 PM UTC
I'm agree with you.
4/26/2008 7:27:31 PM UTC
cheapest next day butalbital
4/26/2008 7:32:31 PM UTC
Prozac delivery
5/14/2008 1:33:26 PM UTC
thanks alot
5/14/2008 1:36:20 PM UTC
thanks alot
5/14/2008 6:01:41 PM UTC
Yes, I'm agree...
5/15/2008 12:06:04 AM UTC
thank u
5/15/2008 12:07:20 AM UTC
thank u
5/15/2008 12:08:34 AM UTC
thank u
5/15/2008 12:09:32 AM UTC
thank u
5/15/2008 12:10:41 AM UTC
thank u
5/15/2008 12:11:57 AM UTC
thank u

Post a new comment

Name
E-mail
Home page
 
Comment (HTML not allowed)  
Enter the code shown (prevents robots):


© 2006 Microsoft Corporation Privacy Terms of Use