Topic: Hyperlapse, another use of Photosynth tech

Report Abuse Report Abuse
Joscelin.Trouwborst (Over 1 year ago)
From Ms Research

@Nate. I bet you love this. And sure those who fly drones with GoPros.
Nathanael (Over 1 year ago)
Thanks! I'd seen this listed on a few researchers' profiles at MSR but was waiting for them to put up their presentation.

I've also had an unposted forum topic asking about whether Photosynth has any plans to scale their work to handling video.
We'll see how long we have to wait to use this.

Video has motion blur and low resolution as deterrents but offers much in the way of spatial overlap.
I've wanted a way to solve for the camera positions for all frames a video before but as mentioned in Johannes' presentation, iterative bundle adjustment applications like Photosynth don't handle many similar input frames very well. (Neither does ICE, for that matter, when simply panning.)

You can find previous reference to the term hyperlapse in Blaise's interview with Kate Torgovnick May at TED Global 2013:
" certainly can get hyperlapse-like things, where time and space both flow together."
elph (Over 1 year ago)
I've actually loved using the Photosynth software to make videos, it would be amazing if it could be used in HD. So far I've used the videos to create movements that would only be possible with a dolly track. It's also great as a tool for showing how a camera movement might work to a director really quickly.

I actually really like the glitchy-ness too. :-)

I'm going to look around the forum to see if there are any more conversations about video, Photosynth really is some super future software.
NateLawrence (Over 1 year ago)
Hey, guys, the Hyperlapse team released their apps on 2015 May 14.

There is Hyperlapse Pro for Windows desktop, and also Hyperlapse Mobile for Windows Phone and Android.

Note that all of these will do something a little different than what was shown in the 2014 research, in that they are using 2D motion tracking on mobile devices to smooth captures in realtime with limited processing and battery power. You can learn about the differences in their 2015 SIGGRAPH presentation:

If you want the 3D tracking seen in the original videos that Joscelin linked to above, you'll need to check the option for 'Advanced' smoothing in Hyperlapse Pro.

Here's the Hyperlapse team's homepage:

Here's a video introducing Hyperlapse Pro:
Once again, I recommend turning on the 'Advanced Smoothing' option as a Photosynth user.