Hyperlapse: smooth first-person action time lapse videos

Some really cool technology in the making: take a helmet cam, go running, climbing, whatever action you’d like to film, and this software will reconstruct a smooth time lapse based on some clever algorithms!

We present a method for converting first-person videos, for example, captured with a helmet camera during activities such as rock climbing or bicycling, into hyperlapse videos: time-lapse videos with a smoothly moving camera.

At high speed-up rates, simple frame sub-sampling coupled with existing video stabilization methods does not work, because the erratic camera shake present in first-person videos is amplified by the speed-up.

Our algorithm first reconstructs the 3D input camera path as well as dense, per-frame proxy geometries. We then optimize a novel camera path for the output video (shown in red) that is smooth and passes near the input cameras while ensuring that the virtual camera looks in directions that can be rendered well from the input.

Next, we compute geometric proxies for each input frame. These allow us to render the frames from the novel viewpoints on the optimized path.

Finally, we generate the novel smoothed, time-lapse video by rendering, stitching, and blending appropriately selected source frames for each output frame. We present a number of results for challenging videos that cannot be processed using traditional techniques.

And this is HOW it works:

Source: http://research.microsoft.com/en-us/um/redmond/projects/hyperlapse/

SkyStudioPro – new version: 1.1.0.27

I’ve uplodaded a newer version of SkyStudioPro, version 1.1.0.27

What’s new in version 1.1.0.27

– fixed interval times >10 minutes
– added 5 minute interval time
– added warning in case codec changes (happened when you install/uninstall codecs)
– fixed scaling options when using large fonts (feedback welcome)
– fixed quote issue in output filename field in SkyStudioProVideoCompiler

Get it here

About SkyStudioPro

SkyStudioPro is a freeware time-lapse and motion detection application for the Windows® platform. You can use it to capture time-lapse movies using almost any capture device or web cam. It also features motion detection, you can set it to record movie clips when motion is detected.

Freeware

SkyStudioPro is freeware – you can download and use it free of charge.
There are no limitations to the free version, because there is no commercial version.
Of course, if you want to support the development, you could consider making a donation.

SkyStudioPro version 1.1.0.21 – updated with MovieCompiler

There is a new version of SkyStudioPro available for download: 1.1.0.21

I added a brand new VideoCompiler that you can use to make movies of image sequences. This means that you can now use SkyStudioPro for stop-motion movies as well!
The video settings in VideoCompiler are almost the same as in SkyStudioPro, so you’ll know how to use it right away.

New in this version:

– Upgraded VideoCompiler to version 1.0.0.1
– better GUI and useful hints in VideoCompiler
– preview function in VideoCompiler
– Intergration of VideoCompiler with SkyStudioPro
– better “file closing” when time-lapse movie is saved

SkyStudioPro is a freeware time lapse and motion detection application for the Windows® platform.
You can download it from http://www.skystudiopro.com

SkyStudioPro version 1.1.0.18 – updated

There is a new version of SkyStudioPro available for download: 1.1.0.18

New in this version:

– folder creation by date is now optional
– prevent screensaver from running
– prevent stand-by of sleep mode
– lots of useful hints added in mouse overs
– button for auto-sizing of program window

SkyStudioPro is a freeware time lapse and motion detection application for the Windows® platform.
You can download it from http://www.skystudiopro.com

SkyStudio Pro – freeware time-lapse & motion detection software

SkyStudio Pro is a freeware time-lapse capture & motion detection application for Windows®. It allows you to capture high-res time-lapse footage at any size, any speed with any capture device or web cam.

SCREENSHOT

SkyStudio Pro screenshot

SkyStudio Pro screenshot

DEVICE SETUP

SkyStudio Pro device settings

– select video capture device, any Windows device, capture card or webcam will do
– select audio device, not really needed for time lapse video
– video capture dialog to access your driver settings
– audio capture dialog to access your driver settings
– capture size, e.g. 640×480
– capture resize, allows you to take huge frames from your webcam and resize them on the fly for better sharpness.
– frame rate, allows you to take slow shots from webcams, will enhance light quality at night. Lower frame rate means more light

notes:
– all settings are stored by video device. Changing the video device will open its codec, time-lapse and motion settings.
– recorded avi will have either the selected captured frame size, OR if resize is checked, the resized frame size.

SAVING, RECORDING

SkyStudio Pro saving & recording

– storage folder: root dir for saving movies. Subfolders will automatically be created by date.
– Live codec: codec used for live capture.
– Time-lapse codec: seperate codec can be selected for time-lapse movies. Use as high as possible quality here.
Personally I favor FFDShow codec at 95% quality. Relatively small movies, great quality & sharpness.
– config buttons open the codec config dialog.

note: live video uses lot of cpu, make sure your codec is suitable for live recording

TIME LAPSE

SkyStudio Pro

– preview display shows how your time lapse will look. Click to pause/resume. Below are two bars: the upper shows current playback, the lower shows current frame being recorded.
– current date/time, frame rate and frame number is added to each frame (top left)
– interval: gap between each frame taken from your capture device. 5 sec means every 5 seconds a snapshot is taken and added to the movie
– Fps: the final avi will run at this frame rate. Recommended: 25fps
– auto-save: saves the movie and starts a new one after x frames. Purpose: if your pc crashes for whatever reason, you’ll still have most of your movie.
– recording: check to record, uncheck to stop recording
notes:
– with a 1 sec interval and 25fps, your final movie will be 25x faster than reality, playing 25 seconds of real captured time per second in the final movie.
– with a 5 sec interval and 25fps, your final movie will be 125x faster than reality and so on.
– you can change the fps during recording, but it will only have effect on the next recorded movie.
– at the start of every recording, the frame size and fps of the recorded video is set, and does not change during recording

MOTION DETECTION

SkyStudio Pro motion detection

– check/uncheck to activate/deactivate
– noise filter needs no explanation other than that it uses some cpu
– proportional: sets a baseline for the motion values, and outputs motion as a “relative” value. As opposed to “absolute”.
– slider: if the motion value is above the slider, it triggers a “motion event”.
– Autom.treshold: sets the treshold slider about 10 points above the average motion of the last 25 frames.
– ON MOTION: if the motion value is above the treshold, a motion event is triggered. Two options: start recording live video, or speed up the current time-lapse.
The latter creates a nice “bullet time effect”. Imagine your time lapse showing clouds speeding by… when an object triggers a motion event the time lapse slows down to real speed. When the object is gone, the video speeds up to time-lapse speed again!

Operating System & requirements

– this program is provided “as is” – no warrantee or guarantee. I developed it for my own use, if it works for you too: great.
– this program has been developed and tested under Windows 7 (x64).
– it will probably work fine under XP and Vista, feel free to test and feed back.
– faster PC, better results. Time-laps does not use much CPU, motion detection does, especially at high frame rate.

LICENSE

This software is freeware for non-commercial use. It uses Mitov’s components for Delphi: AudioLab, VideoLab, VisionLab. Many thanks and credits to him for making these components available for non-commercial use. You can find his website at http://www.mitov.com/
The SkyStudioPro software is developed by DjSadhu – http://www.djsadhu.com

DOWNLOAD




SetupSkyStudioPro.zip (1.75Mb)


version 1.1.0.15

For questions or suggestions: dst [a t] djsadhu.com.

Time-lapse script

I have been capturing video from the sky for years. When I used to run Windows, I wrote my own software for making time-lapse movies.
After I switched to Linux (first Ubuntu 9.04, now Linux Mint 7) I had to “reinvent” time-lapse capturing.
Then I came across a nice script that I could modify. Run this script in a terminal:


#!/bin/bash

echo TIMELAPSE SCRIPT by DjSadhu
echo "Video device?"
read devnum
echo "Video input?"
read inpt
echo "Frame interval seconds?"
read intv

[ -p my.fifo ] && rm my.fifo
mkfifo my.fifo

mplayer -slave -quiet -input file=my.fifo -vf screenshot,scale=768:576 -tv driver=v4l2:input=$inpt:fps=1:norm=pal:width=768:height=576:\
device=/dev/video$devnum tv:// &
while true
do
echo "screenshot 0" >my.fifo
sleep $intv
name=`ls -tr shot*.png | tail -n1`
mv $name img/timelapse-`date +%y%m%d_%H%M%S`.png
done

This script asks for your video device ($devnum), the video input line ($inpt) and a frame interval in seconds ($intv).
It opens mplayer to display the video live, and starts taking .png screenshots in directory “/img” (create first!)
To close, simply click away the mplayer or the terminal.

Now we have to convert the images into a movie:


#!/bin/bash

echo MAKING MOVIE FROM STILLS
echo "Movie width?"
read pix_x
echo "Movie height?"
read pix_y
echo "File type? png bmp jpg"
read filetype
echo "Delete stills when done? (y/n)"
read del_permis

if [ $filetype = 'bmp' ]
then
echo "Converting from " $filetype "to png..."
mogrify -format png $filetype/*.$filetype
echo "Moving png..."
rm -r $filetype/*.$filetype
echo "Deleting " $filetype "..."
mv $filetype/*.png img
echo "Done."
fi

filetype="png";

FNAME=tl-`date +%y%m%d_%H%M`.avi
cd img/
mencoder mf://*.$filetype -mf w=$pix_x:h=$pix_y:fps=25:type=png -ovc lavc -lavcopts vcodec=mpeg4:mbd=2:trell:vbitrate=5000 -oac copy -o $FNAME
mv *.avi ../avi
if [ $del_permis = 'y' ] || [ $del_permis = 'Y' ]
then
rm -rf *.$filetype
echo Stills deleted
else
echo Stills kept
fi
echo "Finished, press any key to exit"
read anykey

This script asks for a file type (png/bmp) because sometimes I need to convert bitmaps into a movie.
Default is “png” from the “img” directory, but I can choose “bmp” from the “bmp” directory.
Then it runs mencoder to create the movie, and optionally deletes the stills after completion.
I created two links in my main menu (“timelapse” and “makemovie”) and I was ready to capture another day…