Thursday, 20 November 2008
Video Ownage of Static Scenes PDF Print E-mail
Written by fr3sh   
Sunday, 17 August 2008 01:09

video-pwn1

Using Photographs to Enhance Video of a Static Scene is an amazing post production development that combines normal video footage with photographs of the same scene to provide a number of beautiful enhancements. The technology can be used to actually bump the resolution of the video up, provide higher exposures, and even mask out or touch up areas of the video seamlessly by only masking or manipulating a few video frames. The demo video shows it all.

video-pwn3

video-pwn2

From the site:

We present a framework for automatically enhancing videos of a static scene using a few photographs of the same scene. For example, our system can transfer photographic qualities such as high resolution, high dynamic range and better lighting from the photographs to the video. Additionally, the user can quickly modify the video by editing only a few still images of the scene. Finally, our system allows a user to remove unwanted objects and camera shake from the video. These capabilities are enabled by two technical contributions presented in this paper. First, we make several improvements to a state-of-the-art multiview stereo algorithm in order to compute view-dependent depths using video, photographs, and structure-from-motion data. Second, we present a novel image-based rendering algorithm that can re-render the input video using the appearance of the photographs while preserving certain temporal dynamics such as specularities and dynamic scene lighting.

video-pwn4

They completely remove the parking sign and pole with just a simple mask.

video-pwn5

The same mask process is applied here, however it's used to replace a texture. Pretty incredible considering this technology does all of this automatically, where as it would take a bit of time and effort to do this with existing techniques.

Check out more here.