Using Photographs to Enhance Videos of a Static Scene

[Florin Andrei]

Pretty cool:

http://grail.cs.washington.edu/projects/videoenhancement/videoEnhancement.htm

Abstract

We present a framework for automatically enhancing videos of a static scene using a few photographs of the same scene. For example, our system can transfer photographic qualities such as high resolution, high dynamic range and better lighting from the photographs to the video. Additionally, the user can quickly modify the video by editing only a few still images of the scene. Finally, our system allows a user to remove unwanted objects and camera shake from the video. These capabilities are enabled by two technical contributions presented in this paper. First, we make several improvements to a state-of-the-art multiview stereo algorithm in order to compute view-dependent depths using video, photographs, and structure-from-motion data. Second, we present a novel image-based rendering algorithm that can re-render the input video using the appearance of the photographs while preserving certain temporal dynamics such as specularities and dynamic scene lighting.

 

[Martin Weiss]

This is nothing short of amazing:

http://www.vimeo.com/1513129

Makes HDR possible with one video camera and a good stils camera.

Lets you remove unwanted objects.

Removes camera shake.

Lets you replace objects with others.

Preserves reflections.

WOW!

 

[mattbatt]

Just checked it out on Gizmodo very interesting.

I know in the past, there has been talk of future high res camera's (like the RED) taking over the digital SLR . . . so there is some sort of marriage between the two. Think that will happen?

When I first watched the video, I thought of photoshop for video brought to the home user = even more doubt on whether what you see is real or not.