A METHOD AND APPARATUS FOR REAL-TIME/ON-LINE PERFORMING OF MULTI VIEW MULTIMEDIA APPLICATIONS

An Image-based rendering IBR system is described capable of performing online stereo matching and view synthesis at high speed, completely running on the graphics processing unit (GPU). Given two rectified stereo images, the invention first extracts the disparity map with a novel stream-centric dense stereo correspondence algorithm. For visually plausible image synthesis, an adaptive view interpolation scheme is then used to effectively handle occlusions and incorrectly matched pixels, assisted by a photometric outlier map. To allow even faster intermediate view generation, an alternative forward warping method is seamlessly integrated, enabling a coarse-grained quality-complexity scalability. Besides yielding artifact-free intermediate views, the proposed IBR techniques are also specifically designed to leverage the GPU streaming architecture for high execution speed.

Patent Publication Number: EP2143075

Year filing: 2008

Year approval: 2014

Year publication: 2014

Status: Assigned

Technology domains: Computer technology

Validated for IOF-key: Yes

Attributed to: Associatie KULeuven