The Open UniversitySkip to content
 

Disocclusion Hole-Filling in DIBR-Synthesized Images using Multi-Scale Template Matching

Reel, S.; Wong, K. C. P.; Cheung, G. and Dooley, L. S. (2014). Disocclusion Hole-Filling in DIBR-Synthesized Images using Multi-Scale Template Matching. In: Visual Communications and Image Processing Conference, 2014 IEEE, IEEE, pp. 494–497.

Full text available as:
[img]
Preview
PDF (Proof) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (621kB) | Preview
DOI (Digital Object Identifier) Link: https://doi.org/10.1109/VCIP.2014.7051614
Google Scholar: Look up in Google Scholar

Abstract

Transmitting texture and depth images of captured camera view(s) of a 3D scene enables a receiver to synthesize novel virtual viewpoint images via Depth-Image-Based Rendering (DIBR). However, a DIBR-synthesized image often contains disocclusion holes, which are spatial regions in the virtual view image that were occluded by foreground objects in the captured camera view(s). In this paper, we propose to complete these disocclusion holes by exploiting the self-similarity characteristic of natural images via nonlocal template-matching (TM). Specifically, we first define self-similarity as nonlocal recurrences of pixel patches within the same image across different scales--one characterization of self-similarity in a given image is the scale range in which these patch recurrences take place. Then, at encoder we segment an image into multiple depth layers using available per-pixel depth values, and characterize self-similarity in each layer with a scale range; scale ranges for all layers are transmitted as side information to the decoder. At decoder, disocclusion holes are completed via TM on a per-layer basis by searching for similar patches within the designated scale range. Experimental results show that our method improves the quality of rendered images over previous disocclusion hole-filling algorithms by up to 3.9dB in PSNR.

Item Type: Conference or Workshop Item
Copyright Holders: 2014 IEEE
ISBN: 1-4799-6139-6, 978-1-4799-6139-9
Keywords: free viewpoint video; depth-image-based rendering; image inpainting
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Research Group: Centre for Research in Computing (CRC)
Related URLs:
Item ID: 41031
Depositing User: Smarti Reel
Date Deposited: 02 Oct 2014 09:47
Last Modified: 02 May 2018 14:02
URI: http://oro.open.ac.uk/id/eprint/41031
Share this page:

Metrics

Altmetrics from Altmetric

Citations from Dimensions

Download history for this item

These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU