Reel, S.; Wong, K. C. P.; Cheung, G. and Dooley, L. S.
(2014).
|
PDF (Proof)
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (621kB) | Preview |
| DOI (Digital Object Identifier) Link: | https://doi.org/10.1109/VCIP.2014.7051614 |
|---|---|
| Google Scholar: | Look up in Google Scholar |
Abstract
Transmitting texture and depth images of captured camera view(s) of a 3D scene enables a receiver to synthesize novel virtual viewpoint images via Depth-Image-Based Rendering (DIBR). However, a DIBR-synthesized image often contains disocclusion holes, which are spatial regions in the virtual view image that were occluded by foreground objects in the captured camera view(s). In this paper, we propose to complete these disocclusion holes by exploiting the self-similarity characteristic of natural images via nonlocal template-matching (TM). Specifically, we first define self-similarity as nonlocal recurrences of pixel patches within the same image across different scales--one characterization of self-similarity in a given image is the scale range in which these patch recurrences take place. Then, at encoder we segment an image into multiple depth layers using available per-pixel depth values, and characterize self-similarity in each layer with a scale range; scale ranges for all layers are transmitted as side information to the decoder. At decoder, disocclusion holes are completed via TM on a per-layer basis by searching for similar patches within the designated scale range. Experimental results show that our method improves the quality of rendered images over previous disocclusion hole-filling algorithms by up to 3.9dB in PSNR.
| Item Type: | Conference or Workshop Item |
|---|---|
| Copyright Holders: | 2014 IEEE |
| ISBN: | 1-4799-6139-6, 978-1-4799-6139-9 |
| Keywords: | free viewpoint video; depth-image-based rendering; image inpainting |
| Academic Unit/School: | Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications Faculty of Science, Technology, Engineering and Mathematics (STEM) |
| Research Group: | Centre for Research in Computing (CRC) |
| Related URLs: | |
| Item ID: | 41031 |
| Depositing User: | Smarti Reel |
| Date Deposited: | 02 Oct 2014 09:47 |
| Last Modified: | 07 Dec 2018 14:49 |
| URI: | http://oro.open.ac.uk/id/eprint/41031 |
| Share this page: |     |
Metrics
Altmetrics from Altmetric | Citations from Dimensions |
Download history for this item
These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)