Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/90511
PIRA download icon_1.1View/Download Full Text
Title: Efficient depth intra frame coding in 3D-HEVC by corner points
Authors: Fu, CH 
Chan, YL 
Zhang, HB 
Tsang, SH 
Xu, MT
Issue Date: 2021
Source: IEEE transactions on image processing, 2021, v. 30, 9311748, p. 1608-1622
Abstract: To improve the coding performance of depth maps, 3D-HEVC includes several new depth intra coding tools at the expense of increased complexity due to a flexible quadtree Coding Unit/Prediction Unit (CU/PU) partitioning structure and a huge number of intra mode candidates. Compared to natural images, depth maps contain large plain regions surrounded by sharp edges at the object boundaries. Our observation finds that the features proposed in the literature either speed up the CU/PU size decision or intra mode decision and they are also difficult to make proper predictions for CUs/PUs with the multi-directional edges in depth maps. In this work, we reveal that the CUs with multi-directional edges are highly correlated with the distribution of corner points (CPs) in the depth map. CP is proposed as a good feature that can guide to split the CUs with multi-directional edges into smaller units until only single directional edge remains. This smaller unit can then be well predicted by the conventional intra mode. Besides, a fast intra mode decision is also proposed for non-CP PUs, which prunes the conventional HEVC intra modes, skips the depth modeling mode decision, and early determines segment-wise depth coding. Furthermore, a two-step adaptive corner point selection technique is designed to make the proposed algorithm adaptive to frame content and quantization parameters, with the capability of providing the flexible tradeoff between the synthesized view quality and complexity. Simulation results show that the proposed algorithm can provide about 66% time reduction of the 3D-HEVC intra encoder without incurring noticeable performance degradation for synthesized views and it also outperforms the previous state-of-The-Art algorithms in term of time reduction and $\Delta $ BDBR.
Keywords: 3D-HEVC
Corner detection
Depth map
Depth modeling mode
Intra coding
Multi-view video plus depth
Publisher: Institute of Electrical and Electronics Engineers
Journal: IEEE transactions on image processing 
ISSN: 1057-7149
EISSN: 1941-0042
DOI: 10.1109/TIP.2020.3046866
Rights: © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
The following publication C. -H. Fu, Y. -L. Chan, H. -B. Zhang, S. H. Tsang and M. -T. Xu, "Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points," in IEEE Transactions on Image Processing, vol. 30, pp. 1608-1622, 2021 is available at https://dx.doi.org/10.1109/TIP.2020.3046866
Appears in Collections:Journal/Magazine Article

Files in This Item:
File Description SizeFormat 
2242_Fu_Efficient_Depth_Intra.pdfPre-Published version1.47 MBAdobe PDFView/Open
Open Access Information
Status open access
File Version Final Accepted Manuscript
Access
View full-text via PolyU eLinks SFX Query
Show full item record

Page views

22
Citations as of May 22, 2022

Downloads

2
Citations as of May 22, 2022

SCOPUSTM   
Citations

4
Citations as of May 26, 2022

WEB OF SCIENCETM
Citations

5
Citations as of May 26, 2022

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.