Fast Depth Intra Coding Based on Depth Edge Classification Network in 3D-HEVC

被引:21
|
作者
Liu, Chang [1 ,2 ]
Jia, Kebin [1 ,2 ]
Liu, Pengyu [1 ,2 ]
机构
[1] Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Adv Informat Networks, Beijing 100124, Peoples R China
基金
北京市自然科学基金;
关键词
Encoding; Complexity theory; Image edge detection; Three-dimensional displays; Standards; Feature extraction; Convolutional neural networks; 3D-HEVC; CNN; depth map; edge classification; VIDEO; MULTIVIEW; DECISION;
D O I
10.1109/TBC.2021.3106143
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the extension of high efficiency video coding (HEVC) standard, three dimensional-HEVC (3D-HEVC) is the latest 3D video coding standard. 3D-HEVC adopts many complicated coding algorithms to generate additional intermediate views for 3D video representation, which result in extremely high coding complexity. Therefore, this paper proposed a fast depth intra coding approach to reduce the 3D-HEVC complexity, which is based on convolutional neural network (CNN). First, we established a database based on the independent view of the depth map, which includes coding unit (CU) partition data of the depth map. Second, we constructed a depth edge classification CNN (DEC-CNN) framework to classify the edges for the depth map and embedded the network into a 3D-HEVC test platform. Finally, we utilized the pixel value of the binarized depth image to correct the above classification results. The experimental results demonstrated that our approach can reduce the intra coding time by 72.5% on average under negligible degradation of coding performance. This result outperforms the other state-of-the-art methods to reduce the coding complexity of 3D-HEVC.
引用
收藏
页码:97 / 109
页数:13
相关论文
共 50 条
  • [1] Low Complexity Depth Intra Coding in 3D-HEVC Based on Depth Classification
    Zheng, Huijie
    Zhu, Jianqing
    Zeng, Huanqiang
    Chen, Jing
    Cai, Canhui
    Ma, Kai-Kuang
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [2] Fast Depth Intra Coding based on Layer-classification and CNN for 3D-HEVC
    Liu, Chang
    Jia, Kebin
    Liu, Pengyu
    Sun, Zhonghua
    2020 DATA COMPRESSION CONFERENCE (DCC 2020), 2020, : 381 - 381
  • [3] Fast 3D-HEVC Depth Intra Coding Based on Boundary Continuity
    Chen, Mei-Juan
    Lin, Jie-Ru
    Hsu, Yu-Chih
    Ciou, Yi-Sheng
    Yeh, Chia-Hung
    Lin, Min-Hui
    Kau, Lih-Jen
    Chang, Chuan-Yu
    IEEE ACCESS, 2021, 9 : 79588 - 79599
  • [4] Fast Depth Intra Coding Based on Decision Tree in 3D-HEVC
    Fu, Chang-Hong
    Chen, Hao
    Chan, Yui-Lam
    Tsang, Sik-Ho
    Hong, Hong
    Zhu, Xiaohua
    IEEE ACCESS, 2019, 7 : 173138 - 173147
  • [5] Fast Intra Mode Decision Based on Edge Detection for Depth Map Coding in 3D-HEVC
    Zhang, Ru-Yi
    Jia, Ke-Bin
    Liu, Peng-Yu
    Sun, Zhong-Hua
    Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 : 147 - 155
  • [6] Fast intra mode decision for depth coding in 3D-HEVC
    Qiuwen Zhang
    Yongshuang Yang
    Huawen Chang
    Weiwei Zhang
    Yong Gan
    Multidimensional Systems and Signal Processing, 2017, 28 : 1203 - 1226
  • [7] Fast intra mode decision for depth coding in 3D-HEVC
    Zhang, Qiuwen
    Yang, Yongshuang
    Chang, Huawen
    Zhang, Weiwei
    Gan, Yong
    MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2017, 28 (04) : 1203 - 1226
  • [8] Visual Perception Based Algorithm for Fast Depth Intra Coding of 3D-HEVC
    Lin, Jie-Ru
    Chen, Mei-Juan
    Yeh, Chia-Hung
    Chen, Yong-Ci
    Kau, Lih-Jen
    Chang, Chuan-Yu
    Lin, Min-Hui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1707 - 1720
  • [9] Fast Single Depth Intra Mode Decision for Depth Map Coding in 3D-HEVC
    Kim, Miok
    Ling, Nam
    Song, Li
    2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2015,
  • [10] A Fast Mode Selection for Depth Modelling Modes of Intra Depth Coding in 3D-HEVC
    Liu, Peikun
    He, Gang
    ShunXue
    Li, Yunsong
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,