Fast Depth Intra Coding Based on Depth Edge Classification Network in 3D-HEVC

被引:21
|
作者
Liu, Chang [1 ,2 ]
Jia, Kebin [1 ,2 ]
Liu, Pengyu [1 ,2 ]
机构
[1] Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Adv Informat Networks, Beijing 100124, Peoples R China
基金
北京市自然科学基金;
关键词
Encoding; Complexity theory; Image edge detection; Three-dimensional displays; Standards; Feature extraction; Convolutional neural networks; 3D-HEVC; CNN; depth map; edge classification; VIDEO; MULTIVIEW; DECISION;
D O I
10.1109/TBC.2021.3106143
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the extension of high efficiency video coding (HEVC) standard, three dimensional-HEVC (3D-HEVC) is the latest 3D video coding standard. 3D-HEVC adopts many complicated coding algorithms to generate additional intermediate views for 3D video representation, which result in extremely high coding complexity. Therefore, this paper proposed a fast depth intra coding approach to reduce the 3D-HEVC complexity, which is based on convolutional neural network (CNN). First, we established a database based on the independent view of the depth map, which includes coding unit (CU) partition data of the depth map. Second, we constructed a depth edge classification CNN (DEC-CNN) framework to classify the edges for the depth map and embedded the network into a 3D-HEVC test platform. Finally, we utilized the pixel value of the binarized depth image to correct the above classification results. The experimental results demonstrated that our approach can reduce the intra coding time by 72.5% on average under negligible degradation of coding performance. This result outperforms the other state-of-the-art methods to reduce the coding complexity of 3D-HEVC.
引用
收藏
页码:97 / 109
页数:13
相关论文
共 50 条
  • [31] Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points
    Fu, Chang-Hong
    Chan, Yui-Lam
    Zhang, Hong-Bin
    Tsang, Sik Ho
    Xu, Meng-Ting
    IEEE Transactions on Image Processing, 2021, 30 : 1608 - 1622
  • [32] Fast intra mode decision and fast CU size decision for depth video coding in 3D-HEVC
    Chiang, Jui-Chiu
    Peng, Kuan-Kai
    Wu, Chao-Chun
    Deng, Chih-You
    Lie, Wen-Nung
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 71 : 13 - 23
  • [33] QUADTREE DECISION FOR DEPTH INTRA CODING IN 3D-HEVC BY GOOD FEATURE
    Zhang, Hong-Bin
    Chan, Yui-Lam
    Fu, Chang-Hong
    Tsang, Sik-Ho
    Siu, Wan-Chi
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1481 - 1485
  • [34] Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points
    Fu, Chang-Hong
    Chan, Yui-Lam
    Zhang, Hong-Bin
    Tsang, Sik Ho
    Xu, Meng-Ting
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1608 - 1622
  • [35] Fast Intra Mode Decision for 3D-HEVC Depth Map Coding using Decision Trees
    Moura, Christopher
    Saldanha, Mario
    Sanchez, Gustavo
    Marcon, Cesar
    Porto, Marcelo
    Agostini, Luciano
    2020 27TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2020,
  • [36] Advanced texture and depth coding in 3D-HEVC
    Lin, Jian-Liang
    Chen, Yi-Wen
    Chang, Yu -Lin
    An, Jicheng
    Zhang, Kai
    Huang, Yu-Wen
    Lei, Shawmin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 50 : 83 - 92
  • [37] Fast mode decision and PU size decision algorithm for intra depth coding in 3D-HEVC
    He, Gang
    Hu, Jing
    Li, Yunsong
    Yu, Wenxin
    Yang, Zhuo
    Liu, Peikun
    Guo, Ruixue
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 49 : 303 - 314
  • [38] Simplified Depth Intra Coding Based on Texture Feature and Spatial Correlation in 3D-HEVC
    Li, Tiansong
    Yu, Li
    Wang, Shengwei
    Wang, Hongkui
    2018 DATA COMPRESSION CONFERENCE (DCC 2018), 2018, : 421 - 421
  • [39] Novel Bitrate Saving and Fast Coding for Depth Videos in 3D-HEVC
    Chung, Kuo-Liang
    Huang, Yong-Huai
    Lin, Chien-Hsiung
    Fang, Jian-Ping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (10) : 1859 - 1869
  • [40] LOW COMPLEXITY DEPTH INTRA CODING COMBINING FAST INTRA MODE AND FAST CU SIZE DECISION IN 3D-HEVC
    Peng, Kuan-Kai
    Chiang, Jui-Chiu
    Lie, Wen-Nung
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1126 - 1130