Occupancy Map Guided Fast Video-Based Dynamic Point Cloud Coding

被引:36
|
作者
Xiong, Jian [1 ]
Gao, Hao [2 ]
Wang, Miaohui [3 ]
Li, Hongliang [4 ,5 ]
Lin, Weisi [6 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Telecommun & Informat Engn, Nanjing 210003, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Coll Artificial Intelligence, Nanjing 210003, Peoples R China
[3] Hainan Univ, Sch Comp Sci & Cyberspace Secur, Haikou 570228, Hainan, Peoples R China
[4] Shenzhen Univ, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[5] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[6] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Geometry; Encoding; Two dimensional displays; Image coding; Correlation; Rate-distortion; Point cloud; V-PCC; occupancy map; HEVC; video coding; INTER CU DECISION; MODE DECISION; HEVC; COMPRESSION; MPEG;
D O I
10.1109/TCSVT.2021.3063501
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In video-based dynamic point cloud compression (V-PCC), 3D point clouds are projected into patches, and then the patches are padded into 2D images suitable for the video compression framework. However, the patch projection-based method produces a large number of empty pixels; the far and near components are projected to generate different 2D images (video frames), respectively. As a result, the generated video is with high resolutions and double frame rates, so the V-PCC has huge computational complexity. This paper proposes an occupancy map guided fast V-PCC method. Firstly, the relationship between the prediction coding and block complexity is studied based on a local linear image gradient model. Secondly, according to the V-PCC strategies of patch projection and block generation, we investigate the differences of rate-distortion characteristics between different types of blocks, and the temporal correlations between the far and near layers. Finally, by taking advantage of the fact that occupancy maps can explicitly indicate the block types, we propose an occupancy map guided fast coding method, in which coding is performed on the different types of blocks. Experiments have tested typical dynamic point clouds, and shown that the proposed method achieves an average 43.66% time-saving at the cost of only 0.27% and 0.16% Bjontegaard Delta (BD) rate increment under the geometry Point-to-Point (D1) error and attribute Luma Peak-Signal-Noise-Ratio (PSNR), respectively.
引用
收藏
页码:813 / 825
页数:13
相关论文
共 50 条
  • [1] Occupancy Map Guided Attributes Deblocking for Video-based Point Cloud Compression
    Chen, Peilin
    Wang, Shiqi
    Li, Zhu
    2023 DATA COMPRESSION CONFERENCE, DCC, 2023, : 332 - 332
  • [2] Chain Code-Based Occupancy Map Coding for Video-Based Point Cloud Compression
    Yang, Runyu
    Yan, Ning
    Li, Li
    Liu, Dong
    Wu, Feng
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 479 - 482
  • [3] Leveraging occupancy map to accelerate video-based point cloud compression
    Wang, Wenyu
    Ding, Gongchun
    Ding, Dandan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104
  • [4] OCCUPANCY-MAP-BASED RATE DISTORTION OPTIMIZATION FOR VIDEO-BASED POINT CLOUD COMPRESSION
    Li, Li
    Li, Zhu
    Liu, Shan
    Li, Houqiang
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3167 - 3171
  • [5] Occupancy-Map-Based Rate Distortion Optimization and Partition for Video-Based Point Cloud Compression
    Li, Li
    Li, Zhu
    Liu, Shan
    Li, Houqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (01) : 326 - 338
  • [6] Occupancy map-based low complexity motion prediction for video-based point cloud compression
    Wang, Yihan
    Wang, Yongfang
    Cui, Tengyao
    Fang, Zhijun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [7] Convolutional Neural Network-Based Occupancy Map Accuracy Improvement for Video-Based Point Cloud Compression
    Jia, Wei
    Li, Li
    Akhtar, Anique
    Li, Zhu
    Liu, Shan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2352 - 2365
  • [8] Differential Transform for Video-Based Plenoptic Point Cloud Coding
    Garcia, Diogo C.
    Dorea, Camilo
    Ferreira, Renan U. B.
    Freitas, Davi R.
    de Queiroz, Ricardo L.
    Higa, Rogerio
    Seidel, Ismael
    Testoni, Vanessa
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1994 - 2003
  • [9] ADAPTIVE PLANE PROJECTION FOR VIDEO-BASED POINT CLOUD CODING
    Lopes, Eurico
    Ascenso, Joao
    Brites, Catarina
    Pereira, Fernando
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 49 - 54
  • [10] Surface Lightfield Support in Video-based Point Cloud Coding
    Naik, Deepa
    Schwarz, Sebastian
    Vadakita, Vinod Kumar Malamal
    Roimela, Kimmo
    2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,