PDE-based Progressive Prediction Framework for Attribute Compression of 3D Point Clouds

被引:2
|
作者
Yang, Xiaodong [1 ]
Shao, Yiting [1 ,2 ]
Liu, Shan [3 ]
Li, Thomas H. [1 ]
Li, Ge [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen, Peoples R China
[2] Peng Cheng Lab, Artificial Intelligence Res Ctr, Shenzhen, Peoples R China
[3] Tencent Media Lab, Palo Alto, CA USA
基金
中国国家自然科学基金;
关键词
Point cloud; Attribute compression; Intra prediction; Partial differential equations; Diffusion; WEIGHTED GRAPHS; IMAGE; REGULARIZATION; SCHEME;
D O I
10.1145/3581783.3612422
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the diffusion-based image compression scheme has achieved significant success, which inspires us to use diffusion theory to employ the diffusion model for point cloud attribute compression. However, the relevant existing methods cannot be used to deal with our task due to the irregular structure of point clouds. To handle this, we propose the partial differential equation (PDE) based progressive prediction framework for attribute compression of 3D point clouds. Firstly, we propose a PDE-based prediction module, which performs prediction by optimizing attribute gradients, allowing the geometric distribution of adjacent areas to be fully utilized and explaining the weighting method for prediction. Besides, we propose a low-complexity method for calculating partial derivative operations on point clouds to address the uncertainty of neighbor occupancy in three-dimensional space. In the proposed prediction framework, we design a two-layer level of detail (LOD) structure, where the attribute information in the high level is used for interpolating the low level by edge-enhancing anisotropic diffusion (EED) to infer local features from the high-level information. After the diffusion-based interpolation, we design a texture-wise prediction method making use of interpolated values and texture information. Experiment results show that our proposed framework achieves an average of 12.00% BD-rate reduction and 1.59% bitrate saving compared with Predlift (PLT) under attribute near-lossless and attribute lossless conditions, respectively. Furthermore, additional experiments demonstrate our proposed scheme has better texture preservation and subjective quality.
引用
收藏
页码:9271 / 9281
页数:11
相关论文
共 50 条
  • [1] PDE-based Progressive Prediction Framework for Attribute Compression of 3D Point Clouds
    Yang, Xiaodong
    Shao, Yiting
    Liu, Shan
    Li, Thomas H.
    Li, Ge
    MM 2023 - Proceedings of the 31st ACM International Conference on Multimedia, 2023, : 9271 - 9281
  • [2] PROGRESSIVE MODES IN PDE-BASED IMAGE COMPRESSION
    Schmaltz, Christian
    Mach, Nicolas
    Mainberger, Markus
    Weickert, Joachim
    2013 PICTURE CODING SYMPOSIUM (PCS), 2013, : 233 - 236
  • [3] Entropy-driven Progressive Compression of 3D Point Clouds
    Zampieri, A.
    Delarue, G.
    Abou Bakr, N.
    Alliez, P.
    COMPUTER GRAPHICS FORUM, 2024, 43 (05)
  • [4] 3D Point Cloud Attribute Compression via Graph Prediction
    Gu, Shuai
    Hou, Junhui
    Zeng, Huanqiang
    Yuan, Hui
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 (27) : 176 - 180
  • [5] PDE-Based Graph Signal Processing for 3-D Color Point Clouds Opportunities for cultural heritage
    Lozes, Francois
    Elmoataz, Abderrahim
    Lezoray, Olivier
    IEEE SIGNAL PROCESSING MAGAZINE, 2015, 32 (04) : 103 - 111
  • [6] A Hybrid Compression Framework for Color Attributes of Static 3D Point Clouds
    Liu, Hao
    Yuan, Hui
    Liu, Qi
    Hou, Junhui
    Zeng, Huanqiang
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1564 - 1577
  • [7] A Proof-of-Concept Framework for PDE-Based Video Compression
    Andris, Sarah
    Peter, Pascal
    Weickert, Joachim
    2016 PICTURE CODING SYMPOSIUM (PCS), 2016,
  • [8] PDE-based smoothing for 3D mesh quality improvement
    Zhang, Ying
    Ben Hamza, A.
    2006 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY, 2006, : 334 - 339
  • [9] Attribute Compression of 3D Point Clouds Using Laplacian Sparsity Optimized Graph Transform
    Shao, Yiting
    Zhang, Zhaobin
    Li, Zhu
    Fan, Kui
    Li, Ge
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [10] 3D Point Cloud Attribute Compression Based on Cylindrical Projection
    Li, Zhe
    He, Lanyi
    Zhu, Wenjie
    Xu, Yiling
    Sun, Jun
    Yang, Le
    2019 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2019,