PDE-based Progressive Prediction Framework for Attribute Compression of 3D Point Clouds

被引:2
|
作者
Yang, Xiaodong [1 ]
Shao, Yiting [1 ,2 ]
Liu, Shan [3 ]
Li, Thomas H. [1 ]
Li, Ge [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen, Peoples R China
[2] Peng Cheng Lab, Artificial Intelligence Res Ctr, Shenzhen, Peoples R China
[3] Tencent Media Lab, Palo Alto, CA USA
基金
中国国家自然科学基金;
关键词
Point cloud; Attribute compression; Intra prediction; Partial differential equations; Diffusion; WEIGHTED GRAPHS; IMAGE; REGULARIZATION; SCHEME;
D O I
10.1145/3581783.3612422
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the diffusion-based image compression scheme has achieved significant success, which inspires us to use diffusion theory to employ the diffusion model for point cloud attribute compression. However, the relevant existing methods cannot be used to deal with our task due to the irregular structure of point clouds. To handle this, we propose the partial differential equation (PDE) based progressive prediction framework for attribute compression of 3D point clouds. Firstly, we propose a PDE-based prediction module, which performs prediction by optimizing attribute gradients, allowing the geometric distribution of adjacent areas to be fully utilized and explaining the weighting method for prediction. Besides, we propose a low-complexity method for calculating partial derivative operations on point clouds to address the uncertainty of neighbor occupancy in three-dimensional space. In the proposed prediction framework, we design a two-layer level of detail (LOD) structure, where the attribute information in the high level is used for interpolating the low level by edge-enhancing anisotropic diffusion (EED) to infer local features from the high-level information. After the diffusion-based interpolation, we design a texture-wise prediction method making use of interpolated values and texture information. Experiment results show that our proposed framework achieves an average of 12.00% BD-rate reduction and 1.59% bitrate saving compared with Predlift (PLT) under attribute near-lossless and attribute lossless conditions, respectively. Furthermore, additional experiments demonstrate our proposed scheme has better texture preservation and subjective quality.
引用
收藏
页码:9271 / 9281
页数:11
相关论文
共 50 条
  • [31] Progressive 3D Model Compression Based on Surfacelet
    Li, Jinjiang
    Fan, Hui
    ENTERTAINMENT FOR EDUCATION: DIGITAL TECHNIQUES AND SYSTEMS, 2010, 6249 : 582 - 591
  • [32] A hybrid framework for robust dynamic 3D point clouds removal
    Zhu, Hongwei
    Zhang, Guobao
    Liang, Quncong
    Ye, Zhiqi
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (01)
  • [33] Robust Feature Matching for 3D Point Clouds with Progressive Consistency Voting
    Quan, Siwen
    Yin, Kunpeng
    Ye, Kaixiao
    Nan, Kechen
    SENSORS, 2022, 22 (20)
  • [34] INCREMENTAL REFINEMENT OF FACADE MODELS WITH ATTRIBUTE GRAMMAR FROM 3D POINT CLOUDS
    Dehbi, Y.
    Staat, C.
    Mandtler, L.
    Pluemer, L.
    XXIII ISPRS CONGRESS, COMMISSION III, 2016, 3 (03): : 311 - 316
  • [35] Implicit Shape Reconstruction of Unorganized Points Using PDE-Based Deformable 3D Manifolds
    Franchini, Elena
    Morigi, Serena
    Sgallari, Fiorella
    NUMERICAL MATHEMATICS-THEORY METHODS AND APPLICATIONS, 2010, 3 (04) : 405 - 430
  • [36] Implicit Shape Reconstruction of Unorganized Points Using PDE-Based Deformable 3D Manifolds
    Elena Franchini
    Serena Morigi
    Fiorella Sgallari
    Numerical Mathematics:Theory,Methods and Applications, 2010, (04) : 405 - 430
  • [37] A 3D Haar Wavelet Transform for Point Cloud Attribute Compression Based on Local Surface Analysis
    Zhang, Sujun
    Zhang, Wei
    Yang, Fuzheng
    Huo, Junyan
    2019 PICTURE CODING SYMPOSIUM (PCS), 2019,
  • [38] Transformer for 3D Point Clouds
    Wang, Jiayun
    Chakraborty, Rudrasis
    Yu, Stella X.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 4419 - 4431
  • [39] 3D Point Cloud Denoising Based on Color Attribute
    Lin, Wei-Chi
    Lee, Ming-Zhan
    Chou, He-Sheng
    Lin, Yuan-Jin
    Li, Kuo-Chen
    Lin, Ting-Lan
    Chen, Shin-Lun
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1512 - 1516
  • [40] Advanced 3D Motion Prediction for Video Based Point Cloud Attributes Compression
    Li, Li
    Li, Zhu
    Zakharchenko, Vladyslav
    Chen, Emile
    2019 DATA COMPRESSION CONFERENCE (DCC), 2019, : 498 - 507