GQE-Net: A Graph-Based Quality Enhancement Network for Point Cloud Color Attribute

被引:50
|
作者
Xing, Jinrui [1 ]
Yuan, Hui [1 ]
Hamzaoui, Raouf [2 ]
Liu, Hao [3 ]
Hou, Junhui [4 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] De Montfort Univ, Sch Engn & Sustainable Dev, Leicester LE1 9BH, England
[3] Yantai Univ, Sch Comp & Control Engn, Yantai 264005, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; quality enhancement; graph neural network; G-PCC; GEOMETRY;
D O I
10.1109/TIP.2023.3330086
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, point clouds have become increasingly popular for representing three-dimensional (3D) visual objects and scenes. To efficiently store and transmit point clouds, compression methods have been developed, but they often result in a degradation of quality. To reduce color distortion in point clouds, we propose a graph-based quality enhancement network (GQE-Net) that uses geometry information as an auxiliary input and graph convolution blocks to extract local features efficiently. Specifically, we use a parallel-serial graph attention module with a multi-head graph attention mechanism to focus on important points or features and help them fuse together. Additionally, we design a feature refinement module that takes into account the normals and geometry distance between points. To work within the limitations of GPU memory capacity, the distorted point cloud is divided into overlap-allowed 3D patches, which are sent to GQE-Net for quality enhancement. To account for differences in data distribution among different color components, three models are trained for the three color components. Experimental results show that our method achieves state-of-the-art performance. For example, when implementing GQE-Net on a recent test model of the geometry-based point cloud compression (G-PCC) standard, 0.43 dB, 0.25 dB and 0.36 dB Bj phi ntegaard delta (BD)-peak signal-to-noise ratio (PSNR), corresponding to 14.0%, 9.3% and 14.5% BD-rate savings were achieved on dense point clouds for the Y, Cb, and Cr components, respectively.
引用
收藏
页码:6303 / 6317
页数:15
相关论文
共 50 条
  • [21] A Graph-based One-Shot Learning Method for Point Cloud Recognition
    Fan, Zhaoxin
    Liu, Hongyan
    He, Jun
    Sun, Qi
    Du, Xiaoyong
    COMPUTER GRAPHICS FORUM, 2020, 39 (07) : 313 - 323
  • [22] Pyramid Semantic Graph-based Global Point Cloud Registration with Low Overlap
    Qiao, Zhijian
    Yu, Zehuan
    Yin, Huan
    Shen, Shaojie
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 11202 - 11209
  • [23] Graph-Based Compression of Dynamic 3D Point Cloud Sequences
    Thanou, Dorina
    Chou, Philip A.
    Frossard, Pascal
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (04) : 1765 - 1778
  • [24] Joint Geometry and Color Point Cloud Denoising Based on Graph Wavelets
    Irfan, Muhammad Abeer
    Magli, Enrico
    IEEE ACCESS, 2021, 9 : 21149 - 21166
  • [25] GPA-Net:No-Reference Point Cloud Quality Assessment With Multi-Task Graph Convolutional Network
    Shan, Ziyu
    Yang, Qi
    Ye, Rui
    Zhang, Yujie
    Xu, Yiling
    Xu, Xiaozhong
    Liu, Shan
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4955 - 4967
  • [26] Point Cloud Classification Network Based on Dynamic Graph Convolution
    Wu, Ke
    Dai, Hong
    Wang, Shuang
    Liu, Chengrui
    ENGINEERING LETTERS, 2023, 31 (04) : 1859 - 1866
  • [27] Data-adaptive Color Image Denoising and Enhancement Using Graph-based Filtering
    Sadreazami, H.
    Asif, A.
    Mohammadi, A.
    2017 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2017, : 2751 - 2754
  • [28] Roadway Feature Mapping from Point Cloud Data: A Graph-Based Clustering Approach
    Billah, Mohammad
    Maskooki, Arash
    Rahman, Farzana
    Farrell, Jay A.
    2017 28TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV 2017), 2017, : 475 - 480
  • [29] Micro-Structures Graph-Based Point Cloud Registration for Balancing Efficiency and Accuracy
    Zhang, Rongling
    Yan, Li
    Wei, Pengcheng
    Xie, Hong
    Wang, Pinzhuo
    Wang, Binbing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [30] Higher order heterogeneous graph neural network based on node attribute enhancement
    Li, Chao
    Fu, Jinhu
    Yan, Yeyu
    Zhao, Zhongying
    Zeng, Qingtian
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238