GQE-Net: A Graph-Based Quality Enhancement Network for Point Cloud Color Attribute

被引:50
|
作者
Xing, Jinrui [1 ]
Yuan, Hui [1 ]
Hamzaoui, Raouf [2 ]
Liu, Hao [3 ]
Hou, Junhui [4 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] De Montfort Univ, Sch Engn & Sustainable Dev, Leicester LE1 9BH, England
[3] Yantai Univ, Sch Comp & Control Engn, Yantai 264005, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; quality enhancement; graph neural network; G-PCC; GEOMETRY;
D O I
10.1109/TIP.2023.3330086
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, point clouds have become increasingly popular for representing three-dimensional (3D) visual objects and scenes. To efficiently store and transmit point clouds, compression methods have been developed, but they often result in a degradation of quality. To reduce color distortion in point clouds, we propose a graph-based quality enhancement network (GQE-Net) that uses geometry information as an auxiliary input and graph convolution blocks to extract local features efficiently. Specifically, we use a parallel-serial graph attention module with a multi-head graph attention mechanism to focus on important points or features and help them fuse together. Additionally, we design a feature refinement module that takes into account the normals and geometry distance between points. To work within the limitations of GPU memory capacity, the distorted point cloud is divided into overlap-allowed 3D patches, which are sent to GQE-Net for quality enhancement. To account for differences in data distribution among different color components, three models are trained for the three color components. Experimental results show that our method achieves state-of-the-art performance. For example, when implementing GQE-Net on a recent test model of the geometry-based point cloud compression (G-PCC) standard, 0.43 dB, 0.25 dB and 0.36 dB Bj phi ntegaard delta (BD)-peak signal-to-noise ratio (PSNR), corresponding to 14.0%, 9.3% and 14.5% BD-rate savings were achieved on dense point clouds for the Y, Cb, and Cr components, respectively.
引用
收藏
页码:6303 / 6317
页数:15
相关论文
共 50 条
  • [31] Point Cloud Classification and Segmentation Network Based on Dynamic Graph Convolutional Network
    Wang Jiang'an
    He Jiao
    Pang Dawei
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (12)
  • [32] Sentiment analysis using graph-based Quickprop method for product quality enhancement
    Subramani, Raj Kumar Veerasamy
    Kumaresan, Thirumoorthy
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2024,
  • [33] AAGNet: Attribute-Aware Graph-Based Network for Occluded Pedestrian Re-Identification
    Yao, Shihong
    Pan, Keyu
    Wang, Tao
    Zheng, Zhigao
    Jin, Jing
    Hu, Chuli
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 6580 - 6588
  • [34] GRAPH-BASED MULTI-ATTRIBUTE DECISION MAKING: IMPACT OF ROAD FENCING ON ECOLOGICAL NETWORK
    Kucas, Andrius
    BALTIC JOURNAL OF ROAD AND BRIDGE ENGINEERING, 2015, 10 (02): : 105 - 111
  • [35] CM-Net: a point cloud upsampling network based on adversarial neural network
    Li, Xiaomeng
    Own, Chung-Ming
    Wu, Kaizhen
    Sun, Qian
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [36] Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registration
    Qin, Zheng
    Yu, Hao
    Wang, Changjian
    Peng, Yuxing
    Xu, Kai
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5394 - 5403
  • [37] Graph-based methods for analyzing orchard tree structure using noisy point cloud data
    Westling, Fred
    Underwood, James
    Bryson, Mitch
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 187
  • [38] GRAPH-BASED MOTION ESTIMATION AND COMPENSATION FOR DYNAMIC 3D POINT CLOUD COMPRESSION
    Thanou, Dorina
    Chou, Philip A.
    Frossard, Pascal
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3235 - 3239
  • [39] Exploration of Energy-Efficient Architecture for Graph-Based Point-Cloud Deep Learning
    Zhang, Jie-Fang
    Zhang, Zhengya
    2021 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS 2021), 2021, : 260 - 264
  • [40] RRGA-Net: Robust Point Cloud Registration Based on Graph Convolutional Attention
    Qian, Jian
    Tang, Dewen
    SENSORS, 2023, 23 (24)