GQE-Net: A Graph-Based Quality Enhancement Network for Point Cloud Color Attribute

被引:50
|
作者
Xing, Jinrui [1 ]
Yuan, Hui [1 ]
Hamzaoui, Raouf [2 ]
Liu, Hao [3 ]
Hou, Junhui [4 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] De Montfort Univ, Sch Engn & Sustainable Dev, Leicester LE1 9BH, England
[3] Yantai Univ, Sch Comp & Control Engn, Yantai 264005, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; quality enhancement; graph neural network; G-PCC; GEOMETRY;
D O I
10.1109/TIP.2023.3330086
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, point clouds have become increasingly popular for representing three-dimensional (3D) visual objects and scenes. To efficiently store and transmit point clouds, compression methods have been developed, but they often result in a degradation of quality. To reduce color distortion in point clouds, we propose a graph-based quality enhancement network (GQE-Net) that uses geometry information as an auxiliary input and graph convolution blocks to extract local features efficiently. Specifically, we use a parallel-serial graph attention module with a multi-head graph attention mechanism to focus on important points or features and help them fuse together. Additionally, we design a feature refinement module that takes into account the normals and geometry distance between points. To work within the limitations of GPU memory capacity, the distorted point cloud is divided into overlap-allowed 3D patches, which are sent to GQE-Net for quality enhancement. To account for differences in data distribution among different color components, three models are trained for the three color components. Experimental results show that our method achieves state-of-the-art performance. For example, when implementing GQE-Net on a recent test model of the geometry-based point cloud compression (G-PCC) standard, 0.43 dB, 0.25 dB and 0.36 dB Bj phi ntegaard delta (BD)-peak signal-to-noise ratio (PSNR), corresponding to 14.0%, 9.3% and 14.5% BD-rate savings were achieved on dense point clouds for the Y, Cb, and Cr components, respectively.
引用
收藏
页码:6303 / 6317
页数:15
相关论文
共 50 条
  • [41] A color-based objective quality metric for point cloud contents
    Viola, Irene
    Subramanyam, Shishir
    Cesar, Pablo
    2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
  • [42] GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Network
    Razani, Ryan
    Ran Cheng
    Li, Enxu
    Taghavi, Ehsan
    Yuan Ren
    Liu Bingbing
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 16056 - 16065
  • [43] Optimization Algorithm for Point Cloud Quality Enhancement Based on Statistical Filtering
    Zhao, Qian
    Gao, Xiaorong
    Li, Jinlong
    Luo, Lin
    JOURNAL OF SENSORS, 2021, 2021
  • [44] GGM-Net: Graph Geometric Moments Convolution Neural Network for Point Cloud Shape Classification
    Li, Dilong
    Shen, Xin
    Yu, Yongtao
    Guan, Haiyan
    Wang, Hanyun
    Li, Deren
    IEEE ACCESS, 2020, 8 : 124989 - 124998
  • [45] Cloud Removal with SAR-Optical Data Fusion and Graph-Based Feature Aggregation Network
    Chen, Shanjing
    Zhang, Wenjuan
    Li, Zhen
    Wang, Yuxi
    Zhang, Bing
    REMOTE SENSING, 2022, 14 (14)
  • [46] GAPointNet: Graph attention based point neural network for exploiting local feature of point cloud
    Chen, Can
    Fragonara, Luca Zanotti
    Tsourdos, Antonios
    NEUROCOMPUTING, 2021, 438 : 122 - 132
  • [47] A novel partial point cloud registration method based on graph attention network
    Song, Yanan
    Shen, Weiming
    Peng, Kunkun
    VISUAL COMPUTER, 2023, 39 (03): : 1109 - 1120
  • [48] AGNet: An Attention-Based Graph Network for Point Cloud Classification and Segmentation
    Jing, Weipeng
    Zhang, Wenjun
    Li, Linhui
    Di, Donglin
    Chen, Guangsheng
    Wang, Jian
    REMOTE SENSING, 2022, 14 (04)
  • [49] PCTMA-Net: Point Cloud Transformer with Morphing Atlas-based Point Generation Network for Dense Point Cloud Completion
    Lin, Jianjie
    Rickert, Markus
    Perzylo, Alexander
    Knoll, Alois
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 5657 - 5663
  • [50] DDGCN: graph convolution network based on direction and distance for point cloud learning
    Chen, Lifang
    Zhang, Qian
    VISUAL COMPUTER, 2023, 39 (03): : 863 - 873