No-Reference Point Cloud Quality Assessment Through Structure Sampling and Clustering Based on Graph

被引:0
|
作者
Wu, Xinqiang [1 ]
He, Zhouyan [1 ]
Jiang, Gangyi [2 ]
Yu, Mei [2 ]
Song, Yang [1 ]
Luo, Ting [1 ]
机构
[1] Ningbo Univ, Coll Sci & Technol, Ningbo 315212, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud quality assessment; no-reference; point cloud sampling; graph-based feature extraction;
D O I
10.1109/TBC.2024.3482173
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a popular multimedia representation, 3D Point Clouds (PC) inevitably encounter distortion during their acquisition, processing, coding, and transmission, resulting in visual quality degradation. Therefore, it is critical to propose a Point Cloud Quality Assessment (PCQA) method to perceive the visual quality of PC. In this paper, we propose a no-reference PCQA method through structure sampling and clustering based on graph, which consists of two-stage pre-processing, quality feature extraction, attention-based feature fusion, and feature regression. For pre-processing, considering the Human Visual System (HVS) tendency to perceive distortions in both the global structure and local details of PCs, a two-stage sampling strategy is introduced. Specifically, to adapt to the irregular structure of PCs, it introduces structural key point sampling and local cluster to capture both global and local information, respectively, thereby facilitating more effective learning of distortion features. Then, in quality feature extraction, two modules are designed based on the two-stage pre-processing results (i.e., Global Feature Extraction (GFE) and Local Feature Extraction (LFE)) to respectively extract global and local quality features. Additionally, for attention-based feature fusion, a Unified Feature Integrator (UFI) module is proposed. This module enhances quality perception capability by integrating global features and individual local quality features and introduces the Transformer to interact with the integrated quality features. Finally, feature regression is conducted to map the final features into the quality score. The performance of the proposed method is tested on four publicly available databases, and the experimental results show that the proposed method is superior compared with existing state-of-the-art no-reference PCQA methods in most cases.
引用
收藏
页码:307 / 322
页数:16
相关论文
共 50 条
  • [1] CLUSTERING-BASED PSYCHOMETRIC NO-REFERENCE QUALITY MODEL FOR POINT CLOUD VIDEO
    Van Damme, Sam
    Vega, Maria Torres
    van der Hooft, Jeroen
    De Turck, Filip
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1866 - 1870
  • [2] A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences
    Fan, Yu
    Zhang, Zicheng
    Sun, Wei
    Min, Xiongkuo
    Liu, Ning
    Zhou, Quan
    He, Jun
    Wang, Qiyuan
    Zhai, Guangtao
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [3] Evaluation of point cloud features for no-reference visual quality assessment
    Smitskamp, Gwennan
    Viola, Irene
    Cesar, Pablo
    2023 15TH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE, QOMEX, 2023, : 147 - 152
  • [4] No-Reference Point Cloud Quality Assessment via Domain Adaptation
    Yang, Qi
    Liu, Yipeng
    Chen, Siheng
    Xu, Yiling
    Sun, Jun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 21147 - 21156
  • [5] Point Cloud Quality Assessment: Dataset Construction and Learning-based No-reference Metric
    Liu, Yipeng
    Yang, Qi
    Xu, Yiling
    Yang, Le
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [6] Dynamic Hypergraph Convolutional Network for No-Reference Point Cloud Quality Assessment
    Chen, Wu
    Jiang, Qiuping
    Zhou, Wei
    Xu, Long
    Lin, Weisi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 10479 - 10493
  • [7] GPA-Net:No-Reference Point Cloud Quality Assessment With Multi-Task Graph Convolutional Network
    Shan, Ziyu
    Yang, Qi
    Ye, Rui
    Zhang, Yujie
    Xu, Yiling
    Xu, Xiaozhong
    Liu, Shan
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4955 - 4967
  • [8] Non-Local Geometry and Color Gradient Aggregation Graph Model for No-Reference Point Cloud Quality Assessment
    Wang, Songtao
    Wang, Xiaoqi
    Gao, Hao
    Xiong, Jian
    MM 2023 - Proceedings of the 31st ACM International Conference on Multimedia, 2023, : 6803 - 6810
  • [9] Non-Local Geometry and Color Gradient Aggregation Graph Model for No-Reference Point Cloud Quality Assessment
    Wang, Songtao
    Wang, Xiaoqi
    Gao, Hao
    Xiong, Jian
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6803 - 6810
  • [10] No-reference point cloud quality assessment based on multi-projection and hierarchical pyramid network
    Miao, Yizhuang
    Xiao, Shuyan
    Pan, Lingjiao
    Zhang, Lin
    Yang, Zhengkai
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (11) : 7969 - 7980