No-Reference Point Cloud Quality Assessment Through Structure Sampling and Clustering Based on Graph

被引:0
|
作者
Wu, Xinqiang [1 ]
He, Zhouyan [1 ]
Jiang, Gangyi [2 ]
Yu, Mei [2 ]
Song, Yang [1 ]
Luo, Ting [1 ]
机构
[1] Ningbo Univ, Coll Sci & Technol, Ningbo 315212, Peoples R China
[2] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud quality assessment; no-reference; point cloud sampling; graph-based feature extraction;
D O I
10.1109/TBC.2024.3482173
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As a popular multimedia representation, 3D Point Clouds (PC) inevitably encounter distortion during their acquisition, processing, coding, and transmission, resulting in visual quality degradation. Therefore, it is critical to propose a Point Cloud Quality Assessment (PCQA) method to perceive the visual quality of PC. In this paper, we propose a no-reference PCQA method through structure sampling and clustering based on graph, which consists of two-stage pre-processing, quality feature extraction, attention-based feature fusion, and feature regression. For pre-processing, considering the Human Visual System (HVS) tendency to perceive distortions in both the global structure and local details of PCs, a two-stage sampling strategy is introduced. Specifically, to adapt to the irregular structure of PCs, it introduces structural key point sampling and local cluster to capture both global and local information, respectively, thereby facilitating more effective learning of distortion features. Then, in quality feature extraction, two modules are designed based on the two-stage pre-processing results (i.e., Global Feature Extraction (GFE) and Local Feature Extraction (LFE)) to respectively extract global and local quality features. Additionally, for attention-based feature fusion, a Unified Feature Integrator (UFI) module is proposed. This module enhances quality perception capability by integrating global features and individual local quality features and introduces the Transformer to interact with the integrated quality features. Finally, feature regression is conducted to map the final features into the quality score. The performance of the proposed method is tested on four publicly available databases, and the experimental results show that the proposed method is superior compared with existing state-of-the-art no-reference PCQA methods in most cases.
引用
收藏
页码:307 / 322
页数:16
相关论文
共 50 条
  • [21] No-Reference Image Quality Assessment Based on HVS
    Fu, Yan
    Wang, Shengchun
    2016 INTERNATIONAL SYMPOSIUM ON COMPUTER, CONSUMER AND CONTROL (IS3C), 2016, : 1093 - 1096
  • [22] NO-REFERENCE MESH VISUAL QUALITY ASSESSMENT USING GRAPH-BASED DEEP LEARNING
    Abouelaziz, Ilyass
    Chetouani, Aladine
    El Hassouni, Mohammed
    Cherifi, Hocine
    IEEE MMSP 2021: 2021 IEEE 23RD INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2021,
  • [23] An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysis
    Mukesh Kumar Rohil
    Neetika Gupta
    Prakash Yadav
    Signal, Image and Video Processing, 2020, 14 : 205 - 213
  • [24] NO-REFERENCE IMAGE QUALITY ASSESSMENT BASED ON FILTERING
    Lu, Fang-Fang
    Lu, Lu
    Wang, Zhen
    MATERIAL ENGINEERING AND MECHANICAL ENGINEERING (MEME2015), 2016, : 929 - 937
  • [25] No-reference quality assessment based on visual perception
    Li, Junshan
    Yang, Yawei
    Hu, Shuangyan
    Zhang, Jiao
    INTERNATIONAL SYMPOSIUM ON OPTOELECTRONIC TECHNOLOGY AND APPLICATION 2014: IMAGE PROCESSING AND PATTERN RECOGNITION, 2014, 9301
  • [26] No-reference Image Quality Assessment through Transfer Learning
    Feng, Yeli
    Cai Yiyu
    2017 IEEE 2ND INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2017, : 90 - 94
  • [27] An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysis
    Rohil, Mukesh Kumar
    Gupta, Neetika
    Yadav, Prakash
    SIGNAL IMAGE AND VIDEO PROCESSING, 2020, 14 (01) : 205 - 213
  • [28] No-Reference Image Quality Assessment through SIFT Intensity
    Sun, Tongfeng
    Ding, Shifei
    Xu, Xinzheng
    APPLIED MATHEMATICS & INFORMATION SCIENCES, 2014, 8 (04): : 1925 - 1934
  • [29] RATING-AUGMENTED NO-REFERENCE POINT CLOUD QUALITY ASSESSMENT USING MULTI-TASK LEARNING
    Wang, Xinyu
    Wang, Xiaochuan
    Liu, Ruijun
    Huang, Xiankai
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4320 - 4324
  • [30] Zoom to Perceive Better: No-Reference Point Cloud Quality Assessment via Exploring Effective Multiscale Feature
    Wang, Jilong
    Gao, Wei
    Li, Ge
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6334 - 6346