DcTr: Noise-robust point cloud completion by dual-channel transformer with cross-attention

被引:20
|
作者
Fei, Ben [1 ]
Yang, Weidong [1 ,2 ]
Ma, Lipeng [1 ]
Chen, Wen-Ming [3 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai Key Lab Data Sci, Shanghai 200433, Peoples R China
[2] Zhuhai Fudan Innovat Inst, Hengqin New Area, Zhuhai 519000, Guangdong, Peoples R China
[3] Acad Engn & Technol, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; 3D Vision; Transformer; Cross; -attention; Dual -channel transformer;
D O I
10.1016/j.patcog.2022.109051
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current point cloud completion research mainly utilizes the global shape representation and local features to recover the missing regions of 3D shape for the partial point cloud. However, these methods suffer from inefficient utilization of local features and unstructured points prediction in local patches, hardly resulting in a well-arranged structure for points. To tackle these problems, we propose to employ Dual-channel Transformer and Cross-attention (CA) for point cloud completion (DcTr). The DcTr is apt at using local features and preserving a well-structured generation process. Specifically, the dual-channel transformer leverages point-wise attention and channel-wise attention to summarize the deconvolution patterns used in the previous Dual-channel Transformer Point Deconvolution (DCTPD) stage to produce the deconvolution in the current DCTPD stage. Meanwhile, we employ cross-attention to convey the geometric information from the local regions of incomplete point clouds for the generation of complete ones at different resolutions. In this way, we can generate the locally compact and structured point cloud by capturing the structure characteristic of 3D shape in local patches. Our experimental results indicate that DcTr outperforms the state-of-the-art point cloud completion methods under several benchmarks and is robust to various kinds of noise.
引用
收藏
页数:13
相关论文
共 44 条
  • [1] VQ-DcTr: Vector Quantized Autoencoder With Dual-channel Transformer Points Splitting for 3D Point Cloud Completion
    Fei, Ben
    Yang, Weidong
    Chen, Wen-Ming
    Ma, Lipeng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4769 - 4778
  • [2] COCCA: POINT CLOUD COMPLETION THROUGH CAD CROSS-ATTENTION
    Misik, Adam
    Salihu, Driton
    Brock, Heike
    Steinbach, Eckehard
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 580 - 584
  • [3] Dual-channel VTS feature compensation for noise-robust speech recognition on mobile devices
    Lopez-Espejo, Ivan
    Peinado, Antonio M.
    Gomez, Angel M.
    Gonzalez, Jose A.
    IET SIGNAL PROCESSING, 2017, 11 (01) : 17 - 25
  • [4] Learning Cross-Attention Point Transformer With Global Porous Sampling
    Duan, Yueqi
    Sun, Haowen
    Yan, Juncheng
    Lu, Jiwen
    Zhou, Jie
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6283 - 6297
  • [5] SphereNet: Learning a Noise-Robust and General Descriptor for Point Cloud Registration
    Zhao, Guiyu
    Guo, Zhentao
    Wang, Xin
    Ma, Hongbin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [6] DHAFormer: Dual-channel hybrid attention network with transformer for polyp segmentation
    Huang, Xuejie
    Wang, Liejun
    Jiang, Shaochen
    Xu, Lianghui
    PLOS ONE, 2024, 19 (07):
  • [7] Cross-Regional Attention Network for Point Cloud Completion
    Wu, Hang
    Miao, Yubin
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10274 - 10280
  • [8] Dual Cross-Attention Transformer Networks for Temporal Predictive Modeling of Industrial Process
    Wang, Jie
    Xie, Yongfang
    Xie, Shiwen
    Chen, Xiaofang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 11
  • [9] TSMCF: Transformer-Based SAR and Multispectral Cross-Attention Fusion for Cloud Removal
    Zhu, Hongming
    Wang, Zeju
    Han, Letong
    Xu, Manxin
    Li, Weiqi
    Liu, Qin
    Liu, Sicong
    Du, Bowen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 6710 - 6720
  • [10] ROBUST DUAL-CHANNEL NOISE POWER SPECTRAL DENSITY ESTIMATION
    Jeub, Marco
    Nelke, Christoph
    Krueger, Hauke
    Beaugeant, Christophe
    Vary, Peter
    19TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO-2011), 2011, : 2304 - 2308