DcTr: Noise-robust point cloud completion by dual-channel transformer with cross-attention

被引:20
|
作者
Fei, Ben [1 ]
Yang, Weidong [1 ,2 ]
Ma, Lipeng [1 ]
Chen, Wen-Ming [3 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai Key Lab Data Sci, Shanghai 200433, Peoples R China
[2] Zhuhai Fudan Innovat Inst, Hengqin New Area, Zhuhai 519000, Guangdong, Peoples R China
[3] Acad Engn & Technol, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; 3D Vision; Transformer; Cross; -attention; Dual -channel transformer;
D O I
10.1016/j.patcog.2022.109051
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current point cloud completion research mainly utilizes the global shape representation and local features to recover the missing regions of 3D shape for the partial point cloud. However, these methods suffer from inefficient utilization of local features and unstructured points prediction in local patches, hardly resulting in a well-arranged structure for points. To tackle these problems, we propose to employ Dual-channel Transformer and Cross-attention (CA) for point cloud completion (DcTr). The DcTr is apt at using local features and preserving a well-structured generation process. Specifically, the dual-channel transformer leverages point-wise attention and channel-wise attention to summarize the deconvolution patterns used in the previous Dual-channel Transformer Point Deconvolution (DCTPD) stage to produce the deconvolution in the current DCTPD stage. Meanwhile, we employ cross-attention to convey the geometric information from the local regions of incomplete point clouds for the generation of complete ones at different resolutions. In this way, we can generate the locally compact and structured point cloud by capturing the structure characteristic of 3D shape in local patches. Our experimental results indicate that DcTr outperforms the state-of-the-art point cloud completion methods under several benchmarks and is robust to various kinds of noise.
引用
收藏
页数:13
相关论文
共 44 条
  • [31] DTSSD: Dual-Channel Transformer-Based Network for Point-Based 3D Object Detection
    Zheng, Zhijie
    Huang, Zhicong
    Zhao, Jingwen
    Hu, Haifeng
    Chen, Dihu
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 798 - 802
  • [32] Remote sensing image registration based on dual-channel neural network and robust point set registration algorithm
    Wang Dongzhen
    Chen Ying
    Li Jipeng
    2020 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATICS AND BIOMEDICAL SCIENCES (ICIIBMS 2020), 2020, : 208 - 215
  • [33] Robust Hyperspectral Image Classification Using a Multi-Scale Transformer with Long-Short-Distance Spatial-Spectral Cross-Attention
    Peng, Danyang
    Feng, Haoran
    Wu, Jun
    Wen, Yi
    Han, Tingting
    Li, Yuanyuan
    Yang, Guangyu
    Qu, Lei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [34] CSDN: Cross-Modal Shape-Transfer Dual-Refinement Network for Point Cloud Completion
    Zhu, Zhe
    Nan, Liangliang
    Xie, Haoran
    Chen, Honghua
    Wang, Jun
    Wei, Mingqiang
    Qin, Jing
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (07) : 3545 - 3563
  • [35] A strong anti-noise and easily deployable bearing fault diagnosis model based on time-frequency dual-channel Transformer
    Xu, Zhao
    Jia, Zhiyang
    Wei, Yiwei
    Zhang, Shuyan
    Jin, Zhong
    Dong, Wenpei
    MEASUREMENT, 2024, 236
  • [36] MCTNet: Multiscale Cross-Attention-Based Transformer Network for Semantic Segmentation of Large-Scale Point Cloud
    Guo, Bo
    Deng, Liwei
    Wang, Ruisheng
    Guo, Wenchao
    Ng, Alex Hay-Man
    Bai, Wenfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [37] 3DGTN: 3-D Dual-Attention GLocal Transformer Network for Point Cloud Classification and Segmentation
    Lu, Dening
    Gao, Kyle
    Xie, Qian
    Xu, Linlin
    Li, Jonathan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [38] DCFA-YOLO: A Dual-Channel Cross-Feature-Fusion Attention YOLO Network for Cherry Tomato Bunch Detection
    Chai, Shanglei
    Wen, Ming
    Li, Pengyu
    Zeng, Zhi
    Tian, Yibin
    AGRICULTURE-BASEL, 2025, 15 (03):
  • [39] AN INTERPRETABLE GLAUCOMA DETECTION USING DUAL SCALE CROSS-ATTENTION VISION TRANSFORMER-BASED LONG SHORT TERM MEMORY WITH OPTICAL CUP AND DISK SEGMENTATION
    Krishnamoorthy, V.
    Logeswari, S.
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2025, 25 (01)
  • [40] DuSFE: Dual-Channel Squeeze-Fusion-Excitation co-attention for cross-modality registration of cardiac SPECT and CT
    Chen, Xiongchao
    Zhou, Bo
    Xie, Huidong
    Guo, Xueqi
    Zhang, Jiazhen
    Duncan, James S.
    Miller, Edward J.
    Sinusas, Albert J.
    Onofrey, John A.
    Liu, Chi
    MEDICAL IMAGE ANALYSIS, 2023, 88