DcTr: Noise-robust point cloud completion by dual-channel transformer with cross-attention

被引:20
|
作者
Fei, Ben [1 ]
Yang, Weidong [1 ,2 ]
Ma, Lipeng [1 ]
Chen, Wen-Ming [3 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai Key Lab Data Sci, Shanghai 200433, Peoples R China
[2] Zhuhai Fudan Innovat Inst, Hengqin New Area, Zhuhai 519000, Guangdong, Peoples R China
[3] Acad Engn & Technol, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; 3D Vision; Transformer; Cross; -attention; Dual -channel transformer;
D O I
10.1016/j.patcog.2022.109051
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current point cloud completion research mainly utilizes the global shape representation and local features to recover the missing regions of 3D shape for the partial point cloud. However, these methods suffer from inefficient utilization of local features and unstructured points prediction in local patches, hardly resulting in a well-arranged structure for points. To tackle these problems, we propose to employ Dual-channel Transformer and Cross-attention (CA) for point cloud completion (DcTr). The DcTr is apt at using local features and preserving a well-structured generation process. Specifically, the dual-channel transformer leverages point-wise attention and channel-wise attention to summarize the deconvolution patterns used in the previous Dual-channel Transformer Point Deconvolution (DCTPD) stage to produce the deconvolution in the current DCTPD stage. Meanwhile, we employ cross-attention to convey the geometric information from the local regions of incomplete point clouds for the generation of complete ones at different resolutions. In this way, we can generate the locally compact and structured point cloud by capturing the structure characteristic of 3D shape in local patches. Our experimental results indicate that DcTr outperforms the state-of-the-art point cloud completion methods under several benchmarks and is robust to various kinds of noise.
引用
收藏
页数:13
相关论文
共 44 条
  • [21] DCFNet:Dual-Channel Feature Fusion of Real Scene for Point Cloud Semantic Segmentation
    Sun, Liujie
    Zhu, Yaoda
    Wang, Wenju
    Computer Engineering and Applications, 2024, 60 (12) : 160 - 169
  • [22] Point cloud completion using multiscale feature fusion and cross-regional attention
    Wu, Hang
    Miao, Yubin
    Fu, Ruochong
    IMAGE AND VISION COMPUTING, 2021, 111
  • [23] GazeSymCAT: A symmetric cross-attention transformer for robust gaze estimation under extreme head poses and gaze variations
    Zhong, Yupeng
    Lee, Sang Hun
    JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2025, 12 (03) : 115 - 129
  • [24] Accurate Multi-contrast MRI Super-Resolution via a Dual Cross-Attention Transformer Network
    Huang, Shoujin
    Li, Jingyu
    Mei, Lifeng
    Zhang, Tan
    Chen, Ziran
    Dong, Yu
    Dong, Linzheng
    Liu, Shaojun
    Lyu, Mengye
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 313 - 322
  • [25] OAAFormer: Robust and Efficient Point Cloud Registration Through Overlapping-Aware Attention in Transformer
    Gao, Jun-Jie
    Dong, Qiu-Jie
    Wang, Rui-An
    Chen, Shuang-Min
    Xin, Shi-Qing
    Tu, Chang-He
    Wang, Wenping
    Journal of Computer Science and Technology, 2024, 39 (04) : 755 - 770
  • [26] DuDoCAF: Dual-Domain Cross-Attention Fusion with Recurrent Transformer for Fast Multi-contrast MR Imaging
    Lyu, Jun
    Sui, Bin
    Wang, Chengyan
    Tian, Yapeng
    Dou, Qi
    Qin, Jing
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 : 474 - 484
  • [27] Robust Control Strategy for Dual-Channel Supply Chain With Free Riding Behavior and Cross-Channel Return
    Xia, Yuxiang
    Li, Chengcheng
    IEEE ACCESS, 2023, 11 : 144953 - 144965
  • [28] CsAGP: Detecting Alzheimer's disease from multimodal images via dual-transformer with cross-attention and graph pooling
    Tang, Chaosheng
    Wei, Mingyang
    Sun, Junding
    Wang, Shuihua
    Zhang, Yudong
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (07)
  • [29] Cloud Detection of Remote Sensing Image Based on Multi-Scale Data and Dual-Channel Attention Mechanism
    Yan, Qing
    Liu, Hu
    Zhang, Jingjing
    Sun, Xiaobing
    Xiong, Wei
    Zou, Mingmin
    Xia, Yi
    Xun, Lina
    REMOTE SENSING, 2022, 14 (15)
  • [30] ADT: Person re-identification based on efficient attention mechanism and single-channel dual-channel fusion with transformer features aggregation
    Xing, Jiahui
    Lu, Jian
    Zhang, Kaibing
    Chen, Xiaogai
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 261