CarvingNet: Point cloud completion by stepwise refining multi-resolution features

被引:1
|
作者
Li, Liangliang [1 ,2 ,3 ]
Liu, Guihua [1 ,3 ]
Xu, Feng [1 ,3 ]
Deng, Lei [1 ,3 ]
机构
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang 621010, Peoples R China
[2] Sichuan Vocat Coll Informat Technol, Guangyuan 628040, Peoples R China
[3] Robot Technol Used Special Environm Key Lab Sichua, Mianyang 621010, Peoples R China
关键词
3D computer vision; Point cloud completion; Transformer; U; -Net;
D O I
10.1016/j.patcog.2024.110780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the field of 3D vision, 3D point cloud completion is a crucial task in many practical applications. Current methods use Transformer's Encoder-Decoder framework to predict the missing part of the point cloud features at low resolution, which does not fully utilize the feature information at multiple resolutions and can result in the loss of the object's geometric details. In this paper, we present a novel point cloud completion method, CarvingNet, which, to the best of our knowledge, is the first to apply the U-Net architecture to the point cloud completion task by operating directly on unordered point cloud features at multiple resolutions. Firstly, we gradually expand the receptive field and use cross-attention to purify the features of the missing part of the point cloud at each resolution and to generate the contour features of the complete point cloud at the last obtained resolution. Then, we gradually reduce the receptive field and use cross-attention to refine the features of the complete point cloud at each resolution and to generate the features of the complete point cloud with rich details at the last obtained resolution. To obtain point cloud features at different resolutions, we specifically design the up-sampling module and down-sampling module for disordered point cloud features. Furthermore, we improve the FoldingNet network to make it more suitable for generating high-quality dense point clouds. The experimental results demonstrate that our proposed CarvingNet achieves the performance of existing state-of-the-art methods on the ShapeNet-55, ShapeNet-34, and KITTI benchmarks.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] MRRA-GAN: Multi-Resolution Relation-Aware GAN for Point Cloud Completion
    Ren, Ke
    Du, Zhenjiang
    He, Qifeng
    Xie, Ning
    Wang, Guan
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2045 - 2050
  • [2] SPCNet: Stepwise Point Cloud Completion Network
    Hu, Fei
    Chen, Honghua
    Lu, Xuequan
    Zhu, Zhe
    Wang, Jun
    Wang, Weiming
    Wang, Fu Lee
    Wei, Mingqiang
    COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 153 - 164
  • [3] A Multi-Resolution Approach to Point Cloud Registration without Control Points
    Bash, Eleanor A.
    Wecker, Lakin
    Rahman, Mir Mustafizur
    Dow, Christine F.
    McDermid, Greg
    Samavati, Faramarz F.
    Whitehead, Ken
    Moorman, Brian J.
    Medrzycka, Dorota
    Copland, Luke
    REMOTE SENSING, 2023, 15 (04)
  • [4] PointRas: Uncertainty-Aware Multi-Resolution Learning for Point Cloud Segmentation
    Zheng, Yu
    Xu, Xiuwei
    Zhou, Jie
    Lu, Jiwen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6002 - 6016
  • [5] Multi-Resolution Point Cloud Generation Based on Heterogeneous Sensor Fusion System
    Jo, HyungGi
    Cho, Hae Min
    Lee, Seongwon
    Kim, Euntai
    2017 14TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2017, : 886 - 888
  • [6] Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentation
    Li, Yuyan
    Duan, Ye
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3980 - 3986
  • [7] Fast Multi-Resolution Spatial Clustering for 3D Point Cloud Data
    Chiang, Yen-Hung
    Hsu, Chih-Ming
    Tsai, Augustine
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 1678 - 1683
  • [8] Stroke-based splatting: an efficient multi-resolution point cloud visualization technique
    Rafael Kuffner dos Anjos
    Claudia Sofia Ribeiro
    Daniel Simões Lopes
    João Madeiras Pereira
    The Visual Computer, 2018, 34 : 1383 - 1397
  • [9] Stroke-based splatting: an efficient multi-resolution point cloud visualization technique
    dos Anjos, Rafael Kuffner
    Ribeiro, Claudia Sofia
    Lopes, Daniel Simoes
    Pereira, Joao Madeiras
    VISUAL COMPUTER, 2018, 34 (10): : 1383 - 1397
  • [10] Multi-resolution point-sample raytracing
    Wand, M
    Strasser, W
    GRAPHICS INTERFACE 2003, PROCEEDING, 2003, : 139 - 148