CarvingNet: Point cloud completion by stepwise refining multi-resolution features

被引:1
|
作者
Li, Liangliang [1 ,2 ,3 ]
Liu, Guihua [1 ,3 ]
Xu, Feng [1 ,3 ]
Deng, Lei [1 ,3 ]
机构
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang 621010, Peoples R China
[2] Sichuan Vocat Coll Informat Technol, Guangyuan 628040, Peoples R China
[3] Robot Technol Used Special Environm Key Lab Sichua, Mianyang 621010, Peoples R China
关键词
3D computer vision; Point cloud completion; Transformer; U; -Net;
D O I
10.1016/j.patcog.2024.110780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the field of 3D vision, 3D point cloud completion is a crucial task in many practical applications. Current methods use Transformer's Encoder-Decoder framework to predict the missing part of the point cloud features at low resolution, which does not fully utilize the feature information at multiple resolutions and can result in the loss of the object's geometric details. In this paper, we present a novel point cloud completion method, CarvingNet, which, to the best of our knowledge, is the first to apply the U-Net architecture to the point cloud completion task by operating directly on unordered point cloud features at multiple resolutions. Firstly, we gradually expand the receptive field and use cross-attention to purify the features of the missing part of the point cloud at each resolution and to generate the contour features of the complete point cloud at the last obtained resolution. Then, we gradually reduce the receptive field and use cross-attention to refine the features of the complete point cloud at each resolution and to generate the features of the complete point cloud with rich details at the last obtained resolution. To obtain point cloud features at different resolutions, we specifically design the up-sampling module and down-sampling module for disordered point cloud features. Furthermore, we improve the FoldingNet network to make it more suitable for generating high-quality dense point clouds. The experimental results demonstrate that our proposed CarvingNet achieves the performance of existing state-of-the-art methods on the ShapeNet-55, ShapeNet-34, and KITTI benchmarks.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] MeshFeat: Multi-resolution Features for Neural Fields on Meshes
    Mahajan, Mihir
    Hofherr, Florian
    Cremers, Daniel
    COMPUTER VISION - ECCV 2024, PT XXIX, 2025, 15087 : 268 - 285
  • [22] SparseARFM-SI: Rotary Point Cloud Place Recognition Based on Multi-Resolution and Attention Mechanism
    Liu, Xiaohang
    Zhang, Ruonan
    Wang, Jie
    Li, Ge
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [23] Simulating, modeling and refining supramolecular complexes at multi-resolution and multi-length scales
    Ma, Jianpeng
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2005, 230 : U1291 - U1292
  • [24] A Hierarchical Machine Learning Approach for Multi-Level and Multi-Resolution 3D Point Cloud Classification
    Teruggi, Simone
    Grilli, Eleonora
    Russo, Michele
    Fassi, Francesco
    Remondino, Fabio
    REMOTE SENSING, 2020, 12 (16)
  • [25] Multi-resolution curve alignment based on salient features
    Li, Zheng
    Luo, Xiaonan
    Gao, Chengying
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2006, : 357 - 360
  • [26] Detection of anomalies in textures based on multi-resolution features
    Shadhan, Lior
    Cohen, Israel
    2006 IEEE 24TH CONVENTION OF ELECTRICAL & ELECTRONICS ENGINEERS IN ISRAEL, 2006, : 358 - +
  • [27] Hand Detection Using Multi-Resolution HOG Features
    Zhao, Yanguo
    Song, Zhan
    Wu, Xinyu
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO 2012), 2012,
  • [28] Hybrid simplification: Combining multi-resolution polygon and point rendering
    Cohen, JD
    Aliaga, DG
    Zhang, WQ
    VISUALIZATION 2001, PROCEEDINGS, 2001, : 37 - 44
  • [29] Multi-feature fusion point cloud completion network
    Chen, Xiu
    Li, Yujie
    Li, Yun
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2022, 25 (04): : 1551 - 1564
  • [30] Multiple-point statistics using multi-resolution images
    Straubhaar, Julien
    Renard, Philippe
    Chugunova, Tatiana
    STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2020, 34 (02) : 251 - 273