Attention-Based Dense Point Cloud Reconstruction From a Single Image

被引:23
|
作者
Lu, Qiang [1 ,2 ,3 ]
Xiao, Mingjie [2 ]
Lu, Yiyang [2 ]
Yuan, Xiaohui [4 ]
Yu, Ye [1 ,2 ,3 ]
机构
[1] Hefei Univ Technol, Key Lab Knowledge Engn Big Data, Minist Educ, Hefei 230009, Anhui, Peoples R China
[2] Hefei Univ Technol, Sch Comp & Informat, Hefei 230009, Anhui, Peoples R China
[3] Anhui Prov Key Lab Ind Safety & Emergency Technol, Hefei 230009, Anhui, Peoples R China
[4] Univ North Texas, Dept Sci & Engn, Denton, TX 76203 USA
来源
IEEE ACCESS | 2019年 / 7卷
基金
中国国家自然科学基金;
关键词
3D reconstruction; point-cloud; attention mechanism; two-stage training; single view reconstruction; GENERATION NETWORK;
D O I
10.1109/ACCESS.2019.2943235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Three-dimensional Reconstruction has drawn much attention in computer vision. Generating a dense point cloud from a single image is a more challenging task. However, generating dense point clouds directly costs expensively in calculation and memory and may cause the network hard to train. In this work, we propose a two-stage training dense point cloud generation network. We first train our attention-based sparse point cloud generation network to generate a sparse point cloud from a single image. Then we train our dense point cloud generation network to densify the generated sparse point cloud. After combining the two stages and finetuning, we obtain an end-to-end network that generates a dense point cloud from a single image. Through evaluation of both synthetic and real-world datasets, we demonstrate that our approach outperforms state of the art works in dense point cloud generation. Our source code is available at https://github.com/VIM-Lab/AttentionDPCR.
引用
收藏
页码:137420 / 137431
页数:12
相关论文
共 50 条
  • [1] An Attention-Based Network for Single Image HDR Reconstruction
    Dafaallah, Mohamed
    Yuan, Hui
    Jiang, Shiqi
    Yang, Ye
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022,
  • [2] CGNet: A Cascaded Generative Network for dense point cloud reconstruction from a single image
    Wang, Ping
    Liu, Li
    Zhang, Huaxiang
    Wang, Tianshi
    KNOWLEDGE-BASED SYSTEMS, 2021, 223
  • [3] Attention-based 3D Object Reconstruction from a Single Image
    Salvi, Andrey
    Gavenski, Nathan
    Pooch, Eduardo
    Tasoniero, Felipe
    Barros, Rodrigo
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [4] Attention-Based Point Cloud Edge Sampling
    Wu, Chengzhi
    Zheng, Junwei
    Pfrommer, Julius
    Beyerer, Juergen
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5333 - 5343
  • [5] Feedback Attention-Based Dense CNN for Hyperspectral Image Classification
    Yu, Chunyan
    Han, Rui
    Song, Meiping
    Liu, Caiyu
    Chang, Chein-, I
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] 3D point cloud generation reconstruction from single image based on image retrieval☆
    Chen, Hui
    Zuo, Yipeng
    Tong, Yong
    Zhu, Li
    RESULTS IN OPTICS, 2021, 5
  • [7] 3D-CDRNet: Retrieval-based dense point cloud reconstruction from a single image under complex background
    Tong, Yong
    Chen, Hui
    Yang, Ning
    Menhas, Muhammad Ilyas
    Ahmad, Bilal
    DISPLAYS, 2023, 78
  • [8] Automatic Reconstruction of Dense 3D Face Point Cloud with A Single Depth Image
    Zhang, Shu
    Yu, Hui
    Dong, Junyu
    Wang, Ting
    Ju, Zhaojie
    Liu, Honghai
    2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, : 1439 - 1444
  • [9] Attention-Based Dynamic Graph CNN for Point Cloud Classification
    Wang, Junfei
    Xiong, Hui
    Gong, Yanli
    Wu, Xianfeng
    Wang, Shun
    Jia, Qian
    Lai, Zhongyuan
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2022, PT I, 2022, 1700 : 357 - 365
  • [10] NeuroGAN: image reconstruction from EEG signals via an attention-based GAN
    Rahul Mishra
    Krishan Sharma
    R. R. Jha
    Arnav Bhavsar
    Neural Computing and Applications, 2023, 35 : 9181 - 9192