SE-MD: a single-encoder multiple-decoder deep network for point cloud reconstruction from 2D images

被引:3
|
作者
Hafiz, Abdul Mueed [1 ]
Bhat, Rouf Ul Alam [1 ]
Parah, Shabir Ahmad [2 ]
Hassaballah, M. [3 ,4 ]
机构
[1] Univ Kashmir, Dept Elect & Commun Engn, Inst Technol, Srinagar 190006, J&K, India
[2] Univ Kashmir, Dept Elect & Instrumentat Technol, Srinagar 190006, J&K, India
[3] Prince Sattam Bin Abdulaziz Univ, Dept Comp Sci, Coll Comp Engn & Sci, Al Kharj 16278, Saudi Arabia
[4] South Valley Univ, Fac Comp & Informat, Dept Comp Sci, Qena, Egypt
关键词
3D model reconstruction; 3D shape reconstruction; 2D images; Point clouds; ShapeNet; 3D convolutional networks;
D O I
10.1007/s10044-023-01155-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D model reconstruction from single 2D RGB images is a challenging and actively researched computer vision task. Several techniques based on conventional network architectures have been proposed for the same. However, the body of research work is limited and there are some issues like using inefficient 3D representation formats, weak 3D model reconstruction backbones, inability to reconstruct dense point clouds, dependence of post-processing for reconstruction of dense point clouds and dependence on silhouettes in RGB images. In this paper, a new 2D RGB image to point cloud conversion technique is proposed, which improves the state-of-the-art in the field due to its efficient, robust and simple model by using the concept of parallelization in network architecture. It not only uses efficient and rich 3D representation of point clouds, but also uses a new robust point cloud reconstruction backbone to address the prevalent issues. This involves using a single-encoder multiple-decoder deep network architecture wherein each decoder reconstructs certain fixed viewpoints. This is followed by fusing all the viewpoints to reconstruct a dense point cloud. Various experiments are conducted to evaluate the proposed technique and to compare its performance with those of the state-of-the-arts and impressive gains in performance are demonstrated.
引用
收藏
页码:1291 / 1302
页数:12
相关论文
共 50 条
  • [21] 3D-ARNet: An accurate 3D point cloud reconstruction network from a single-image
    Hui Chen
    Yipeng Zuo
    Multimedia Tools and Applications, 2022, 81 : 12127 - 12140
  • [22] 3D-ARNet: An accurate 3D point cloud reconstruction network from a single-image
    Chen, Hui
    Zuo, Yipeng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (09) : 12127 - 12140
  • [23] 3D Face Reconstruction From A Single Image Assisted by 2D Face Images in the Wild
    Tu, Xiaoguang
    Zhao, Jian
    Xie, Mei
    Jiang, Zihang
    Balamurugan, Akshaya
    Luo, Yao
    Zhao, Yang
    He, Lingxiao
    Ma, Zheng
    Feng, Jiashi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 (23) : 1160 - 1172
  • [24] A 3D template-based point generation network for 3D reconstruction from single images
    Yuniarti, Anny
    Arifin, Agus Zainal
    Suciati, Nanik
    APPLIED SOFT COMPUTING, 2021, 111
  • [25] IMG2HEIGHT: height estimation from single remote sensing image using a deep convolutional encoder-decoder network
    Du, Shouhang
    Xing, Jianghe
    Du, Shihong
    Cui, Ximin
    Xiao, Xiongwu
    Li, Wei
    Wang, Shaoyu
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (18) : 5686 - 5712
  • [26] COMPARISON OF 2D AND 3D WALL RECONSTRUCTION ALGORITHMS FROM POINT CLOUD DATA FOR AS-BUILT BIM
    Bassier, Maarten
    Yousefzadeh, Meisam
    Vergauwen, Maarten
    JOURNAL OF INFORMATION TECHNOLOGY IN CONSTRUCTION, 2020, 25 : 173 - 192
  • [27] One-Stage Shape Instantiation from a Single 2D Image to 3D Point Cloud
    Zhou, Xiao-Yun
    Wang, Zhao-Yang
    Li, Peichao
    Zheng, Jian-Qing
    Yang, Guang-Zhong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV, 2019, 11767 : 30 - 38
  • [28] Object-Aware 3D Scene Reconstruction from Single 2D Images of Indoor Scenes
    Wen, Mingyun
    Cho, Kyungeun
    MATHEMATICS, 2023, 11 (02)
  • [29] Fast Object Segmentation by Growing Minimal Paths from a Single Point on 2D or 3D Images
    Benmansour, Fethallah
    Cohen, Laurent D.
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2009, 33 (02) : 209 - 221
  • [30] Fast Object Segmentation by Growing Minimal Paths from a Single Point on 2D or 3D Images
    Fethallah Benmansour
    Laurent D. Cohen
    Journal of Mathematical Imaging and Vision, 2009, 33 : 209 - 221