SE-MD: a single-encoder multiple-decoder deep network for point cloud reconstruction from 2D images

被引:3
|
作者
Hafiz, Abdul Mueed [1 ]
Bhat, Rouf Ul Alam [1 ]
Parah, Shabir Ahmad [2 ]
Hassaballah, M. [3 ,4 ]
机构
[1] Univ Kashmir, Dept Elect & Commun Engn, Inst Technol, Srinagar 190006, J&K, India
[2] Univ Kashmir, Dept Elect & Instrumentat Technol, Srinagar 190006, J&K, India
[3] Prince Sattam Bin Abdulaziz Univ, Dept Comp Sci, Coll Comp Engn & Sci, Al Kharj 16278, Saudi Arabia
[4] South Valley Univ, Fac Comp & Informat, Dept Comp Sci, Qena, Egypt
关键词
3D model reconstruction; 3D shape reconstruction; 2D images; Point clouds; ShapeNet; 3D convolutional networks;
D O I
10.1007/s10044-023-01155-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D model reconstruction from single 2D RGB images is a challenging and actively researched computer vision task. Several techniques based on conventional network architectures have been proposed for the same. However, the body of research work is limited and there are some issues like using inefficient 3D representation formats, weak 3D model reconstruction backbones, inability to reconstruct dense point clouds, dependence of post-processing for reconstruction of dense point clouds and dependence on silhouettes in RGB images. In this paper, a new 2D RGB image to point cloud conversion technique is proposed, which improves the state-of-the-art in the field due to its efficient, robust and simple model by using the concept of parallelization in network architecture. It not only uses efficient and rich 3D representation of point clouds, but also uses a new robust point cloud reconstruction backbone to address the prevalent issues. This involves using a single-encoder multiple-decoder deep network architecture wherein each decoder reconstructs certain fixed viewpoints. This is followed by fusing all the viewpoints to reconstruct a dense point cloud. Various experiments are conducted to evaluate the proposed technique and to compare its performance with those of the state-of-the-arts and impressive gains in performance are demonstrated.
引用
收藏
页码:1291 / 1302
页数:12
相关论文
共 50 条
  • [41] A reconstruction method of 3D face model from front and side 2D face images using deep learning model
    Nishio, Ryota
    Oono, Masaki
    Goto, Takaharu
    Kishimoto, Takahiro
    Shishibori, Masami
    FIFTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2021, 11794
  • [42] Reconstruction of High-Resolution 3D GPR Data from 2D Profiles: A Multiple-Point Statistical Approach
    Zhang, Chongmin
    Gravey, Mathieu
    Mariethoz, Gregoire
    Irving, James
    REMOTE SENSING, 2024, 16 (12)
  • [43] A Neural-Network-Based Cost-Effective Method for Initial Weld Point Extraction from 2D Images
    Lopez-Fuster, Miguel-Angel
    Morgado-Estevez, Arturo
    Diaz-Cano, Ignacio
    Badesa, Francisco J.
    MACHINES, 2024, 12 (07)
  • [44] BoxNet: A Deep Learning Method for 2D Bounding Box Estimation from Bird's-Eye View Point Cloud
    Nezhadarya, Ehsan
    Liu, Yang
    Liu, Bingbing
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1557 - 1564
  • [45] Reconstruction of large-scale anisotropic 3D digital rocks from 2D shale images using generative adversarial network
    Chi, Peng
    Sun, Jianmeng
    Zhang, Ran
    Luo, Xin
    Yan, Weichao
    MARINE AND PETROLEUM GEOLOGY, 2024, 170
  • [46] Advanced 3D Face Reconstruction from Single 2D Images Using Enhanced Adversarial Neural Networks and Graph Neural Networks
    Fathallah, Mohamed
    Eletriby, Sherif
    Alsabaan, Maazen
    Ibrahem, Mohamed I.
    Farok, Gamal
    SENSORS, 2024, 24 (19)
  • [47] Development of a 2D Image Reconstruction and Viewing System for Histological Images from Multiple Tissue Blocks: Towards High-Resolution Whole-Organ 3D Histological Images
    Hashimoto, Noriaki
    Bautista, Pinky A.
    Haneishi, Hideaki
    Snuderl, Matija
    Yagi, Yukako
    PATHOBIOLOGY, 2016, 83 (2-3) : 127 - 139
  • [48] Multi-criteria guided deep learning for 3D microstructure reconstruction of cementitious materials from a single 2D image: application to transport properties
    Xu, Wenxiang
    Wu, Haotian
    Sun, Qian
    Han, Yu
    Jiang, Jinyang
    Liu, Jiaping
    CONSTRUCTION AND BUILDING MATERIALS, 2024, 447
  • [49] Deep learning reconstruction of ultrashort pulses from 2D spatial intensity patterns recorded by an all-in-line system in a single-shot
    Ziv, Ron
    Dikopoltsev, Alex
    Zahavy, Tom
    Rubinstein, Ittai
    Sidorenko, Pavel
    Cohen, Oren
    Segev, Mordechai
    OPTICS EXPRESS, 2020, 28 (05) : 7528 - 7538
  • [50] Pix2Vox++: Multi-scale Context-aware 3D Object Reconstruction from Single and Multiple Images
    Xie, Haozhe
    Yao, Hongxun
    Zhang, Shengping
    Zhou, Shangchen
    Sun, Wenxiu
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (12) : 2919 - 2935