SE-MD: a single-encoder multiple-decoder deep network for point cloud reconstruction from 2D images

被引:3
|
作者
Hafiz, Abdul Mueed [1 ]
Bhat, Rouf Ul Alam [1 ]
Parah, Shabir Ahmad [2 ]
Hassaballah, M. [3 ,4 ]
机构
[1] Univ Kashmir, Dept Elect & Commun Engn, Inst Technol, Srinagar 190006, J&K, India
[2] Univ Kashmir, Dept Elect & Instrumentat Technol, Srinagar 190006, J&K, India
[3] Prince Sattam Bin Abdulaziz Univ, Dept Comp Sci, Coll Comp Engn & Sci, Al Kharj 16278, Saudi Arabia
[4] South Valley Univ, Fac Comp & Informat, Dept Comp Sci, Qena, Egypt
关键词
3D model reconstruction; 3D shape reconstruction; 2D images; Point clouds; ShapeNet; 3D convolutional networks;
D O I
10.1007/s10044-023-01155-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D model reconstruction from single 2D RGB images is a challenging and actively researched computer vision task. Several techniques based on conventional network architectures have been proposed for the same. However, the body of research work is limited and there are some issues like using inefficient 3D representation formats, weak 3D model reconstruction backbones, inability to reconstruct dense point clouds, dependence of post-processing for reconstruction of dense point clouds and dependence on silhouettes in RGB images. In this paper, a new 2D RGB image to point cloud conversion technique is proposed, which improves the state-of-the-art in the field due to its efficient, robust and simple model by using the concept of parallelization in network architecture. It not only uses efficient and rich 3D representation of point clouds, but also uses a new robust point cloud reconstruction backbone to address the prevalent issues. This involves using a single-encoder multiple-decoder deep network architecture wherein each decoder reconstructs certain fixed viewpoints. This is followed by fusing all the viewpoints to reconstruct a dense point cloud. Various experiments are conducted to evaluate the proposed technique and to compare its performance with those of the state-of-the-arts and impressive gains in performance are demonstrated.
引用
收藏
页码:1291 / 1302
页数:12
相关论文
共 50 条
  • [1] SE-MD: a single-encoder multiple-decoder deep network for point cloud reconstruction from 2D images
    Abdul Mueed Hafiz
    Rouf Ul Alam Bhat
    Shabir Ahmad Parah
    M. Hassaballah
    Pattern Analysis and Applications, 2023, 26 (3) : 1291 - 1302
  • [2] Deep 2D Encoder-Decoder Convolutional Neural Network for Multiple Sclerosis Lesion Segmentation in Brain MRI
    Aslani, Shahab
    Dayan, Michael
    Murino, Vittorio
    Sona, Diego
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2018, PT I, 2019, 11383 : 132 - 141
  • [3] Height estimation from single aerial images using a deep convolutional encoder-decoder network
    Amirkolaee, Hamed Amini
    Arefi, Hossein
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 149 : 50 - 66
  • [4] Point-Reconstruction-Network: 3D Point Cloud Reconstruction from a Single Image
    Yueqi Guang Huo
    Zhiqiang Niu
    Dawei Yang
    undefined Lin
    Pattern Recognition and Image Analysis, 2024, 34 (4) : 1288 - 1295
  • [5] A multiple-point statistics algorithm for 3D pore space reconstruction from 2D images
    Hajizadeh, Alireza
    Safekordi, Aliakbar
    Farhadpour, Farhad A.
    ADVANCES IN WATER RESOURCES, 2011, 34 (10) : 1256 - 1267
  • [6] Concurrent attentional reconstruction network for 3D point cloud reconstruction from single image
    Velagapalli, Premalatha
    Parveen, Nikhat
    APPLIED SOFT COMPUTING, 2025, 172
  • [7] Disentangling Deep Network for Reconstructing 3D Object Shapes from Single 2D Images
    Yang, Yang
    Han, Junwei
    Zhang, Dingwen
    Cheng, De
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 153 - 166
  • [8] sat2pc: Generating Building Roof's Point Cloud from a Single 2D Satellite Images
    Rezaei, Yoones
    Lee, Stephen
    PROCEEDINGS OF THE 2023 ACM/IEEE 14TH INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS, WITH CPS-IOTWEEK 2023, 2023, : 221 - 230
  • [9] A Novel Fusion Method of 3D Point Cloud and 2D Images for 3D Environment Reconstruction
    Yin, Fang
    Chou, Wusheng
    Wang, Dongyang
    Yang, Guang
    NINTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2017), 2017, 10420
  • [10] Deep Encoder-Decoder Adversarial Reconstruction (DEAR) Network for 3D CT from Few-View Data
    Xie, Huidong
    Shan, Hongming
    Wang, Ge
    BIOENGINEERING-BASEL, 2019, 6 (04):