Unsupervised Learning-Based 3-D Target Reconstruction From Single-View SAR Image

被引:0
|
作者
Wang, Yanni [1 ]
Jia, Hecheng [1 ]
Fu, Shilei [1 ]
Xu, Feng [1 ]
机构
[1] Fudan Univ, Key Lab Informat Sci Electromagnet Waves MoE, Shanghai 200433, Peoples R China
关键词
3-D reconstruction; differentiable synthetic aperture radar (SAR) renderer (DSR); unsupervised learning;
D O I
10.1109/TGRS.2025.3550633
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional shape retrieval from synthetic aperture radar (SAR) images has long presented a significant research challenge, with single-view reconstruction proving even more complex due to constraints such as the scarcity of labeled data, limited sample diversity, and heightened sensitivity to radar scattering characteristics. Recently developed deep learning-based methods have made progress in single-view target reconstruction from SAR images. However, these methods still rely heavily on 3-D ground-truth supervision and fail to fully leverage SAR imaging mechanisms for 3-D reconstruction. To address these limitations, an end-to-end unsupervised single-view 3-D reconstruction framework based on a differentiable SAR renderer (DSR) is proposed, achieving precise reconstruction while eliminating the need for ground-truth data. Specifically, the encoder-decoder architecture effectively extracts 3-D and angular features, utilizing template deformation to preserve both fine details and global structures across scales, along with essential pose information for 3-D shape reconstruction. The reconstructed 3-D model is projected onto a 2-D plane, and pixel-level intersection over union (PIoU) loss is employed for unsupervised learning, enabling the extraction of discriminative latent structures and patterns. This approach effectively reduces low-frequency noise, sharpens critical edges, and enhances high-frequency details, improving spatial structure accuracy while minimizing shape distortions and height errors in complex targets. Extensive quantitative and qualitative experiments on both simulated and real datasets demonstrate the framework's superior performance in single-view SAR 3-D target reconstruction, offering a promising solution with broad potential applications.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Deep Learning-Based Single-View Fluorescence Dose Reconstruction for 3D Dosimetry
    Nomura, Y.
    Ashraf, M. R.
    Xing, L.
    INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2023, 117 (02): : S49 - S50
  • [2] 3-D Clothed Human Model Reconstruction Based on Single-View In-the-Wild Image Data
    Shao, Liangjing
    Chen, Benshuang
    Zhang, Ziqun
    Chen, Xinrong
    IEEE SENSORS JOURNAL, 2024, 24 (15) : 24178 - 24188
  • [3] Toward Realistic Single-View 3D Object Reconstruction with Unsupervised Learning from Multiple Images
    Long-Nhat Ho
    Anh Tuan Tran
    Quynh Phung
    Minh Hoai
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12580 - 12590
  • [4] Learning View Priors for Single-view 3D Reconstruction
    Kato, Hiroharu
    Harada, Tatsuya
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9770 - 9779
  • [5] Deep Learning-Based Reconstruction of 3D Morphology of Geomaterial Particles from Single-View 2D Images
    Zhao, Jiangpeng
    Xie, Heping
    Li, Cunbao
    Liu, Yifei
    MATERIALS, 2024, 17 (20)
  • [6] Fast Automatic Single-View 3-d Reconstruction of Urban Scenes
    Barinova, Olga
    Konushin, Vadim
    Yakubenko, Anton
    Lee, KeeChang
    Lim, Hwasup
    Konushini, Anton
    COMPUTER VISION - ECCV 2008, PT II, PROCEEDINGS, 2008, 5303 : 100 - +
  • [7] SVD-based camera self-calibration and 3-D reconstruction from single-view
    Yang, ZG
    Ren, L
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 4090 - 4095
  • [8] 3D Reconstruction from Single-View Image Using Feature Selection
    Wang, Bo
    Yao, Hongxun
    IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 143 - 152
  • [9] 3D Reconstruction and Estimation from Single-view 2D Image by Deep Learning A Survey
    Shan, Yongfeng
    Liang, Christy Jie
    Xu, Min
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 1 - 7
  • [10] Lightweight Pixel2mesh for 3-D Target Reconstruction From a Single SAR Image
    Yu, Lingjuan
    Zou, Jianping
    Liang, Miaomiao
    Li, Liang
    Xie, Xiaochun
    Yu, Xiangchun
    Hong, Wen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5