Learning Implicit Neural Representation for Satellite Object Mesh Reconstruction

被引:3
|
作者
Yang, Xi [1 ]
Cao, Mengqing [1 ]
Li, Cong [2 ]
Zhao, Hua [3 ]
Yang, Dong [2 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xian Inst Space Radio Technol, Xian 710100, Peoples R China
[3] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
3D reconstruction; point cloud; implicit surface; satellite;
D O I
10.3390/rs15174163
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Constructing a surface representation from the sparse point cloud of a satellite is an important task for satellite on-orbit services such as satellite docking and maintenance. In related studies on surface reconstruction from point clouds, implicit neural representations have gained popularity in learning-based 3D object reconstruction. When aiming for a satellite with a more complicated geometry and larger intra-class variance, existing implicit approaches cannot perform well. To solve the above contradictions and make effective use of implicit neural representations, we built a NASA3D dataset containing point clouds, watertight meshes, occupancy values, and corresponding points by using the 3D models on NASA's official website. On the basis of NASA3D, we propose a novel network called GONet for a more detailed reconstruction of satellite grids. By designing an explicit-related implicit neural representation of the Grid Occupancy Field (GOF) and introducing it into GONet, we compensate for the lack of explicit supervision in existing point cloud surface reconstruction approaches. The GOF, together with the occupancy field (OF), serves as the supervised information for neural network learning. Learning the GOF strengthens GONet's attention to the critical points of the surface extraction algorithm Marching Cubes; thus, it helps improve the reconstructed surface's accuracy. In addition, GONet uses the same encoder and decoder as ConvONet but designs a novel Adaptive Feature Aggregation (AFA) module to achieve an adaptive fusion of planar and volume features. The insertion of AFA allows for the obtained implicit features to incorporate more geometric and volumetric information. Both visualization and quantitative experimental results demonstrate that our GONet could handle 3D satellite reconstruction work and outperform existing state-of-the-art methods by a significant margin. With a watertight mesh, our GONet achieves 5.507 CD-L1, 0.8821 F-score, and 68.86% IoU, which is equal to gains of 1.377, 0.0466, and 3.59% over the previous methods using NASA3D, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation
    Zheng, Xin
    Li, Zhengqu
    Liu, Deyang
    Zhou, Xiaofei
    Shan, Caifeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12437 - 12449
  • [42] Implicit SVD for Graph Representation Learning
    Abu-El-Haija, Sami
    Mostafa, Hesham
    Nassar, Marcel
    Crespi, Valentino
    Steeg, Greg Ver
    Galstyan, Aram
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [43] Learning Implicit Glyph Shape Representation
    Liu, Ying-Tian
    Guo, Yuan-Chen
    Li, Yi-Xiao
    Wang, Chen
    Zhang, Song-Hai
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (10) : 4172 - 4182
  • [44] Coarse-to-Fine Implicit Representation Learning for 3D Hand-Object Reconstruction from a Single RGB-D Image
    Liu, Xingyu
    Ren, Pengfei
    Wang, Jingyu
    Qi, Qi
    Sun, Haifeng
    Zhuang, Zirui
    Liao, Jianxin
    COMPUTER VISION - ECCV 2024, PT LI, 2025, 15109 : 74 - 92
  • [45] Learning Point Processes and Convolutional Neural Networks for Object Detection in Satellite Images
    Mabon, Jules
    Ortner, Mathias
    Zerubia, Josiane
    REMOTE SENSING, 2024, 16 (06)
  • [46] Object-Compositional Neural Implicit Surfaces
    Wu, Qianyi
    Liu, Xian
    Chen, Yuedong
    Li, Kejie
    Zheng, Chuanxia
    Cai, Jianfei
    Zheng, Jianmin
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 197 - 213
  • [47] NeuMesh: Learning Disentangled Neural Mesh-Based Implicit Field for Geometry and Texture Editing
    Yang, Bangbang
    Bao, Chong
    Zeng, Junyi
    Bao, Hujun
    Zhang, Yinda
    Cui, Zhaopeng
    Zhang, Guofeng
    COMPUTER VISION - ECCV 2022, PT XVI, 2022, 13676 : 597 - 614
  • [48] Ultrasound Confidence Maps with Neural Implicit Representation
    Yesilkaynak, Vahit Bugra
    Duque, Vanessa Gonzalez
    Wysocki, Magdalena
    Velikova, Yordanka
    Mateus, Diana
    Navab, Nassir
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, PT II, MIUA 2024, 2024, 14860 : 89 - 100
  • [49] Implicit neural representation for potential field geophysics
    Smith, Luke Thomas
    Horrocks, Tom
    Akhtar, Naveed
    Holden, Eun-Jung
    Wedge, Daniel
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [50] A Multi-Implicit Neural Representation for Fonts
    Reddy, Pradyumna
    Zhang, Zhifei
    Wang, Zhaowen
    Fisher, Matthew
    Jin, Hailin
    Mitra, Niloy J.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34