Digital Surface Model Super-Resolution by Integrating High-Resolution Remote Sensing Imagery Using Generative Adversarial Networks

被引:1
|
作者
Sun, Guihou [1 ]
Chen, Yuehong [1 ]
Huang, Jiamei [1 ]
Ma, Qiang [2 ]
Ge, Yong [3 ]
机构
[1] Hohai Univ, Coll Geog & Remote Sensing, Nanjing 211100, Peoples R China
[2] China Inst Water Resources & Hydropower Res, Res Ctr Flood & Drought Disaster Reduct, Beijing 100038, Peoples R China
[3] Chinese Acad Sci, State Key Lab Resources & Environm Informat Syst, Inst Geog Sci & Nat Resources Res, Beijing 100101, Peoples R China
关键词
Feature extraction; Remote sensing; Generators; Spatial resolution; Surface topography; Digital surface model (DSM); generative adversarial networks (GANs); remote sensing imagery; slope loss; super-resolution (SR); DEM; DSM;
D O I
10.1109/JSTARS.2024.3399544
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Digital surface model (DSM) is the fundamental data in various geoscience applications, such as city 3-D modeling and urban environment analysis. The freely available DSM often suffers from limited spatial resolution. Super-resolution (SR) is a promising technique to increase the spatial resolution of DSM. However, most existing SR models struggle to reconstruct spatial details, such as buildings, valleys, and ridges. This article proposes a novel DSM super-resolution (DSMSR) model that integrates high-resolution remote sensing imagery using generative adversarial networks. The generator in DSMSR contains three modules. The first DSM feature extraction module uses the residual-in-residual dense block to extract features from low-resolution DSM. The second multiscale attention feature extraction module employs the pyramid convolutional residual dense blocks to capture the spatial details of ground objects at multiple scales from remote sensing imagery. The third DSM reconstruction module uses a squeeze-and-excitation block to fuse the extracted features from low-resolution DSM and high-resolution remote sensing imagery for generating SR DSM. The discriminator of DSMSR uses the relativistic average discriminator for adversarial learning. The slope loss is further introduced to ensure the accurate representation of topographic features. We evaluate DSMSR on four different terrain regions in the U.K. to downscale the 30-m AW3D30 DSM to 5-m DSM. The experimental results indicate that DSMSR outperforms the traditional interpolation algorithms and four existing deep-learning-based SR models. The DSMSR restores more spatial detail of topographic features and generates more accurate image quality, elevation, and terrain metrics.
引用
收藏
页码:10636 / 10647
页数:12
相关论文
共 50 条
  • [31] Super-Resolution Reconstruction of Remote Sensing Images Using Generative Adversarial Network With Shallow Information Enhancement
    Fu, Yujia
    Zhang, Xiangrong
    Wang, Mingyang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 8529 - 8540
  • [32] Reconstruction of super-resolution from high-resolution remote sensing images based on convolutional neural networks
    Liu, Yang
    Xu, Hu
    Shi, Xiaodong
    PeerJ Computer Science, 2024, 10
  • [33] Reconstruction of super-resolution from high-resolution remote sensing images based on convolutional neural networks
    Liu, Yang
    Xu, Hu
    Shi, Xiaodong
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [34] Shadow Detection in High-Resolution Multispectral Satellite Imagery Using Generative Adversarial Networks
    Morales, Giorgio
    Arteaga, Daniel
    Huaman, Samuel G.
    Telles, Joel
    Palomino, Walther
    PROCEEDINGS OF THE 2018 IEEE 25TH INTERNATIONAL CONFERENCE ON ELECTRONICS, ELECTRICAL ENGINEERING AND COMPUTING (INTERCON 2018), 2018,
  • [35] Large-Factor Super-Resolution of Remote Sensing Images With Spectra-Guided Generative Adversarial Networks
    Meng, Yapeng
    Li, Wenyuan
    Lei, Sen
    Zou, Zhengxia
    Shi, Zhenwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] Improving the spatial resolution of solar images using super-resolution diffusion generative adversarial networks
    Song, Wei
    Ma, Ying
    Sun, Haoying
    Zhao, Xiaobing
    Lin, Ganghua
    ASTRONOMY & ASTROPHYSICS, 2024, 686
  • [37] SUPER-RESOLUTION OF REMOTE SENSING IMAGERY USING IMPLICIT DEGRADATION MODELING
    Oh, Han
    Kim, Dongjin
    Lee, Sun Gu
    Chung, Daewon
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5146 - 5149
  • [38] Super-Resolution and Inpainting with Degraded and Upgraded Generative Adversarial Networks
    Huang, Yawen
    Zheng, Feng
    Wang, Danyang
    Jiang, Junyu
    Wang, Xiaoqian
    Shao, Ling
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 645 - 651
  • [39] RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolution
    Zhang, Wenlong
    Liu, Yihao
    Dong, Chao
    Qiao, Yu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3096 - 3105
  • [40] GENERATIVE ADVERSARIAL NETWORKS AND PERCEPTUAL LOSSES FOR VIDEO SUPER-RESOLUTION
    Lucas, Alice
    Lopez-Tapia, Santiago
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 51 - 55