Digital Surface Model Super-Resolution by Integrating High-Resolution Remote Sensing Imagery Using Generative Adversarial Networks

被引:1
|
作者
Sun, Guihou [1 ]
Chen, Yuehong [1 ]
Huang, Jiamei [1 ]
Ma, Qiang [2 ]
Ge, Yong [3 ]
机构
[1] Hohai Univ, Coll Geog & Remote Sensing, Nanjing 211100, Peoples R China
[2] China Inst Water Resources & Hydropower Res, Res Ctr Flood & Drought Disaster Reduct, Beijing 100038, Peoples R China
[3] Chinese Acad Sci, State Key Lab Resources & Environm Informat Syst, Inst Geog Sci & Nat Resources Res, Beijing 100101, Peoples R China
关键词
Feature extraction; Remote sensing; Generators; Spatial resolution; Surface topography; Digital surface model (DSM); generative adversarial networks (GANs); remote sensing imagery; slope loss; super-resolution (SR); DEM; DSM;
D O I
10.1109/JSTARS.2024.3399544
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Digital surface model (DSM) is the fundamental data in various geoscience applications, such as city 3-D modeling and urban environment analysis. The freely available DSM often suffers from limited spatial resolution. Super-resolution (SR) is a promising technique to increase the spatial resolution of DSM. However, most existing SR models struggle to reconstruct spatial details, such as buildings, valleys, and ridges. This article proposes a novel DSM super-resolution (DSMSR) model that integrates high-resolution remote sensing imagery using generative adversarial networks. The generator in DSMSR contains three modules. The first DSM feature extraction module uses the residual-in-residual dense block to extract features from low-resolution DSM. The second multiscale attention feature extraction module employs the pyramid convolutional residual dense blocks to capture the spatial details of ground objects at multiple scales from remote sensing imagery. The third DSM reconstruction module uses a squeeze-and-excitation block to fuse the extracted features from low-resolution DSM and high-resolution remote sensing imagery for generating SR DSM. The discriminator of DSMSR uses the relativistic average discriminator for adversarial learning. The slope loss is further introduced to ensure the accurate representation of topographic features. We evaluate DSMSR on four different terrain regions in the U.K. to downscale the 30-m AW3D30 DSM to 5-m DSM. The experimental results indicate that DSMSR outperforms the traditional interpolation algorithms and four existing deep-learning-based SR models. The DSMSR restores more spatial detail of topographic features and generates more accurate image quality, elevation, and terrain metrics.
引用
收藏
页码:10636 / 10647
页数:12
相关论文
共 50 条
  • [41] Generative adversarial networks for hyperspectral image spatial super-resolution
    Jiang Yilin
    Shao Ran
    Tang Sanqiang
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2020, 27 (04) : 8 - 16
  • [42] ID Preserving Face Super-Resolution Generative Adversarial Networks
    Li, Jinning
    Zhou, Yichen
    Ding, Jie
    Chen, Cen
    Yang, Xulei
    IEEE ACCESS, 2020, 8 : 138373 - 138381
  • [43] DPSRGAN: Dilation Patch Super-Resolution Generative Adversarial Networks
    Mirchandani, Kapil
    Chordiya, Kushal
    2021 6TH INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2021,
  • [44] Generative Adversarial Networks and Perceptual Losses for Video Super-Resolution
    Lucas, Alice
    Lopez-Tapia, Santiago
    Molina, Rafael
    Katsaggelos, Aggelos K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (07) : 3312 - 3327
  • [45] Hierarchical Generative Adversarial Networks for Single Image Super-Resolution
    Chen, Weimin
    Ma, Yuqing
    Liu, Xianglong
    Yuan, Yi
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 355 - 364
  • [46] Using super-resolution generative adversarial network models and transfer learning to obtain high resolution digital periapical radiographs
    Moran, Maira B. H.
    Faria, Marcelo D. B.
    Giraldi, Gilson A.
    Bastos, Luciana F.
    Conci, Aura
    COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 129
  • [47] IMAGE SUPER-RESOLUTION USING COMPLEX DENSE BLOCK ON GENERATIVE ADVERSARIAL NETWORKS
    Chen, Bo-Xun
    Liu, Tsung-Jung
    Liu, Kuan-Hsien
    Liu, Hsin-Hua
    Pei, Soo-Chang
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2866 - 2870
  • [48] Image Super-Resolution using Generative Adversarial Networks with EfficientNetV2
    AlTakrouri, Saleh
    Noor, Norliza Mohd
    Ahmad, Norulhusna
    Justinia, Taghreed
    Usman, Sahnius
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (02) : 879 - 887
  • [49] SOUP-GAN: Super-Resolution MRI Using Generative Adversarial Networks
    Zhang, Kuan
    Hu, Haoji
    Philbrick, Kenneth
    Conte, Gian Marco
    Sobek, Joseph D.
    Rouzrokh, Pouria
    Erickson, Bradley J.
    TOMOGRAPHY, 2022, 8 (02) : 905 - 919
  • [50] TE-SAGAN: An Improved Generative Adversarial Network for Remote Sensing Super-Resolution Images
    Xu, Yongyang
    Luo, Wei
    Hu, Anna
    Xie, Zhong
    Xie, Xuejing
    Tao, Liufeng
    REMOTE SENSING, 2022, 14 (10)