Damaged Building Object Detection From Bitemporal Remote Sensing Imagery: A Cross-Task Integration Network and Five Datasets

被引:0
|
作者
Zhang, Haiming [1 ]
Zhang, Yongxian [2 ]
Wang, Di [1 ]
Ma, Guorui [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
[2] Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China
关键词
Buildings; Feature extraction; Remote sensing; Object oriented modeling; Deep learning; Semantics; Monitoring; Labeling; Transformers; Object recognition; Building; change detection (CD); damage; object detection (OD); remote sensing; DETECTION FRAMEWORK; SENSED IMAGES; NET;
D O I
10.1109/TGRS.2024.3493886
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Existing change detection (CD) research mostly focuses on pixel-level dense prediction, while object detection (OD) for entire damaged/changed buildings is rare. Object-level detection datasets for damaged/changed buildings are also lacking. This article proposes an object-oriented damaged/changed building CD model, OoCDNet, along with five global-scale OD datasets for damaged/changed buildings. OoCDNet bridges and integrates the dual tasks of CD and OD, driven by the task of locating damaged/changed buildings. By modeling the changes in buildings at the object level between bitemporal images, it achieves rapid identification of target buildings. OoCDNet consists of four parts, the two paths of the dual-path feature extraction module (DouBackbone) are responsible for extracting the base features of the image, the bidirectional pyramid feature aggregation module (AggNeck) models the change information of the features aggregated at the end, the cross-informative self-attentive short-circuit enhancement module enhances the features from the DouBackbone with highly efficient self-attentive information and supplements the enhancement information to the AggNeck, and the enhanced features with semantic and localization information are fed into the detection module for OD. The proposed OoEWEBD is a global-scale OD dataset for damaged buildings, containing 10377 image pairs, each sized $256\times 256$ pixels. The remaining four datasets are created based on the WHU_CD, LEVIR-CD+, S2Looking, and xBD datasets, targeting buildings with general changes or those affected by disasters. Compared with state-of-the-art (SOTA) OD and CD methods, OoCDNet can quickly and effectively detect target buildings, achieving the highest accuracy and having a high application value. The code and datasets will be available at https://github.com/Haiming-Z/OD-based-Change-Detection-mode-OoCDNet.
引用
收藏
页数:27
相关论文
共 50 条
  • [21] Feature Pyramid Full Granularity Attention Network for Object Detection in Remote Sensing Imagery
    Liu, Chang
    Qi, Xiao
    Yin, Hang
    Song, Bowei
    Li, Ke
    Shen, Fei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT X, ICIC 2024, 2024, 14871 : 332 - 353
  • [22] Object Detection in Remote Sensing Imagery Based on Prototype Learning Network With Proposal Relation
    Ni, Kang
    Ma, Tengfei
    Zheng, Zhizhong
    Wang, Peng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [23] Building Detection from VHR Remote Sensing Imagery Based on the Morphological Building Index
    You, Yongfa
    Wang, Siyuan
    Ma, Yuanxu
    Chen, Guangsheng
    Wang, Bin
    Shen, Ming
    Liu, Weihua
    REMOTE SENSING, 2018, 10 (08):
  • [24] Object-oriented detection of building shadow in TripleSat-2 remote sensing imagery
    Liu, Yuxuan
    Wei, Yuchun
    Tao, Shikang
    Dai, Qiuping
    Wang, Wenyao
    Wu, Mengqi
    JOURNAL OF APPLIED REMOTE SENSING, 2020, 14 (03)
  • [25] Siam-DWENet: Flood inundation detection for SAR imagery using a cross-task transfer siamese network
    Zhao, Bofei
    Sui, Haigang
    Liu, Junyi
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 116
  • [26] Deep Learning Models for Hazard-Damaged Building Detection Using Remote Sensing Datasets: A Comprehensive Review
    Wang, Lili
    Wu, Jidong
    Yang, Youtian
    Tang, Rumei
    Ya, Ru
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 15301 - 15318
  • [27] Orientation guided anchoring for geospatial object detection from remote sensing imagery
    Yu, Yongtao
    Guan, Haiyan
    Li, Dilong
    Gu, Tiannan
    Tang, E.
    Li, Aixia
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 160 : 67 - 82
  • [28] Task-Decoupled Learning Strategies for Optimized Multiclass Object Detection From VHR Optical Remote Sensing Imagery
    Zhou, Guangyao
    Wang, Guanqun
    Huang, Yu
    Wang, Wenzhi
    Qu, Zhi
    Yin, Chenghan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 8457 - 8471
  • [29] Cross-modality attentive feature fusion for object detection in multispectral remote sensing imagery
    Qingyun, Fang
    Zhaokui, Wang
    Pattern Recognition, 2022, 130
  • [30] Cross-modality attentive feature fusion for object detection in multispectral remote sensing imagery
    Fang Qingyun
    Wang Zhaokui
    PATTERN RECOGNITION, 2022, 130