Damaged Building Object Detection From Bitemporal Remote Sensing Imagery: A Cross-Task Integration Network and Five Datasets

被引:0
|
作者
Zhang, Haiming [1 ]
Zhang, Yongxian [2 ]
Wang, Di [1 ]
Ma, Guorui [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
[2] Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China
关键词
Buildings; Feature extraction; Remote sensing; Object oriented modeling; Deep learning; Semantics; Monitoring; Labeling; Transformers; Object recognition; Building; change detection (CD); damage; object detection (OD); remote sensing; DETECTION FRAMEWORK; SENSED IMAGES; NET;
D O I
10.1109/TGRS.2024.3493886
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Existing change detection (CD) research mostly focuses on pixel-level dense prediction, while object detection (OD) for entire damaged/changed buildings is rare. Object-level detection datasets for damaged/changed buildings are also lacking. This article proposes an object-oriented damaged/changed building CD model, OoCDNet, along with five global-scale OD datasets for damaged/changed buildings. OoCDNet bridges and integrates the dual tasks of CD and OD, driven by the task of locating damaged/changed buildings. By modeling the changes in buildings at the object level between bitemporal images, it achieves rapid identification of target buildings. OoCDNet consists of four parts, the two paths of the dual-path feature extraction module (DouBackbone) are responsible for extracting the base features of the image, the bidirectional pyramid feature aggregation module (AggNeck) models the change information of the features aggregated at the end, the cross-informative self-attentive short-circuit enhancement module enhances the features from the DouBackbone with highly efficient self-attentive information and supplements the enhancement information to the AggNeck, and the enhanced features with semantic and localization information are fed into the detection module for OD. The proposed OoEWEBD is a global-scale OD dataset for damaged buildings, containing 10377 image pairs, each sized $256\times 256$ pixels. The remaining four datasets are created based on the WHU_CD, LEVIR-CD+, S2Looking, and xBD datasets, targeting buildings with general changes or those affected by disasters. Compared with state-of-the-art (SOTA) OD and CD methods, OoCDNet can quickly and effectively detect target buildings, achieving the highest accuracy and having a high application value. The code and datasets will be available at https://github.com/Haiming-Z/OD-based-Change-Detection-mode-OoCDNet.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] SDCINet: A novel cross-task integration network for segmentation and detection of damaged/changed building targets with optical remote sensing imagery
    Zhang, Haiming
    Ma, Guorui
    Fan, Hongyang
    Gong, Hongyu
    Wang, Di
    Zhang, Yongxian
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 218 : 422 - 446
  • [2] Using Adversarial Network for Multiple Change Detection in Bitemporal Remote Sensing Imagery
    Zhao, Wenzhi
    Chen, Xi
    Ge, Xiaoshan
    Chen, Jiage
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [3] Cross-Layer Attention Network for Small Object Detection in Remote Sensing Imagery
    Li, Yangyang
    Huang, Qin
    Pei, Xuan
    Chen, Yanqiao
    Jiao, Licheng
    Shang, Ronghua
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 2148 - 2161
  • [4] Building Change Detection for VHR Remote Sensing Images via Local-Global Pyramid Network and Cross-Task Transfer Learning Strategy
    Liu, Tongfei
    Gong, Maoguo
    Lu, Di
    Zhang, Qingfu
    Zheng, Hanhong
    Jiang, Fenlong
    Zhang, Mingyang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Building-Road Collaborative Extraction From Remote Sensing Images via Cross-Task and Cross-Scale Interaction
    Guo, Haonan
    Su, Xin
    Wu, Chen
    Du, Bo
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [6] Damaged Building Detection From Post-Earthquake Remote Sensing Imagery Considering Heterogeneity Characteristics
    Xie, Yakun
    Feng, Dejun
    Chen, Hongyu
    Liu, Zichen
    Mao, Wenfei
    Zhu, Jun
    Hu, Ya
    Baik, Sung Wook
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] An Efficient Feature Pyramid Network for Object Detection in Remote Sensing Imagery
    Fang Qingyun
    Zhang Lin
    Wang Zhaokui
    IEEE ACCESS, 2020, 8 : 93058 - 93068
  • [8] Information balance network for multiscale object detection in remote sensing imagery
    Bin Wen
    Zhang, Jun
    Shen, Yanjun
    Xu, Bingrong
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (06)
  • [9] KNOWLEDGE DISTILLATION FOR OBJECT DETECTION: FROM GENERIC TO REMOTE SENSING DATASETS
    Hoang-An Le
    Minh-Tan Pham
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6194 - 6197
  • [10] Cross-Modal Adaptation for Object Detection in Infrared Remote Sensing Imagery
    Wang, Zeyu
    Li, Shuaiting
    Huang, Kejie
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22