Damaged Building Object Detection From Bitemporal Remote Sensing Imagery: A Cross-Task Integration Network and Five Datasets

被引:0
|
作者
Zhang, Haiming [1 ]
Zhang, Yongxian [2 ]
Wang, Di [1 ]
Ma, Guorui [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
[2] Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China
关键词
Buildings; Feature extraction; Remote sensing; Object oriented modeling; Deep learning; Semantics; Monitoring; Labeling; Transformers; Object recognition; Building; change detection (CD); damage; object detection (OD); remote sensing; DETECTION FRAMEWORK; SENSED IMAGES; NET;
D O I
10.1109/TGRS.2024.3493886
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Existing change detection (CD) research mostly focuses on pixel-level dense prediction, while object detection (OD) for entire damaged/changed buildings is rare. Object-level detection datasets for damaged/changed buildings are also lacking. This article proposes an object-oriented damaged/changed building CD model, OoCDNet, along with five global-scale OD datasets for damaged/changed buildings. OoCDNet bridges and integrates the dual tasks of CD and OD, driven by the task of locating damaged/changed buildings. By modeling the changes in buildings at the object level between bitemporal images, it achieves rapid identification of target buildings. OoCDNet consists of four parts, the two paths of the dual-path feature extraction module (DouBackbone) are responsible for extracting the base features of the image, the bidirectional pyramid feature aggregation module (AggNeck) models the change information of the features aggregated at the end, the cross-informative self-attentive short-circuit enhancement module enhances the features from the DouBackbone with highly efficient self-attentive information and supplements the enhancement information to the AggNeck, and the enhanced features with semantic and localization information are fed into the detection module for OD. The proposed OoEWEBD is a global-scale OD dataset for damaged buildings, containing 10377 image pairs, each sized $256\times 256$ pixels. The remaining four datasets are created based on the WHU_CD, LEVIR-CD+, S2Looking, and xBD datasets, targeting buildings with general changes or those affected by disasters. Compared with state-of-the-art (SOTA) OD and CD methods, OoCDNet can quickly and effectively detect target buildings, achieving the highest accuracy and having a high application value. The code and datasets will be available at https://github.com/Haiming-Z/OD-based-Change-Detection-mode-OoCDNet.
引用
收藏
页数:27
相关论文
共 50 条
  • [31] Building detection in high spatial resolution remote sensing imagery with the U-Rotation Detection Network
    Yang, Jirui
    Ji, Luyan
    Geng, Xiurui
    Yang, Xue
    Zhao, Yongchao
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2019, 40 (15) : 6036 - 6058
  • [32] Single Shot Anchor Refinement Network for Oriented Object Detection in Optical Remote Sensing Imagery
    Bao, Songze
    Zhong, Xing
    Zhu, Ruifei
    Zhang, Xiaonan
    Li, Zhuqiang
    Li, Mengyang
    IEEE ACCESS, 2019, 7 : 87150 - 87161
  • [33] SOON: Specially Optimized One-Stage Network for Object Detection in Remote Sensing Imagery
    Wang, Zhuo
    Qin, Haonan
    Li, Yunsong
    Lei, Jie
    Xie, Weiying
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 531 - 538
  • [34] Context-Aware Convolutional Neural Network for Object Detection in VHR Remote Sensing Imagery
    Gong, Yiping
    Xiao, Zhifeng
    Tan, Xiaowei
    Sui, Haigang
    Xu, Chuan
    Duan, Haiwang
    Li, Deren
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (01): : 34 - 44
  • [35] Rotation Equivariant Feature Image Pyramid Network for Object Detection in Optical Remote Sensing Imagery
    Shamsolmoali, Pourya
    Zareapoor, Masoumeh
    Chanussot, Jocelyn
    Zhou, Huiyu
    Yang, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] A Path Aggregation Network Based on Residual Feature Enhancement for Object Detection in Remote Sensing Imagery
    Dang, Lanxue
    Huangfu, Panpan
    Hou, Yan-e
    Liu, Yang
    Han, Hongyu
    REMOTE SENSING LETTERS, 2023, 14 (06) : 598 - 608
  • [37] A Novel Effectively Optimized One-Stage Network for Object Detection in Remote Sensing Imagery
    Xie, Weiying
    Qin, Haonan
    Li, Yunsong
    Wang, Zhuo
    Lei, Jie
    REMOTE SENSING, 2019, 11 (11)
  • [38] Context Feature Integration and Balanced Sampling Strategy for Small Weak Object Detection in Remote Sensing Imagery
    Li, Zheng
    Wang, Yongcheng
    Zhang, Yuxi
    Gao, Yunxiao
    Zhao, Zhikang
    Feng, Hao
    Zhao, Tianqi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [39] Task Alignment Interaction and Cross-Scale Guided Enhancement for Remote Sensing Object Detection
    Wu, Guiping
    Liu, Lidong
    Liu, Zixiang
    Liu, Yao
    Gao, Tao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [40] Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery
    Yuan, Qinglie
    Xia, Bin
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (09) : 2893 - 2914