Damaged Building Object Detection From Bitemporal Remote Sensing Imagery: A Cross-Task Integration Network and Five Datasets

被引:0
|
作者
Zhang, Haiming [1 ]
Zhang, Yongxian [2 ]
Wang, Di [1 ]
Ma, Guorui [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
[2] Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China
关键词
Buildings; Feature extraction; Remote sensing; Object oriented modeling; Deep learning; Semantics; Monitoring; Labeling; Transformers; Object recognition; Building; change detection (CD); damage; object detection (OD); remote sensing; DETECTION FRAMEWORK; SENSED IMAGES; NET;
D O I
10.1109/TGRS.2024.3493886
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Existing change detection (CD) research mostly focuses on pixel-level dense prediction, while object detection (OD) for entire damaged/changed buildings is rare. Object-level detection datasets for damaged/changed buildings are also lacking. This article proposes an object-oriented damaged/changed building CD model, OoCDNet, along with five global-scale OD datasets for damaged/changed buildings. OoCDNet bridges and integrates the dual tasks of CD and OD, driven by the task of locating damaged/changed buildings. By modeling the changes in buildings at the object level between bitemporal images, it achieves rapid identification of target buildings. OoCDNet consists of four parts, the two paths of the dual-path feature extraction module (DouBackbone) are responsible for extracting the base features of the image, the bidirectional pyramid feature aggregation module (AggNeck) models the change information of the features aggregated at the end, the cross-informative self-attentive short-circuit enhancement module enhances the features from the DouBackbone with highly efficient self-attentive information and supplements the enhancement information to the AggNeck, and the enhanced features with semantic and localization information are fed into the detection module for OD. The proposed OoEWEBD is a global-scale OD dataset for damaged buildings, containing 10377 image pairs, each sized $256\times 256$ pixels. The remaining four datasets are created based on the WHU_CD, LEVIR-CD+, S2Looking, and xBD datasets, targeting buildings with general changes or those affected by disasters. Compared with state-of-the-art (SOTA) OD and CD methods, OoCDNet can quickly and effectively detect target buildings, achieving the highest accuracy and having a high application value. The code and datasets will be available at https://github.com/Haiming-Z/OD-based-Change-Detection-mode-OoCDNet.
引用
收藏
页数:27
相关论文
共 50 条
  • [41] Sparse anchoring guided high-resolution capsule network for geospatial object detection from remote sensing imagery
    Yu, Yongtao
    Wang, Jun
    Qiang, Hao
    Jiang, Mingxin
    Tang, E.
    Yu, Changhui
    Zhang, Yongjun
    Li, Jonathan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 104
  • [42] A Multitask CNN-Transformer Network for Semantic Change Detection From Bitemporal Remote Sensing Images
    Liu, Wei
    Kang, Ziwen
    Liu, Jiawei
    Lin, Yiyuan
    Yu, Yongtao
    Li, Jonathan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [43] Building Extraction From Remote Sensing Imagery With a High-Resolution Capsule Network
    Yu, Yongtao
    Liu, Chao
    Gao, Junyong
    Jin, Shenghua
    Jiang, Xiaoling
    Jiang, Mingxin
    Zhang, Haiyan
    Zhang, Yahong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [44] A Task-Balanced Multiscale Adaptive Fusion Network for Object Detection in Remote Sensing Images
    Gao, Tao
    Liu, Zixiang
    Zhang, Jing
    Wu, Guiping
    Chen, Ting
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [45] A Cross Stage Partial Network with Strengthen Matching Detector for Remote Sensing Object Detection
    Ren, Shougang
    Fang, Zhiruo
    Gu, Xingjian
    REMOTE SENSING, 2023, 15 (06)
  • [46] Cloud Detection From Remote Sensing Imagery Based on Domain Translation Network
    Guo, Jianhua
    Yang, Jingyu
    Yue, Huanjing
    Chen, Yang
    Hou, Chunping
    Li, Kun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [47] Cloud Detection from Remote Sensing Imagery Based on Domain Translation Network
    Guo, Jianhua
    Yang, Jingyu
    Yue, Huanjing
    Chen, Yang
    Hou, Chunping
    Li, Kun
    IEEE Geoscience and Remote Sensing Letters, 2022, 19
  • [48] MTSCD-Net: A network based on multi-task learning for semantic change detection of bitemporal remote sensing images
    Cui, Fengzhi
    Jiang, Jie
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 118
  • [49] Asymmetric Cross-Attention Hierarchical Network Based on CNN and Transformer for Bitemporal Remote Sensing Images Change Detection
    Zhang, Xiaofeng
    Cheng, Shuli
    Wang, Liejun
    Li, Haojin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [50] Dense Connected Edge Feature Enhancement Network for Building Edge Detection from High Resolution Remote Sensing Imagery
    Dong, Xueyan
    Cao, Jiannong
    Zhao, Weiheng
    CANADIAN JOURNAL OF REMOTE SENSING, 2024, 50 (01)