Enhancing Mid-Low-Resolution Ship Detection With High-Resolution Feature Distillation

被引:12
|
作者
He, Shitian [1 ]
Zou, Huanxin [1 ]
Wang, Yingqian [1 ]
Li, Runlin [1 ]
Cheng, Fei [1 ]
Cao, Xu [1 ]
Li, Meilin [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Marine vehicles; Image resolution; Training; Detectors; Sorting; Remote sensing; Knowledge distillation (KD); mid-low-resolution images; remote sensing; ship detection; super-resolution (SR);
D O I
10.1109/LGRS.2021.3110404
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
To enhance mid-low-resolution ship detection, existing methods generally use image super-resolution (SR) as a preprocessing step and feed the super-resolved images to the detectors. However, these methods only use high-resolution (HR) images as ground-truth labels to supervise the training of their SR module but overlook the rich HR information in the detection stage. Inspired by the recent advances in knowledge distillation, in this letter, we design a feature distillation framework to fully exploit the information in ground-truth HR images to handle mid-low-resolution ship detection. Our framework consists of a student network and a teacher network. The student network first super-resolves input images using an SR module and then feeds the super-resolved images to the detection module. The teacher network whose architecture is the same as the student detection module directly takes HR images as input to generate HR feature representation and then distills these HR features to the student network through a distillation loss. Using our feature distillation framework, HR images are not only used as ground-truth labels to train the SR module but also provide "ground-truth" features to train the detection module, which enhances the detection performance of the student network. We apply our framework to several popular detectors, including FCOS, Faster-RCNN, Mask-RCNN, and Cascase-RCNN, and conduct extensive ablation studies to validate its effectiveness and generality. Experimental results on the HRSC2016, DOTA, and NWPU VHR-10 datasets demonstrate that, when applying our framework to Faster-RCNN, our method can outperform several state-of-the-art detection methods in terms of mAP50 and mAP75.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] Building detection and reconstruction from mid- and high-resolution aerial imagery
    Paparoditis, N
    Cord, M
    Jordan, M
    Cocquerez, JP
    COMPUTER VISION AND IMAGE UNDERSTANDING, 1998, 72 (02) : 122 - 142
  • [32] 2D comb feature for analysis of ship classification in high-resolution SAR imagery
    Leng, Xiangguang
    Ji, Kefeng
    Zhou, Shilin
    Xing, Xiangwei
    Zou, Huanxin
    ELECTRONICS LETTERS, 2017, 53 (07) : 500 - 502
  • [33] HIGH-RESOLUTION FACIAL FEATURE SALIENCY MAPPING
    HAIG, ND
    PERCEPTION, 1986, 15 (04) : 373 - 386
  • [34] An Unsupervised Ship Classifier for High-Resolution SAR Images
    Chen, Longtao
    Yao, Ping
    Wang, Hao
    Wang, Zhensong
    PROCEEDINGS OF THE 2013 ASIA-PACIFIC COMPUTATIONAL INTELLIGENCE AND INFORMATION TECHNOLOGY CONFERENCE, 2013, : 524 - 530
  • [35] Conventional high-resolution CT versus helical high-resolution MDCT in the detection of bronchiectasis
    Dodd, Jonathan D.
    Souza, Carolina A.
    Mueller, Nestor L.
    AMERICAN JOURNAL OF ROENTGENOLOGY, 2006, 187 (02) : 414 - 420
  • [36] Arbitrary-Oriented Ship Detection via Feature Fusion and Visual Attention for High-Resolution Optical Remote Sensing Imagery
    Gong, Wenbin
    Shi, Zhangsong
    Wu, Zhonghong
    Luo, Junren
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (07) : 2622 - 2640
  • [37] High-Resolution Feature Pyramid Network for Small Object Detection on Drone View
    Chen, Zhaodong
    Ji, Hongbing
    Zhang, Yongquan
    Zhu, Zhigang
    Li, Yifan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 475 - 489
  • [38] Road Detection in High-resolution SAR Images with Improved Multiple Feature Fusion
    Chen, Jing
    Ding, Zegang
    Wei, Yangkai
    Gao, Qiang
    Li, Yong
    2019 INTERNATIONAL RADAR CONFERENCE (RADAR2019), 2019, : 753 - 758
  • [39] Image feature point detection method based on the pixels of high-resolution sensors
    Liu, Xingchun
    Wang, Zhe
    Hu, Zhipeng
    Zhang, Jiancheng
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY III, 2014, 9273
  • [40] A high-resolution feature difference attention network for the application of building change detection
    Wang, Xue
    Du, Junhan
    Tan, Kun
    Ding, Jianwei
    Liu, Zhaoxian
    Pan, Chen
    Han, Bo
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 112