FFN: Fountain Fusion Net for Arbitrary-Oriented Object Detection

被引:7
|
作者
Zhang, Tianwei [1 ,2 ,3 ]
Sun, Xu [1 ]
Zhuang, Lina [1 ]
Dong, Xiaoyu [4 ,5 ]
Gao, Lianru [1 ]
Zhang, Bing [3 ,6 ]
Zheng, Ke [7 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Int Res Ctr Big Data Sustainable Dev Goals, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
[4] Univ Tokyo, Dept Complex Sci & Engn, Chuo, Tokyo 1030027, Japan
[5] RIKEN AIP, Chuo, Tokyo 1030027, Japan
[6] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[7] Liaocheng Univ, Coll Geog & Environm, Liaocheng 252059, Peoples R China
关键词
Feature extraction; Detectors; Object detection; Task analysis; Training; Sun; Remote sensing; Deep learning; feature fusion; object detection; remote sensing;
D O I
10.1109/TGRS.2023.3276995
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Arbitrary-oriented object detection (AOOD) is widely used in aerial images because of its efficient object representation. However, current detectors use the over-standardized feature extraction structure, resulting in detectors having no ability to adaptively readjust feature representations of detection units. Meanwhile, we observe that many detection units could not focus on the objects of interest in their receptive field and are easily affected by the background information and interference targets, leading to the weakening of feature expression ability. We call them suboptimal detection units. To address this issue, we propose a novel feature enhancement module called the fountain feature enhancement module (FFEM). FFEM ingeniously uses the fountain-like structure to reconstruct the features of suboptimal detection units, generating fountain features that can automatically condense spatial regional features, which effectively enhance the detectors' overall representation ability. Then, a high-performance AOOD detector called the fountain fusion net (FFN) is proposed with FFEM embedded, and many novel AOOD components are tested for their progressiveness. We validated our FFN and FFEM using three remote sensing datasets DOTA, HRSC2016, and UCAS-AOD as well as one scene text dataset ICDAR 2015. Extensive experiments demonstrate the effectiveness of our proposed method on improving current detectors to achieve state-of-the-art performance based on this novel idea.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Arbitrary-oriented object detection via dense feature fusion and attention model for remote sensing super-resolution image
    Fuhao Zou
    Wei Xiao
    Wanting Ji
    Kunkun He
    Zhixiang Yang
    Jingkuan Song
    Helen Zhou
    Kai Li
    Neural Computing and Applications, 2020, 32 : 14549 - 14562
  • [32] Vector Decomposition-Based Arbitrary-Oriented Object Detection for Optical Remote Sensing Images
    Zhou, Kexue
    Zhang, Min
    Dong, Youqiang
    Tan, Jinlin
    Zhao, Shaobo
    Wang, Hai
    REMOTE SENSING, 2023, 15 (19)
  • [33] Arbitrary-Oriented Ship Detection based on Deep Learning
    Chen, Xingyu
    Tang, Chaoying
    2022 INTERNATIONAL CONFERENCE ON FRONTIERS OF ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING, FAIML, 2022, : 200 - 203
  • [34] Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images
    Sun, Peng
    Zheng, Yongbin
    Wu, Wenqi
    Xu, Wanying
    Bai, Shengjian
    Lu, Xiaoping
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 12
  • [35] Adaptive multi-level feature fusion and attention-based network for arbitrary-oriented object detection in remote sensing imagery
    Chen, Luchang
    Liu, Chunsheng
    Chang, Faliang
    Li, Shuang
    Nie, Zhaoying
    NEUROCOMPUTING, 2021, 451 : 67 - 80
  • [36] SARFA-Net: Shape-Aware Label Assignment and Refined Feature Alignment for Arbitrary-Oriented Object Detection in Remote Sensing Images
    Dong, Yan
    Wei, Minghong
    Gao, Guangshuai
    Li, Chunlei
    Liu, Zhoufeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 8865 - 8881
  • [37] On the Arbitrary-Oriented Object Detection: Classification Based Approaches Revisited (vol 130, pg 1340, 2022)
    Yang, Xue
    Yan, Junchi
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (07) : 1873 - 1874
  • [38] A Novel Arbitrary-Oriented Multilingual Text Detection in Images/Video
    Basavaraju, H. T.
    Aradhya, V. N. Manjunath
    Guru, D. S.
    INFORMATION AND DECISION SCIENCES, 2018, 701 : 519 - 529
  • [39] Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection
    Li, Yangfan
    Bian, Chunjiang
    Chen, Hongzhen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 1160 - 1170
  • [40] Arbitrary-Oriented Scene Text Detection via Rotation Proposals
    Ma, Jianqi
    Shao, Weiyuan
    Ye, Hao
    Wang, Li
    Wang, Hong
    Zheng, Yingbin
    Xue, Xiangyang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (11) : 3111 - 3122