FFN: Fountain Fusion Net for Arbitrary-Oriented Object Detection

被引:7
|
作者
Zhang, Tianwei [1 ,2 ,3 ]
Sun, Xu [1 ]
Zhuang, Lina [1 ]
Dong, Xiaoyu [4 ,5 ]
Gao, Lianru [1 ]
Zhang, Bing [3 ,6 ]
Zheng, Ke [7 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Int Res Ctr Big Data Sustainable Dev Goals, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
[4] Univ Tokyo, Dept Complex Sci & Engn, Chuo, Tokyo 1030027, Japan
[5] RIKEN AIP, Chuo, Tokyo 1030027, Japan
[6] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[7] Liaocheng Univ, Coll Geog & Environm, Liaocheng 252059, Peoples R China
关键词
Feature extraction; Detectors; Object detection; Task analysis; Training; Sun; Remote sensing; Deep learning; feature fusion; object detection; remote sensing;
D O I
10.1109/TGRS.2023.3276995
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Arbitrary-oriented object detection (AOOD) is widely used in aerial images because of its efficient object representation. However, current detectors use the over-standardized feature extraction structure, resulting in detectors having no ability to adaptively readjust feature representations of detection units. Meanwhile, we observe that many detection units could not focus on the objects of interest in their receptive field and are easily affected by the background information and interference targets, leading to the weakening of feature expression ability. We call them suboptimal detection units. To address this issue, we propose a novel feature enhancement module called the fountain feature enhancement module (FFEM). FFEM ingeniously uses the fountain-like structure to reconstruct the features of suboptimal detection units, generating fountain features that can automatically condense spatial regional features, which effectively enhance the detectors' overall representation ability. Then, a high-performance AOOD detector called the fountain fusion net (FFN) is proposed with FFEM embedded, and many novel AOOD components are tested for their progressiveness. We validated our FFN and FFEM using three remote sensing datasets DOTA, HRSC2016, and UCAS-AOD as well as one scene text dataset ICDAR 2015. Extensive experiments demonstrate the effectiveness of our proposed method on improving current detectors to achieve state-of-the-art performance based on this novel idea.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] A Novel Method for Fast Arbitrary-oriented Scene Text Detection
    Ruan, Shaohui
    Lu, Junguo
    Xie, Fengming
    Jin, Zhongxiao
    PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 1652 - 1657
  • [42] Arbitrary-oriented target detection in large scene sar images
    Zi-shuo Han
    Chun-ping Wang
    Qiang Fu
    Defence Technology, 2020, 16 (04) : 933 - 946
  • [43] Arbitrary-Oriented Object Detection in Aerial Images with Dynamic Deformable Convolution and Self-Normalizing Channel Attention
    Zhang, Yutong
    Ma, Chunjie
    Zhuo, Li
    Li, Jiafeng
    ELECTRONICS, 2023, 12 (09)
  • [44] AMR-Net: Arbitrary-Oriented Ship Detection Using Attention Module, Multi-Scale Feature Fusion and Rotation Pseudo-Label
    Wu, Yifan
    Zhao, Wei
    Zhang, Rufei
    Jiang, Feng
    IEEE ACCESS, 2021, 9 : 68208 - 68222
  • [45] Posterior Instance Injection Detector for Arbitrary-Oriented Object Detection From Optical Remote-Sensing Imagery
    Zhang, Tong
    Zhuang, Yin
    Chen, He
    Wang, Guanqun
    Ge, Lihui
    Chen, Liang
    Dong, Hao
    Li, Lianlin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 18
  • [46] FPNFormer: Rethink the Method of Processing the Rotation-Invariance and Rotation-Equivariance on Arbitrary-Oriented Object Detection
    Tian, Yang
    Zhang, Mengmeng
    Li, Jinyu
    Li, Yangfan
    Yang, Hong
    Li, Wei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 10
  • [47] Arbitrary-Oriented Ship Detection Based on Feature Filter and KL Loss
    Li, Chen
    Wang, Lei
    Kang, Bin
    Chen, Mingkai
    Cui, Jingwu
    Zheng, Baoyu
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 620 - 624
  • [48] CASCADE DETECTOR WITH FEATURE FUSION FOR ARBITRARY-ORIENTED OBJECTS IN REMOTE SENSING IMAGES
    Hou, Liping
    Lu, Ke
    Xue, Jian
    Hao, Li
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [49] Surround-Net: A Multi-Branch Arbitrary-Oriented Detector for Remote Sensing
    Luo, Junkun
    Hu, Yimin
    Li, Jiadong
    REMOTE SENSING, 2022, 14 (07)
  • [50] Arbitrary-Oriented Ship Detection Based on RetinaNet for Remote Sensing Images
    Zhu, Mingming
    Hu, Guoping
    Zhou, Hao
    Wang, Shiqiang
    Zhang, Yule
    Yue, Shijie
    Bai, Yu
    Zang, Kexin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 6694 - 6706