FANet: Features Adaptation Network for 360° Omnidirectional Salient Object Detection

被引:13
|
作者
Huang, Mengke [1 ,2 ]
Liu, Zhi [1 ,2 ]
Li, Gongyang [1 ,2 ]
Zhou, Xiaofei [3 ]
Le Meur, Olivier [4 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[4] Univ Rennes 1, IRISA, F-35042 Rennes, France
基金
中国国家自然科学基金;
关键词
360 degrees omnidirectional image; salient object detection; equirectangular and cube-map projection; projection features adaptation; multi-level features adaptation; SEGMENTATION;
D O I
10.1109/LSP.2020.3028192
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Salient object detection (SOD) in 360 degrees omnidirectional images has become an eye-catching problem because of the popularity of affordable 360 degrees cameras. In this paper, we propose a Features Adaptation Network (FANet) to highlight salient objects in 360 degrees omnidirectional images reliably. To utilize the feature extraction capability of convolutional neural networks and capture global object information, we input the equirectangular 360 degrees images and corresponding cube-map 360 degrees images to the feature extraction network (FENet) simultaneously to obtain multi-level equirectangular and cube-map features. Furthermore, we fuse these two kinds of features at each level of the FENet by a projection features adaptation (PFA) module, for selecting these two kinds of features adaptively. Finally, we combine the preliminary adaptation features at different levels by a multi-level features adaptation (MLFA) module, which weights these different-level features adaptively and produces the final saliencymaps. Experiments show our FANet outperforms the state-of-the-art methods on the 360 degrees omnidirectional SOD datasets.
引用
收藏
页码:1819 / 1823
页数:5
相关论文
共 50 条
  • [21] Deep Embedding Features for Salient Object Detection
    Zhuge, Yunzhi
    Zeng, Yu
    Lu, Huchuan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9340 - 9347
  • [22] Gated Contextual Features for Salient Object Detection
    Gupta, Ashish Kumar
    Seal, Ayan
    Khanna, Pritee
    Yazidi, Anis
    Krejcar, Ondrej
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [23] Salient Object Detection: Integrate Salient Features in the Deep Learning Framework
    Chen, Qixin
    Liu, Tie
    Shang, Yuanyuan
    Shao, Zhuhong
    Ding, Hui
    IEEE ACCESS, 2019, 7 : 152483 - 152492
  • [24] A FIXATION-BASED 360° BENCHMARK DATASET FOR SALIENT OBJECT DETECTION
    Zhang, Yi
    Zhang, Lu
    Hamidouche, Wassim
    Deforges, Olivier
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 3458 - 3462
  • [25] Dual pyramid network for salient object detection
    Xu, Xuemiao
    Chen, Jiaxing
    Zhang, Huaidong
    Han, Guoqiang
    NEUROCOMPUTING, 2020, 375 : 113 - 123
  • [26] Decomposition and Completion Network for Salient Object Detection
    Wu, Zhe
    Su, Li
    Huang, Qingming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 6226 - 6239
  • [27] Edge Enhancing Network for Salient Object Detection
    Zhao W.
    Wang H.
    Liu X.
    Tongji Daxue Xuebao/Journal of Tongji University, 2024, 52 (02): : 293 - 302
  • [28] Feature Recalibration Network for Salient Object Detection
    Tan, Zhenshan
    Gu, Xiaodong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT IV, 2022, 13532 : 64 - 75
  • [29] Lightweight adversarial network for salient object detection
    Huang, Lili
    Li, Guanbin
    Li, Ya
    Lin, Liang
    NEUROCOMPUTING, 2020, 381 (381) : 130 - 140
  • [30] Feature Refine Network for Salient Object Detection
    Yang, Jiejun
    Wang, Liejun
    Li, Yongming
    SENSORS, 2022, 22 (12)