FANet: Features Adaptation Network for 360° Omnidirectional Salient Object Detection

被引:13
|
作者
Huang, Mengke [1 ,2 ]
Liu, Zhi [1 ,2 ]
Li, Gongyang [1 ,2 ]
Zhou, Xiaofei [3 ]
Le Meur, Olivier [4 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[4] Univ Rennes 1, IRISA, F-35042 Rennes, France
基金
中国国家自然科学基金;
关键词
360 degrees omnidirectional image; salient object detection; equirectangular and cube-map projection; projection features adaptation; multi-level features adaptation; SEGMENTATION;
D O I
10.1109/LSP.2020.3028192
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Salient object detection (SOD) in 360 degrees omnidirectional images has become an eye-catching problem because of the popularity of affordable 360 degrees cameras. In this paper, we propose a Features Adaptation Network (FANet) to highlight salient objects in 360 degrees omnidirectional images reliably. To utilize the feature extraction capability of convolutional neural networks and capture global object information, we input the equirectangular 360 degrees images and corresponding cube-map 360 degrees images to the feature extraction network (FENet) simultaneously to obtain multi-level equirectangular and cube-map features. Furthermore, we fuse these two kinds of features at each level of the FENet by a projection features adaptation (PFA) module, for selecting these two kinds of features adaptively. Finally, we combine the preliminary adaptation features at different levels by a multi-level features adaptation (MLFA) module, which weights these different-level features adaptively and produces the final saliencymaps. Experiments show our FANet outperforms the state-of-the-art methods on the 360 degrees omnidirectional SOD datasets.
引用
收藏
页码:1819 / 1823
页数:5
相关论文
共 50 条
  • [31] A Multistage Refinement Network for Salient Object Detection
    Zhang, Lihe
    Wu, Jie
    Wang, Tiantian
    Borji, Ali
    Wei, Guohua
    Lu, Huchuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 3534 - 3545
  • [32] A Fully Convolutional Network for Salient Object Detection
    Bianco, Simone
    Buzzelli, Marco
    Schettini, Raimondo
    IMAGE ANALYSIS AND PROCESSING (ICIAP 2017), PT II, 2017, 10485 : 82 - 92
  • [33] Image salient object detection with refined deep features via convolution neural network
    Zhu, Dandan
    Dai, Lei
    Shao, Xuan
    Zhou, Qiangqiang
    Itti, Laurent
    Luo, Ye
    Lu, Jianwei
    JOURNAL OF ELECTRONIC IMAGING, 2017, 26 (06)
  • [34] Object localization and edge refinement network for salient object detection
    Yao, Zhaojian
    Wang, Luping
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [35] Salient object detection based on fusion of multiple features
    Gu, Lingkang
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2018, 124 : 75 - 76
  • [36] Aggregating Attentional Dilated Features for Salient Object Detection
    Zhu, Lei
    Chen, Jiaxing
    Hu, Xiaowei
    Fu, Chi-Wing
    Xu, Xuemiao
    Qin, Jing
    Heng, Pheng-Ann
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (10) : 3358 - 3371
  • [37] Pyramid Spatial Context Features for Salient Object Detection
    Li, Hui
    IEEE ACCESS, 2020, 8 : 88518 - 88526
  • [38] Recurrently Aggregating Deep Features for Salient Object Detection
    Hu, Xiaowei
    Zhu, Lei
    Qin, Jing
    Fu, Chi-Wing
    Heng, Pheng-Ann
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 6943 - 6950
  • [39] Cross refinement network with edge detection for salient object detection
    Xiang, Junjiang
    Hu, Xiao
    Ding, Jiayu
    Tan, Xiangyue
    Yang, Jiaxin
    IET SIGNAL PROCESSING, 2021, 15 (07) : 425 - 436
  • [40] Joint training with the edge detection network for salient object detection
    Gu Zongyun
    Kan Junling
    Ma Chun
    Wang Qing
    Li Fangfang
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2022, 25 (05) : 504 - 512