FANet: Features Adaptation Network for 360° Omnidirectional Salient Object Detection

被引:13
|
作者
Huang, Mengke [1 ,2 ]
Liu, Zhi [1 ,2 ]
Li, Gongyang [1 ,2 ]
Zhou, Xiaofei [3 ]
Le Meur, Olivier [4 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[4] Univ Rennes 1, IRISA, F-35042 Rennes, France
基金
中国国家自然科学基金;
关键词
360 degrees omnidirectional image; salient object detection; equirectangular and cube-map projection; projection features adaptation; multi-level features adaptation; SEGMENTATION;
D O I
10.1109/LSP.2020.3028192
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Salient object detection (SOD) in 360 degrees omnidirectional images has become an eye-catching problem because of the popularity of affordable 360 degrees cameras. In this paper, we propose a Features Adaptation Network (FANet) to highlight salient objects in 360 degrees omnidirectional images reliably. To utilize the feature extraction capability of convolutional neural networks and capture global object information, we input the equirectangular 360 degrees images and corresponding cube-map 360 degrees images to the feature extraction network (FENet) simultaneously to obtain multi-level equirectangular and cube-map features. Furthermore, we fuse these two kinds of features at each level of the FENet by a projection features adaptation (PFA) module, for selecting these two kinds of features adaptively. Finally, we combine the preliminary adaptation features at different levels by a multi-level features adaptation (MLFA) module, which weights these different-level features adaptively and produces the final saliencymaps. Experiments show our FANet outperforms the state-of-the-art methods on the 360 degrees omnidirectional SOD datasets.
引用
收藏
页码:1819 / 1823
页数:5
相关论文
共 50 条
  • [1] Consistency perception network for 360° omnidirectional salient object detection
    Wen, Hongfa
    Zhu, Zunjie
    Zhou, Xiaofei
    Zhang, Jiyong
    Yan, Chenggang
    NEUROCOMPUTING, 2025, 620
  • [2] Adjacent Coordination Network for Salient Object Detection in 360 Degree Omnidirectional Images
    Chen, Xiaolei
    Wang, Xing
    Zhang, Xuegong
    Du, Zelong
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (12): : 4529 - 4541
  • [3] Salient Object Detection on 360° Omnidirectional Image with Bi-branch Hybrid Projection Network
    Zhang, Jie
    Zhang, Qiudan
    Shen, Xuelin
    Wang, Xu
    2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
  • [4] Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360° Omnidirectional Image
    Cong, Runmin
    Huang, Ke
    Lei, Jianjun
    Zhao, Yao
    Huang, Qingming
    Kwong, Sam
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9495 - 9507
  • [5] Distortion-Adaptive Salient Object Detection in 360° Omnidirectional Images
    Li, Jia
    Su, Jinming
    Xia, Changqun
    Tian, Yonghong
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (01) : 38 - 48
  • [6] View-Aware Salient Object Detection for 360° Omnidirectional Image
    Wu, Junjie
    Xia, Changqun
    Yu, Tianshu
    Li, Jia
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6471 - 6484
  • [7] FANet: focus-aware lightweight light field salient object detection network
    Fu, Jiamin
    Chen, Zhihong
    Zhang, Haiwei
    Gao, Yuxuan
    Xu, Haitao
    Zhang, Hao
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2025, 22 (01)
  • [8] Lightweight Distortion-Aware Network for Salient Object Detection in Omnidirectional Images
    Huang, Mengke
    Li, Gongyang
    Liu, Zhi
    Zhu, Linchao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (10) : 6191 - 6197
  • [9] SIHENet: Semantic Interaction and Hierarchical Embedding Network for 360° Salient Object Detection
    He, Zhentao
    Shao, Feng
    Xie, Zhengxuan
    Chai, Xiongli
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [10] SCFANet: Semantics and Context Feature Aggregation Network for 360° Salient Object Detection
    He, Zhentao
    Shao, Feng
    Chen, Gang
    Chai, Xiongli
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2276 - 2288