Bidirectional feature learning network for RGB-D salient object detection

被引:1
|
作者
Niu, Ye
Zhou, Sanping [1 ]
Dong, Yonghao
Wang, Le
Wang, Jinjun
Zheng, Nanning
机构
[1] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian, Peoples R China
基金
中国博士后科学基金; 国家重点研发计划;
关键词
RGB-D salient object detection; Bidirectional feature fusion; Dual consistency loss; IMAGE; FUSION;
D O I
10.1016/j.patcog.2024.110304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-D salient object detection aims to perform the pixel-wise localization of salient objects from both RGB and depth images, whose challenge mainly comes from how to learn complementary features from each modality. Existing works often use increasingly large models for performance enhancement, which need large memory and time consumption in practice. In this paper, we propose a simple yet effective Bidirectional Feature Learning Network (BFLNet) for RGB-D salient object detection under limited memory and time conditions. To achieve accurate performance with lightweight backbone networks, an effective Bidirectional Feature Fusion (BFF) module is designed to merge features from both RGB and depth streams, in which the crossmodal fusions and cross-scale fusions are jointly conducted to fuse the immediate features in multiple scales and multiple modals. What is more, a simple Dual Consistency Loss (DCL) function is designed to prompt cross -modal fusion by keeping the consistency between cross -modal target predictions. Extensive experiments on four benchmark datasets demonstrate that our method has achieved the state-of-the-art performance with high efficiency in RGB-D salient object detection. Code will be available at https://github.com/nightskynostar/BFLNet.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Siamese Network for RGB-D Salient Object Detection and Beyond
    Fu, Keren
    Fan, Deng-Ping
    Ji, Ge-Peng
    Zhao, Qijun
    Shen, Jianbing
    Zhu, Ce
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5541 - 5559
  • [22] Aggregate interactive learning for RGB-D salient object detection
    Wu, Jingyu
    Sun, Fuming
    Xu, Rui
    Meng, Jie
    Wang, Fasheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 195
  • [23] Rethinking feature aggregation for deep RGB-D salient object detection
    Zhang, Yuan-fang
    Zheng, Jiangbin
    Li, Long
    Liu, Nian
    Jia, Wenjing
    Fan, Xiaochen
    Xu, Chengpei
    He, Xiangjian
    NEUROCOMPUTING, 2021, 423 : 463 - 473
  • [24] MLBSNet: Mutual Learning and Boosting Segmentation Network for RGB-D Salient Object Detection
    Xia, Chenxing
    Wang, Jingjing
    Ge, Bing
    ELECTRONICS, 2024, 13 (14)
  • [25] RGB-D salient object detection: A survey
    Tao Zhou
    Deng-Ping Fan
    Ming-Ming Cheng
    Jianbing Shen
    Ling Shao
    ComputationalVisualMedia, 2021, 7 (01) : 37 - 69
  • [26] RGB-D salient object detection: A survey
    Zhou, Tao
    Fan, Deng-Ping
    Cheng, Ming-Ming
    Shen, Jianbing
    Shao, Ling
    COMPUTATIONAL VISUAL MEDIA, 2021, 7 (01) : 37 - 69
  • [27] RGB-D salient object detection: A survey
    Tao Zhou
    Deng-Ping Fan
    Ming-Ming Cheng
    Jianbing Shen
    Ling Shao
    Computational Visual Media, 2021, 7 : 37 - 69
  • [28] Salient Object Detection in RGB-D Videos
    Mou, Ao
    Lu, Yukang
    He, Jiahao
    Min, Dingyao
    Fu, Keren
    Zhao, Qijun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6660 - 6675
  • [29] Calibrated RGB-D Salient Object Detection
    Ji, Wei
    Li, Jingjing
    Yu, Shuang
    Zhang, Miao
    Piao, Yongri
    Yao, Shunyu
    Bi, Qi
    Ma, Kai
    Zheng, Yefeng
    Lu, Huchuan
    Cheng, Li
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9466 - 9476
  • [30] FCDHNet: A feature cross-dimensional hybrid network for RGB-D salient object detection
    Wang, Feifei
    Zheng, Panpan
    Li, Yongming
    Wang, Liejun
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 266