Progressive expansion for semi-supervised bi-modal salient object detection

被引:2
|
作者
Wang, Jie [1 ]
Zhang, Zihao [1 ]
Yu, Nana [1 ]
Han, Yahong [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
关键词
Bi-modal salient object detection; Cross-model fusion; Semi-supervised learning; NETWORK; CONTEXT;
D O I
10.1016/j.patcog.2024.110868
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing bi-modal salient object detection (SOD) methods primarily rely on fully supervised training strategies that require extensive manual annotation. Undoubtedly, extensive manual annotation is time-consuming and laborious, and the fully supervised strategy is also prone to overfitting on the training set. Therefore, we introduce a semi-supervised learning architecture (SSLA) to alleviate these problems while ensuring detection performance. Considering that the inherent training mode and concise architecture of basic SSLA will limit its ability to effectively explore the learning potential of the model, we further propose two optimization strategies, dynamic adjustment and active expansion. Specifically, we dynamically adjust the supervision scheme for unlabeled samples during training so that the model can continuously utilize the model's gains (pseudo labels) to supervise and guide the model to further explore the unlabeled samples. Furthermore, the active expansion strategy enables the model to acquire more beneficial supervised information and focuses its attention on difficult-to-segment samples. In summary, an effective progressive expansion network (PENet) architecture for semi-supervised bi-modal SOD is proposed. Extensive experiments indicate that our PENet architecture, while effectively alleviating 90% of annotation burdens, has achieved highly competitive results in RGB-T and RGB-D tasks compared to fully supervised methods. The performance is even more pronounced during cross-dataset testing.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Semi-supervised Active Salient Object Detection
    Lv, Yunqiu
    Liu, Bowen
    Zhang, Jing
    Dai, Yuchao
    Li, Aixuan
    Zhang, Tong
    PATTERN RECOGNITION, 2022, 123
  • [2] AUGMENTED SEMI-SUPERVISED LEARNING FOR SALIENT OBJECT DETECTION WITH EDGE COMPUTING
    Yu, Chengjin
    Zhang, Yanping
    Mukherjee, Mithun
    Lloret, Jaime
    IEEE WIRELESS COMMUNICATIONS, 2022, 29 (03) : 109 - 114
  • [3] A semi-supervised recurrent neural network for video salient object detection
    Aditya Kompella
    Raghavendra V. Kulkarni
    Neural Computing and Applications, 2021, 33 : 2065 - 2083
  • [4] A semi-supervised recurrent neural network for video salient object detection
    Kompella, Aditya
    Kulkarni, Raghavendra, V
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (06): : 2065 - 2083
  • [5] CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detection
    Pang, Youwei
    Zhao, Xiaoqi
    Zhang, Lihe
    Lu, Huchuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 892 - 904
  • [6] Semi-Supervised Video Salient Object Detection Using Pseudo-Labels
    Yan, Pengxiang
    Li, Guanbin
    Xie, Yuan
    Li, Zhen
    Wang, Chuan
    Chen, Tianshui
    Lin, Liang
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7283 - 7292
  • [7] Semi-Supervised Salient Object Detection Using a Linear Feedback Control System Model
    Zhou, Yuan
    Huo, Shuwei
    Xiang, Wei
    Hou, Chunping
    Kung, Sun-Yuan
    IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (04) : 1173 - 1185
  • [8] Semi-supervised Hyperspectral Salient Object Detection Using Superpixel Attention and Siamese Structure
    Qin H.
    Xu T.
    Li J.
    Binggong Xuebao/Acta Armamentarii, 2023, 44 (09): : 2639 - 2649
  • [9] Semi-Supervised Video Salient Object Detection Based on Uncertainty-Guided Pseudo Labels
    Piao, Yongri
    Lu, Chenyang
    Zhang, Miao
    Lu, Huchuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] Semi-Supervised Active Learning for Object Detection
    Chen, Sijin
    Yang, Yingyun
    Hua, Yan
    ELECTRONICS, 2023, 12 (02)