Progressive expansion for semi-supervised bi-modal salient object detection

被引:2
|
作者
Wang, Jie [1 ]
Zhang, Zihao [1 ]
Yu, Nana [1 ]
Han, Yahong [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
关键词
Bi-modal salient object detection; Cross-model fusion; Semi-supervised learning; NETWORK; CONTEXT;
D O I
10.1016/j.patcog.2024.110868
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing bi-modal salient object detection (SOD) methods primarily rely on fully supervised training strategies that require extensive manual annotation. Undoubtedly, extensive manual annotation is time-consuming and laborious, and the fully supervised strategy is also prone to overfitting on the training set. Therefore, we introduce a semi-supervised learning architecture (SSLA) to alleviate these problems while ensuring detection performance. Considering that the inherent training mode and concise architecture of basic SSLA will limit its ability to effectively explore the learning potential of the model, we further propose two optimization strategies, dynamic adjustment and active expansion. Specifically, we dynamically adjust the supervision scheme for unlabeled samples during training so that the model can continuously utilize the model's gains (pseudo labels) to supervise and guide the model to further explore the unlabeled samples. Furthermore, the active expansion strategy enables the model to acquire more beneficial supervised information and focuses its attention on difficult-to-segment samples. In summary, an effective progressive expansion network (PENet) architecture for semi-supervised bi-modal SOD is proposed. Extensive experiments indicate that our PENet architecture, while effectively alleviating 90% of annotation burdens, has achieved highly competitive results in RGB-T and RGB-D tasks compared to fully supervised methods. The performance is even more pronounced during cross-dataset testing.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Points as Queries: Weakly Semi-supervised Object Detection by Points
    Chen, Liangyu
    Yang, Tong
    Zhang, Xiangyu
    Zhang, Wei
    Sun, Jian
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8819 - 8828
  • [32] SEMI-SUPERVISED OBJECT DETECTION FOR SORGHUM PANICLES IN UAV IMAGERY
    Cai, Enyu
    Guo, Jiaqi
    Yang, Changye
    Delp, Edward J.
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6482 - 6485
  • [33] Semi-supervised self-training of object detection models
    Rosenberg, C
    Hebert, M
    Schneiderman, H
    WACV 2005: SEVENTH IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION, PROCEEDINGS, 2005, : 29 - 36
  • [34] Semi-Supervised and Long-Tailed Object Detection with CascadeMatch
    Zang, Yuhang
    Zhou, Kaiyang
    Huang, Chen
    Loy, Chen Change
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (04) : 987 - 1001
  • [35] Semi-Supervised Exemplar Learning for Object Detection in Aerial Imagery
    Overbey, Lucas A.
    Lyle, Jamie
    Pan, Jean
    Holt, Branson
    Jaegar, Alan
    Jaeger, Ryan
    van Epps, Todd
    Ruane, Martin
    GEOSPATIAL INFORMATICS XI, 2021, 11733
  • [36] Toward Semi-Supervised Graphical Object Detection in Document Images
    Kallempudi, Goutham
    Hashmi, Khurram Azeem
    Pagani, Alain
    Liwicki, Marcus
    Stricker, Didier
    Afzal, Muhammad Zeshan
    FUTURE INTERNET, 2022, 14 (06)
  • [37] DIOD: Fast, Semi-Supervised Deep ISAR Object Detection
    Xue, Bin
    Tong, Ningning
    Xu, Xin
    IEEE SENSORS JOURNAL, 2019, 19 (03) : 1073 - 1081
  • [38] Relational Matching for Weakly Semi-Supervised Oriented Object Detection
    Wu, Wenhao
    Wong, Hau-San
    Wu, Si
    Zhang, Tianyou
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 27800 - 27810
  • [39] Semi-Supervised and Long-Tailed Object Detection with CascadeMatch
    Yuhang Zang
    Kaiyang Zhou
    Chen Huang
    Chen Change Loy
    International Journal of Computer Vision, 2023, 131 : 987 - 1001
  • [40] Penalizing proposals using classifiers for semi-supervised object detection
    Hazra, Somnath
    Dasgupta, Pallab
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235