To Be Critical: Self-calibrated Weakly Supervised Learning for Salient Object Detection

被引:0
|
作者
Wang, Jian [1 ]
Liu, Tingwei [1 ]
Zhang, Miao [1 ,2 ]
Piao, Yongri [1 ]
机构
[1] Dalian Univ Technol, Dalian, Peoples R China
[2] Key Lab Ubiquitous Network & Serv Software Liaoni, Dalian, Peoples R China
基金
中国国家自然科学基金;
关键词
Salient object detection; Weakly supervised learning; Deep learning;
D O I
10.1007/978-981-99-8552-4_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly-supervised salient object detection (WSOD) aims to develop saliency models using image-level annotations. Despite of the success of previous works, explorations on an effective training strategy for the saliency network and accurate matches between image-level annotations and salient objects are still inadequate. In this work, 1) we propose a self-calibrated training strategy by explicitly establishing a mutual calibration loop between pseudo labels and network predictions, liberating the saliency network from error-prone propagation caused by pseudo labels. 2) we prove that even a much smaller dataset (merely 1.8% of ImageNet) with well-matched annotations can facilitate models to achieve better performance as well as generalizability. This sheds new light on the development of WSOD and encourages more contributions to the community. Comprehensive experiments demonstrate that our method outperforms all the existing WSOD methods by adopting the self-calibrated strategy only. Steady improvements are further achieved by training on the proposed dataset. Additionally, our method achieves 94.7% of the performance of fully-supervised methods on average. And what is more, the fully supervised models adopting our predicted results as "ground truths" achieve successful results (95.6% for BASNet and 97.3% for ITSD on F-measure), while costing only 0.32% of labeling time for pixel-level annotation. The code and dataset are available at https://github.com/DUTyimmy/SCW.
引用
收藏
页码:184 / 198
页数:15
相关论文
共 50 条
  • [21] Complementary characteristics fusion network for weakly supervised salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Yang, Fei
    Qin, Cao
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    IMAGE AND VISION COMPUTING, 2022, 126
  • [22] Weakly-Supervised Saliency Detection via Salient Object Subitizing
    Zheng, Xiaoyang
    Tan, Xin
    Zhou, Jie
    Ma, Lizhuang
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (11) : 4370 - 4380
  • [23] Weakly-Supervised Salient Object Detection With Saliency Bounding Boxes
    Liu, Yuxuan
    Wang, Pengjie
    Cao, Ying
    Liang, Zijian
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4423 - 4435
  • [24] Weakly supervised salient object detection via image category annotation
    Zhang, Ruoqi
    Huang, Xiaoming
    Zhu, Qiang
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (12) : 21359 - 21381
  • [25] Weakly Supervised Salient Object Detection With Spatiotemporal Cascade Neural Networks
    Tang, Yi
    Zou, Wenbin
    Jin, Zhi
    Chen, Yuhuan
    Hua, Yang
    Li, Xia
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (07) : 1973 - 1984
  • [26] Zigzag Learning for Weakly Supervised Object Detection
    Zhang, Xiaopeng
    Feng, Jiashi
    Xiong, Hongkai
    Tian, Qi
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4262 - 4270
  • [27] Collaborative Learning for Weakly Supervised Object Detection
    Wang, Jiajie
    Yao, Jiangchao
    Zhang, Ya
    Zhang, Rui
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 971 - 977
  • [28] Webly-supervised learning for salient object detection
    Luo, Ao
    Li, Xin
    Yang, Fan
    Jiao, Zhicheng
    Cheng, Hong
    PATTERN RECOGNITION, 2020, 103
  • [29] Category-Aware Saliency Enhance Learning Based on CLIP for Weakly Supervised Salient Object Detection
    Zhang, Yunde
    Zhang, Zhili
    Liu, Tianshan
    Kong, Jun
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [30] Category-Aware Saliency Enhance Learning Based on CLIP for Weakly Supervised Salient Object Detection
    Yunde Zhang
    Zhili Zhang
    Tianshan Liu
    Jun Kong
    Neural Processing Letters, 56