Webly-supervised learning for salient object detection

被引:20
|
作者
Luo, Ao [1 ]
Li, Xin [2 ]
Yang, Fan [2 ]
Jiao, Zhicheng [3 ]
Cheng, Hong [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[2] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[3] Univ N Carolina, Chapel Hill, NC 27599 USA
关键词
Salient object detection; Webly-supervised learning; Deep learning; OPTIMIZATION; FRAMEWORK; FUSION;
D O I
10.1016/j.patcog.2020.107308
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
End-to-end training of a deep CNN-Based model for salient object detection usually requires a huge number of training samples with pixel-level annotations, which are costly and time-consuming to obtain. In this paper, we propose an approach that can utilize large amounts of web data for learning a deep salient object detection model. With thousands of images collected from the Web, we first employ several bottom-up saliency detection techniques to generate salient object masks for all images, and then use a novel quality evaluation method to pick out a subset of images with reliable masks for training. After that, we develop a self-training approach to boost the performance of our initial network, which iterates between the network training process and the training set updating process. Importantly, different from existing webly-supervised or weakly-supervised methods, our approach is able to automatically select reliable images for network training without requiring any human intervention (e.g., dividing images into different difficulty levels). Results of extensive experiments on several widely-used benchmarks demonstrate that our method has achieved state-of-the-art performance. It significantly outperforms existing unsupervised and weakly-supervised salient object detection methods, and achieves competitive or even better performance than fully supervised approaches. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Weakly Supervised Salient Object Detection with Box Annotation
    Jiang, Zhentao
    Chen, Qiang
    Jiang, Bo
    Leng, Cong
    Cheng, Jian
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 197 - 211
  • [32] Semi-supervised Active Salient Object Detection
    Lv, Yunqiu
    Liu, Bowen
    Zhang, Jing
    Dai, Yuchao
    Li, Aixuan
    Zhang, Tong
    PATTERN RECOGNITION, 2022, 123
  • [33] Deeply Supervised Salient Object Detection with Short Connections
    Hou, Qibin
    Cheng, Ming-Ming
    Hu, Xiaowei
    Borji, Ali
    Tu, Zhuowen
    Torr, Philip H. S.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (04) : 815 - 828
  • [34] Weakly Supervised Salient Object Detection by Learning A Classifier-Driven Map Generator
    Hsu, Kuang-Jui
    Lin, Yen-Yu
    Chuang, Yung-Yu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5435 - 5449
  • [35] Hierarchical Learning for Salient Object Detection
    Zheng, Qi
    Zhang, Peng
    You, Xinge
    Wang, Fangzhao
    Liu, Zida
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 192 - 197
  • [36] Webly Supervised Learning for Skin Lesion Classification
    Navarro, Fernando
    Conjeti, Sailesh
    Tombari, Federico
    Navab, Nassir
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT II, 2018, 11071 : 398 - 406
  • [37] Residual Learning for Salient Object Detection
    Feng, Mengyang
    Lu, Huchuan
    Yu, Yizhou
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4696 - 4708
  • [38] Denoising Labels: A Noise-robust Method for Webly-supervised Fine-grained Visual Classification
    Huang, Dan
    Cai, Zhenhuang
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [39] Webly-Supervised Video Recognition by Mutually Voting for Relevant Web Images and Web Video Frames
    Gan, Chuang
    Sun, Chen
    Duan, Lixin
    Gong, Boqing
    COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 849 - 866
  • [40] Graph Representation and Prototype Learning for webly supervised
    Lin, Jiantao
    Chen, Tianshui
    Chen, Yingcong
    Yang, Zhijing
    Gao, Yuefang
    PATTERN RECOGNITION LETTERS, 2024, 183 : 78 - 85