Weakly Supervised Cell Segmentation by Point Annotation

被引:38
|
作者
Zhao, Tianyi [1 ]
Yin, Zhaozheng [1 ,2 ,3 ,4 ]
机构
[1] SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USA
[2] SUNY Stony Brook, Al Inst, Stony Brook, NY 11794 USA
[3] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA
[4] SUNY Stony Brook, Dept Appl Math & Stat Affiliated, Stony Brook, NY 11794 USA
基金
美国国家科学基金会;
关键词
Image segmentation; Annotations; Training; Neural networks; Task analysis; Deep learning; Computer architecture; Cell segmentation; weakly supervised learning; point annotation; neural networks; human in the loop; UNSUPERVISED SEGMENTATION; IMAGES; PRIORS;
D O I
10.1109/TMI.2020.3046292
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose weakly supervised training schemes to train end-to-end cell segmentation networks that only require a single point annotation per cell as the training label and generate a high-quality segmentation mask close to those fully supervised methods using mask annotation on cells. Three training schemes are investigated to train cell segmentation networks, using the point annotation. First, self-training is performed to learn additional information near the annotated points. Next, co-training is applied to learn more cell regions using multiple networks that supervise each other. Finally, a hybrid-training scheme is proposed to leverage the advantages of both self-training and co-training. During the training process, we propose a divergence loss to avoid the overfitting and a consistency loss to enforce the consensus among multiple co-trained networks. Furthermore, we propose weakly supervised learning with human in the loop, aiming at achieving high segmentation accuracy and annotation efficiency simultaneously. Evaluated on two benchmark datasets, our proposal achieves high-quality cell segmentation results comparable to the fully supervised methods, but with much less amount of human annotation effort.
引用
收藏
页码:2736 / 2747
页数:12
相关论文
共 50 条
  • [41] Weakly-Supervised Point Cloud Semantic Segmentation Based on Dilated Region
    Zhang, Lujian
    Bi, Yuanwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 20
  • [42] Weakly supervised point cloud semantic segmentation with the fusion of heterogeneous network features
    Niu, Yingchun
    Yin, Jianqin
    IMAGE AND VISION COMPUTING, 2024, 142
  • [43] Towards a Weakly Supervised Framework for 3D Point Cloud Object Detection and Annotation
    Meng, Qinghao
    Wang, Wenguan
    Zhou, Tianfei
    Shen, Jianbing
    Jia, Yunde
    Van Gool, Luc
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (08) : 4454 - 4468
  • [44] Weakly Supervised Video Object Segmentation
    Wang, Yufei
    Hu, Yongjiang
    Liew, Alan Wee-Chung
    Wang, Junhu
    PROCEEDINGS OF TENCON 2018 - 2018 IEEE REGION 10 CONFERENCE, 2018, : 0315 - 0320
  • [45] Weakly Supervised Multiclass Video Segmentation
    Liu, Xiao
    Tao, Dacheng
    Song, Mingli
    Ruan, Ying
    Chen, Chun
    Bu, Jiajun
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 57 - 64
  • [46] A Survey of Weakly -supervised Semantic Segmentation
    Zhu, Kaiyin
    Xiong, Neal N.
    Lu, Mingming
    2023 IEEE 9TH INTL CONFERENCE ON BIG DATA SECURITY ON CLOUD, BIGDATASECURITY, IEEE INTL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, HPSC AND IEEE INTL CONFERENCE ON INTELLIGENT DATA AND SECURITY, IDS, 2023, : 10 - 15
  • [47] Weakly Supervised RBM for Semantic Segmentation
    Li, Yong
    Liu, Jing
    Wang, Yuhang
    Lu, Hanqing
    Ma, Songde
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 1888 - 1894
  • [48] Weakly Supervised Cell Instance Segmentation by Propagating from Detection Response
    Nishimura, Kazuya
    Ker, Dai Fei Elmer
    Bise, Ryoma
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT I, 2019, 11764 : 649 - 657
  • [49] Weakly Supervised Multi-Task Learning for Cell Detection and Segmentation
    Chamanzar, Alireza
    Nie, Yao
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 513 - 516
  • [50] Weakly Supervised Cell Instance Segmentation for Multi-Modality Microscopy
    Xue, Ming
    COMPETITIONS IN NEURAL INFORMATION PROCESSING SYSTEMS, VOL 212, 2022, 212