Weakly Supervised Cell Segmentation by Point Annotation

被引:38
|
作者
Zhao, Tianyi [1 ]
Yin, Zhaozheng [1 ,2 ,3 ,4 ]
机构
[1] SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USA
[2] SUNY Stony Brook, Al Inst, Stony Brook, NY 11794 USA
[3] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA
[4] SUNY Stony Brook, Dept Appl Math & Stat Affiliated, Stony Brook, NY 11794 USA
基金
美国国家科学基金会;
关键词
Image segmentation; Annotations; Training; Neural networks; Task analysis; Deep learning; Computer architecture; Cell segmentation; weakly supervised learning; point annotation; neural networks; human in the loop; UNSUPERVISED SEGMENTATION; IMAGES; PRIORS;
D O I
10.1109/TMI.2020.3046292
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose weakly supervised training schemes to train end-to-end cell segmentation networks that only require a single point annotation per cell as the training label and generate a high-quality segmentation mask close to those fully supervised methods using mask annotation on cells. Three training schemes are investigated to train cell segmentation networks, using the point annotation. First, self-training is performed to learn additional information near the annotated points. Next, co-training is applied to learn more cell regions using multiple networks that supervise each other. Finally, a hybrid-training scheme is proposed to leverage the advantages of both self-training and co-training. During the training process, we propose a divergence loss to avoid the overfitting and a consistency loss to enforce the consensus among multiple co-trained networks. Furthermore, we propose weakly supervised learning with human in the loop, aiming at achieving high segmentation accuracy and annotation efficiency simultaneously. Evaluated on two benchmark datasets, our proposal achieves high-quality cell segmentation results comparable to the fully supervised methods, but with much less amount of human annotation effort.
引用
收藏
页码:2736 / 2747
页数:12
相关论文
共 50 条
  • [1] Point2Mask: A Weakly Supervised Approach for Cell Segmentation Using Point Annotation
    Khalid, Nabeel
    Schmeisser, Fabian
    Koochali, Mohammadmahdi
    Munir, Mohsin
    Edlund, Christoffer
    Jackson, Timothy R.
    Trygg, Johan
    Sjogren, Rickard
    Dengel, Andreas
    Ahmed, Sheraz
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, MIUA 2022, 2022, 13413 : 139 - 153
  • [2] Weakly supervised learning of point-level annotation for coral image segmentation
    Yu, Xi
    Ouyang, Bing
    Principe, Jose C.
    Farrington, Stephanie
    Reed, John K.
    Li, Yanjun
    OCEANS 2019 MTS/IEEE SEATTLE, 2019,
  • [3] Label Refinement for Noisy Annotation in Weakly Supervised Segmentation
    Huang, Ziyi
    Liu, Hongshan
    Zhang, Haofeng
    Xing, Fuyong
    Laine, Andrew
    Angelini, Elsa
    Hendon, Christine
    Gan, Yu
    MEDICAL IMAGING 2024: IMAGE PROCESSING, 2024, 12926
  • [4] Weakly-Supervised Cross-Domain Segmentation of Electron Microscopy With Sparse Point Annotation
    Qiu, Dafei
    Xiong, Shan
    Yi, Jiajin
    Peng, Jialin
    IEEE TRANSACTIONS ON BIG DATA, 2025, 11 (02) : 359 - 371
  • [5] Weakly-Supervised Image Annotation and Segmentation with Objects and Attributes
    Shi, Zhiyuan
    Yang, Yongxin
    Hospedales, Timothy M.
    Xiang, Tao
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2525 - 2538
  • [6] Point-Based Weakly Supervised 2.5D Cell Segmentation
    Schmeisser, Fabian
    Denge, Andreas
    Ahmed, Sheraz
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT VIII, 2024, 15023 : 343 - 358
  • [7] A NOVEL WEAKLY SUPERVISED SEGMENTATION APPROACH FOR RAPID LEFT VENTRICLE ANNOTATION
    Rahmati, Behnam
    Shirani, Shahram
    Keshavarz-Motamed, Zahra
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3578 - 3582
  • [8] Weakly Supervised Liver Tumor Segmentation Using Couinaud Segment Annotation
    Lyu, Fei
    Ma, Andy J.
    Yip, Terry Cheuk-Fung
    Wong, Grace Lai-Hung
    Yuen, Pong C.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (05) : 1138 - 1149
  • [9] Point in: Counting Trees with Weakly Supervised Segmentation Network
    Tong, Pinmo
    Zhang, Xishan
    Han, Pengcheng
    Bu, Shuhui
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9545 - 9552
  • [10] Weakly Supervised Segmentation of Small Buildings with Point Labels
    Lee, Jae-Hun
    Kim, ChanYoung
    Sull, Sanghoon
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7386 - 7395