Whole slide cervical cancer classification via graph attention networks and contrastive learning

被引:0
|
作者
Fei, Manman [1 ]
Zhang, Xin [1 ]
Chen, Dongdong [1 ]
Song, Zhiyun [1 ]
Wang, Qian [2 ]
Zhang, Lichi [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai, Peoples R China
[2] ShanghaiTech Univ, Sch Biomed Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Cervical cancer; Whole slide image classification; Graph attention network; Supervised contrastive learning; SUPERRESOLUTION;
D O I
10.1016/j.neucom.2024.128787
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cervical cancer is one of the most common cancers among women, which seriously threatens women's health. Early screening can reduce the incidence rate and mortality. Thinprep cytologic test (TCT) is one of the important means of cytological screening, which has high sensitivity and specificity, and has been widely used in the early screening of cervical cancer. The automatic diagnosis of whole slide images (WSIs) by computers can effectively improve the efficiency and accuracy of doctors' diagnoses. However, current methods ignore the intrinsic relationships between cervical cells in WSIs and neglect contextual information from the surrounding suspicious areas, and therefore limit their robustness and generalizability. In this paper, we propose a novel two-stage method to implement the automatic diagnosis of WSIs, which constructs Graph Attention Networks (GAT) based on local and global fields respectively to capture their contextual information in a hierarchical manner. In the first stage, we extract representative patches from each WSI through suspicious cell detection, and then employ a Local GAT to classify cervical cells by capturing correlations between suspicious cells in image tiles. This classification process provides the confidence and feature vectors for each suspicious cell. In the second stage, we perform WSI classification using a Global GAT model. We construct graphs corresponding to top-Kg and bottom-Kg cells for each WSI based on results from Local GAT, and introduce a supervised contrastive learning strategy to enhance the discriminative power of the extracted features. Experimental results demonstrate that our proposed method outperforms conventional approaches and effectively showcases the benefits of supervised contrastive learning. Our source code and example data are available at https://github.com/feimanman/WholeSlide-Cervical-Cancer-Classification.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Whole Slide Cervical Cancer Screening Using Graph Attention Network and Supervised Contrastive Learning
    Zhang, Xin
    Cao, Maosong
    Wang, Sheng
    Sun, Jiayin
    Fan, Xiangshan
    Wang, Qian
    Zhang, Lichi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 : 202 - 211
  • [2] Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification
    Sun, Zhongtian
    Harit, Anoushka
    Cristea, Alexandra, I
    Yu, Jialin
    Shi, Lei
    Al Moubayed, Noura
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [3] Enhancing Whole Slide Image Classification with Discriminative and Contrastive Learning
    Liang, Peixian
    Zheng, Hao
    Li, Hongming
    Gong, Yuxin
    Bakas, Spyridon
    Fan, Yong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT IV, 2024, 15004 : 102 - 112
  • [4] Contrastive Document Representation Learning with Graph Attention Networks
    Xu, Peng
    Chen, Xinchi
    Ma, Xiaofei
    Huang, Zhiheng
    Xiang, Bing
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 3874 - 3884
  • [5] SHUFFLE ATTENTION MULTIPLE INSTANCES LEARNING FOR BREAST CANCER WHOLE SLIDE IMAGE CLASSIFICATION
    Hou, Cunqiao
    Sun, Qiule
    Wang, Wei
    Zhang, Jianxin
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 466 - 470
  • [6] Weakly supervised pathological whole slide image classification based on contrastive learning
    Xie, Yining
    Long, Jun
    Hou, Jianxin
    Chen, Deyun
    Guan, Guohui
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (21) : 60809 - 60831
  • [7] Registration-enhanced multiple instance learning for cervical cancer whole slide image classification
    He, Qiming
    Wang, Chengjiang
    Zeng, Siqi
    Liang, Zhendong
    Duan, Hufei
    Yang, Jingying
    Pan, Feiyang
    He, Yonghong
    Huang, Wenting
    Guan, Tian
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (01)
  • [8] MuRCL: Multi-Instance Reinforcement Contrastive Learning for Whole Slide Image Classification
    Zhu, Zhonghang
    Yu, Lequan
    Wu, Wei
    Yu, Rongshan
    Zhang, Defu
    Wang, Liansheng
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (05) : 1337 - 1348
  • [9] The Whole Pathological Slide Classification via Weakly Supervised Learning
    Sun, Qiehe
    Li, Jiawen
    Xu, Jin
    Cheng, Junru
    Guan, Tian
    He, Yonghong
    arXiv, 2023,
  • [10] Molecular contrastive learning of representations via graph neural networks
    Yuyang Wang
    Jianren Wang
    Zhonglin Cao
    Amir Barati Farimani
    Nature Machine Intelligence, 2022, 4 : 279 - 287