Context-Aware Self-Supervised Learning of Whole Slide Images

被引:0
|
作者
Aryal M. [1 ]
Yahya Soltani N. [1 ]
机构
[1] Department of Computer Science, Marquette University, Milwaukee, WI
来源
关键词
Artificial intelligence; Cancer; computational pathology; Feature extraction; graph convolutional networks; Kidney; kidney cancer; prostate cancer; Self-supervised learning; Task analysis; Training; whole slide image;
D O I
10.1109/TAI.2024.3365779
中图分类号
学科分类号
摘要
Presenting whole slide images (WSIs) as graph will enable a more efficient and accurate learning framework for cancer diagnosis. Due to the fact that a single WSI consists of billions of pixels and there is a lack of vast annotated datasets required for computational pathology, the problem of learning from WSIs using typical deep learning approaches such as convolutional neural network (CNN) is challenging. Additionally, WSIs down-sampling may lead to the loss of data that is essential for cancer detection. A novel two-stage learning technique is presented in this work. Since context, such as topological features in the tumor surroundings, may hold important information for cancer grading and diagnosis, a graph representation capturing all dependencies among regions in the WSI is very intuitive. Graph convolutional network (GCN) is deployed to include context from the tumor and adjacent tissues, and self-supervised learning is used to enhance training through unlabeled data. More specifically, the entire slide is presented as a graph, where the nodes correspond to the patches from the WSI. The proposed framework is then tested using WSIs from prostate and kidney cancers. IEEE
引用
收藏
页码:1 / 10
页数:9
相关论文
共 50 条
  • [11] Self-supervised Context-aware Style Representation for Expressive Speech Synthesis
    Wu, Yihan
    Wang, Xi
    Zhang, Shaofei
    He, Lei
    Song, Ruihua
    Nie, Jian-Yun
    INTERSPEECH 2022, 2022, : 5503 - 5507
  • [12] Self-supervised Heterogeneous Hypergraph Learning with Context-aware Pooling for Graph-level Classification
    Hayat, Malik Khizar
    Xue, Shan
    Yang, Jian
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 140 - 149
  • [13] Integration of Patch Features Through Self-supervised Learning and Transformer for Survival Analysis on Whole Slide Images
    Huang, Ziwang
    Chai, Hua
    Wang, Ruoqi
    Wang, Haitao
    Yang, Yuedong
    Wu, Hejun
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VIII, 2021, 12908 : 561 - 570
  • [14] Context-aware switching between localisation methods for robust robot navigation: a self-supervised learning approach
    Guilherme, Raul
    Marques, Francisco
    Lourenco, Andre
    Mendonca, Ricardo
    Santana, Pedro
    Barata, Jose
    2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 4356 - 4361
  • [15] Forensic Histopathological Recognition via a Context-Aware MIL Network Powered by Self-supervised Contrastive Learning
    Shen, Chen
    Zhang, Jun
    Liang, Xinggong
    Hao, Zeyi
    Li, Kehan
    Wang, Fan
    Wang, Zhenyuan
    Lian, Chunfeng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VI, 2023, 14225 : 528 - 538
  • [16] SCMIL: Sparse Context-Aware Multiple Instance Learning for Predicting Cancer Survival Probability Distribution in Whole Slide Images
    Yang, Zekang
    Liu, Hong
    Wang, Xiangdong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT IV, 2024, 15004 : 448 - 458
  • [17] Self-supervised context-aware correlation filter for robust landmark tracking in liver ultrasound sequences
    Ma, Lin
    Wang, Junjie
    Gong, Shu
    Lan, Libin
    Geng, Li
    Wang, Siping
    Feng, Xin
    BIOMEDICAL ENGINEERING-BIOMEDIZINISCHE TECHNIK, 2024, 69 (04): : 383 - 394
  • [18] SparseConvMIL: Sparse Convolutional Context-Aware Multiple Instance Learning for Whole Slide Image Classification
    Lerousseau, Marvin
    Vakalopoulou, Maria
    Deutsch, Eric
    Paragios, Nikos
    MICCAI WORKSHOP ON COMPUTATIONAL PATHOLOGY, VOL 156, 2021, 156 : 129 - 139
  • [19] Geography-Aware Self-Supervised Learning
    Ayush, Kumar
    Uzkent, Burak
    Meng, Chenlin
    Tanmay, Kumar
    Burke, Marshall
    Lobell, David
    Ermon, Stefano
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10161 - 10170
  • [20] Self-supervised comparative learning based improved multiple instance learning for whole slide image classification
    Yao, Luhan
    Wang, Hongyu
    Hao, Yingguang
    PROCEEDINGS OF 2023 4TH INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE FOR MEDICINE SCIENCE, ISAIMS 2023, 2023, : 1353 - 1357