Context-Aware Self-Supervised Learning of Whole Slide Images

被引:0
|
作者
Aryal M. [1 ]
Yahya Soltani N. [1 ]
机构
[1] Department of Computer Science, Marquette University, Milwaukee, WI
来源
关键词
Artificial intelligence; Cancer; computational pathology; Feature extraction; graph convolutional networks; Kidney; kidney cancer; prostate cancer; Self-supervised learning; Task analysis; Training; whole slide image;
D O I
10.1109/TAI.2024.3365779
中图分类号
学科分类号
摘要
Presenting whole slide images (WSIs) as graph will enable a more efficient and accurate learning framework for cancer diagnosis. Due to the fact that a single WSI consists of billions of pixels and there is a lack of vast annotated datasets required for computational pathology, the problem of learning from WSIs using typical deep learning approaches such as convolutional neural network (CNN) is challenging. Additionally, WSIs down-sampling may lead to the loss of data that is essential for cancer detection. A novel two-stage learning technique is presented in this work. Since context, such as topological features in the tumor surroundings, may hold important information for cancer grading and diagnosis, a graph representation capturing all dependencies among regions in the WSI is very intuitive. Graph convolutional network (GCN) is deployed to include context from the tumor and adjacent tissues, and self-supervised learning is used to enhance training through unlabeled data. More specifically, the entire slide is presented as a graph, where the nodes correspond to the patches from the WSI. The proposed framework is then tested using WSIs from prostate and kidney cancers. IEEE
引用
收藏
页码:1 / 10
页数:9
相关论文
共 50 条
  • [1] CONTEXT-AWARE GRAPH-BASED SELF-SUPERVISED LEARNING OF WHOLE SLIDE IMAGES
    Aryal, Milan
    Soltani, Nasim Yahya
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3553 - 3557
  • [2] Enhancing Hyperedge Prediction With Context-Aware Self-Supervised Learning
    Ko, Yunyong
    Tong, Hanghang
    Kim, Sang-Wook
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (04) : 1772 - 1784
  • [3] Cancer Survival Prediction From Whole Slide Images With Self-Supervised Learning and Slide Consistency
    Fan, Lei
    Sowmya, Arcot
    Meijering, Erik
    Song, Yang
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (05) : 1401 - 1412
  • [4] CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging
    Taher, Mohammad Reza Hosseinzadeh
    Haghighi, Fatemeh
    Gotway, Michael B.
    Liang, Jianming
    INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 172, 2022, 172 : 535 - 551
  • [5] A deep learning framework for context-aware mitotic activity estimation in whole slide images
    Pati, Pushpak
    Catena, Raul
    Goksel, Orcun
    Gabrani, Maria
    MEDICAL IMAGING 2019: DIGITAL PATHOLOGY, 2019, 10956
  • [6] Self-Supervised Image Denoising for Real-World Images With Context-Aware Transformer
    Zhang, Dan
    Zhou, Fangfang
    IEEE ACCESS, 2023, 11 : 14340 - 14349
  • [7] Grading of Prostate Whole-slide Images Using Weak Self-supervised Learning
    Ghorbani, Amirata
    Esteva, Andre
    Zou, James
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 1439 - 1443
  • [8] Fast and scalable search of whole-slide images via self-supervised deep learning
    Chengkuan Chen
    Ming Y. Lu
    Drew F. K. Williamson
    Tiffany Y. Chen
    Andrew J. Schaumberg
    Faisal Mahmood
    Nature Biomedical Engineering, 2022, 6 : 1420 - 1434
  • [9] Fast and scalable search of whole-slide images via self-supervised deep learning
    Chen, Chengkuan
    Lu, Ming Y.
    Williamson, Drew F. K.
    Chen, Tiffany Y.
    Schaumberg, Andrew J.
    Mahmood, Faisal
    NATURE BIOMEDICAL ENGINEERING, 2022, 6 (12) : 1420 - +
  • [10] A Self-Supervised Learning Based Framework for Eyelid Malignant Melanoma Diagnosis in Whole Slide Images
    Jiang, Zijing
    Wang, Linyan
    Wang, Yaqi
    Jia, Gangyong
    Zeng, Guodong
    Wang, Jun
    Li, Yunxiang
    Chen, Dechao
    Qian, Guiping
    Jin, Qun
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2024, 21 (04) : 701 - 714