Multi-Label Retinal Disease Classification Using Transformers

被引:18
|
作者
Rodriguez, Manuel Alejandro [1 ]
AlMarzouqi, Hasan [1 ]
Liatsis, Panos [1 ]
机构
[1] Khalifa Univ, Dept Elect Engn & Comp Sci, Abu Dhabi 127788, U Arab Emirates
关键词
Multi-label; fundus imaging; disease classification; transformer; deep learning; BLOOD-VESSELS; IMAGES; ENSEMBLE;
D O I
10.1109/JBHI.2022.3214086
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Early detection of retinal diseases is one of the most important means of preventing partial or permanent blindness in patients. In this research, a novel multi-label classification system is proposed for the detection of multiple retinal diseases, using fundus images collected from a variety of sources. First, a new multi-label retinal disease dataset, the MuReD dataset, is constructed, using a number of publicly available datasets for fundus disease classification. Next, a sequence of post-processing steps is applied to ensure the quality of the image data and the range of diseases, present in the dataset. For the first time in fundus multi-label disease classification, a transformer-based model optimized through extensive experimentation is used for image analysis and decision making. Numerous experiments are performed to optimize the configuration of the proposed system. It is shown that the approach performs better than state-of-the-art works on the same task by 7.9% and 8.1% in terms of AUC score for disease detection and disease classification, respectively. The obtained results further support the potential applications of transformer-based architectures in the medical imaging field.
引用
收藏
页码:2739 / 2750
页数:12
相关论文
共 50 条
  • [1] Exploiting Label Dependencies for Multi-Label Document Classification Using Transformers
    Fallah, Haytame
    Bruno, Emmanuel
    Bellot, Patrice
    Murisasco, Elisabeth
    PROCEEDINGS OF THE 2023 ACM SYMPOSIUM ON DOCUMENT ENGINEERING, DOCENG 2023, 2023,
  • [2] General Multi-label Image Classification with Transformers
    Lanchantin, Jack
    Wang, Tianlu
    Ordonez, Vicente
    Qi, Yanjun
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16473 - 16483
  • [3] Transformers for Multi-label Classification of Medical Text: An Empirical Comparison
    Yogarajan, Vithya
    Montiel, Jacob
    Smith, Tony
    Pfahringer, Bernhard
    ARTIFICIAL INTELLIGENCE IN MEDICINE (AIME 2021), 2021, : 114 - 123
  • [4] Taming Pretrained Transformers for Extreme Multi-label Text Classification
    Chang, Wei-Cheng
    Yu, Hsiang-Fu
    Zhong, Kai
    Yang, Yiming
    Dhillon, Inderjit S.
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3163 - 3171
  • [5] Exploring Transformers for Multi-Label Classification of Java']Java Vulnerabilities
    Mamede, Claudia
    Pinconschi, Eduard
    Abreu, Rui
    Campos, Jose
    2022 IEEE 22ND INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY, QRS, 2022, : 43 - 52
  • [6] Multi-label classification of retinal disease via a novel vision transformer model
    Wang, Dong
    Lian, Jian
    Jiao, Wanzhen
    FRONTIERS IN NEUROSCIENCE, 2024, 17
  • [7] Towards the Interpretation of Multi-label Image Classification using Transformers and Fuzzy Cognitive Maps
    Sovatzidi, Georgia
    Vasilakakis, Michael D.
    Iakovidis, Dimitris K.
    2023 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, FUZZ, 2023,
  • [8] Multi-Label Classification using an Ontology
    Traore, Yaya
    Bassole, Didier
    Malo, Sadouanouan
    Sere, Abdoulaye
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (12) : 472 - 476
  • [9] Combining EfficientNet with ML-Decoder classification head for multi-label retinal disease classification
    Sivaz O.
    Aykut M.
    Neural Computing and Applications, 2024, 36 (23) : 14251 - 14261
  • [10] Visual Transformers with Primal Object Queries for Multi-Label Image Classification
    Yazici, Vacit Oguz
    Van De Weijer, Joost
    Yu, Longlong
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3014 - 3020