Beyond pixel: Superpixel-based MRI segmentation through traditional machine learning and graph convolutional network

被引:0
|
作者
Khatun, Zakia [1 ,2 ]
Jonsson Jr, Halldor [3 ]
Tsirilaki, Mariella [4 ]
Maffulli, Nicola [5 ,6 ,7 ]
Oliva, Francesco [8 ]
Daval, Pauline [9 ]
Tortorella, Francesco [1 ]
Gargiulo, Paolo [2 ,10 ]
机构
[1] Univ Salerno, Dept Informat & Elect Engn & Appl Math, Salerno, Italy
[2] Reykjavik Univ, Inst Biomed & Neural Engn, Dept Engn, Reykjavik, Iceland
[3] Landspitali Univ Hosp, Dept Orthopaed, Reykjavik, Iceland
[4] Landspitali Univ Hosp, Dept Radiol, Reykjavik, Iceland
[5] Univ Roma La Sapienza, Univ Hosp St Andrea, Fac Med & Psychol, Dept Trauma & Orthopaed Surg, Rome, Italy
[6] Keele Univ, Fac Med & Hlth Sci, Sch Pharm & Bioengn, Stoke on Trent ST4 7QB, England
[7] Queen Mary Univ London, Mile End Hosp, Ctr Sports & Exercise Med, Barts & London Sch Med & Dent, London, England
[8] San Raffaele Roma Open Univ, Dept Human Sci & Promot Qual Life, Rome, Italy
[9] Univ Aix Marseille, Biomed Dept, Ecole Polytech, Marseille, France
[10] Landspitali Univ Hosp, Dept Sci, Reykjavik, Iceland
关键词
Magnetic resonance imaging; Superpixel; Graph convolutional network; Segmentation via node classification; Achilles tendon; IMAGES;
D O I
10.1016/j.cmpb.2024.108398
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Tendon segmentation is crucial for studying tendon-related pathologies like tendinopathy, tendinosis, etc. This step further enables detailed analysis of specific tendon regions using automated or semi-automated methods. This study specifically aims at the segmentation of Achilles tendon, the largest tendon in the human body. Methods: This study proposes a comprehensive end-to-end tendon segmentation module composed of a preliminary superpixel-based coarse segmentation preceding the final segmentation task. The final segmentation results are obtained through two distinct approaches. In the first approach, the coarsely generated superpixels are subjected to classification using Random Forest (RF) and Support Vector Machine (SVM) classifiers to classify whether each superpixel belongs to a tendon class or not (resulting in tendon segmentation). In the second approach, the arrangements of superpixels are converted to graphs instead of being treated as conventional image grids. This classification process uses a graph-based convolutional network (GCN) to determine whether each superpixel corresponds to a tendon class or not. Results: All experiments are conducted on a custom-made ankle MRI dataset. The dataset comprises 76 subjects and is divided into two sets: one for training (Dataset 1, trained and evaluated using leave-one-group- out cross-validation) and the other as unseen test data (Dataset 2). Using our first approach, the final test AUC (Area Under the ROC Curve) scores using RF and SVM classifiers on the test data (Dataset 2) are 0.992 and 0.987, respectively, with sensitivities of 0.904 and 0.966. On the other hand, using our second approach (GCN-based node classification), the AUC score for the test set is 0.933 with a sensitivity of 0.899. Conclusions: Our proposed pipeline demonstrates the efficacy of employing superpixel generation as a coarse segmentation technique for the final tendon segmentation. Whether utilizing RF, SVM-based superpixel classification, or GCN-based classification for tendon segmentation, our system consistently achieves commendable AUC scores, especially the non-graph-based approach. Given the limited dataset, our graph-based method did not perform as well as non-graph-based superpixel classifications; however, the results obtained provide valuable insights into how well the models can distinguish between tendons and non-tendons. This opens up opportunities for further exploration and improvement.
引用
收藏
页数:14
相关论文
共 50 条
  • [11] Advanced Superpixel-Based Features and Machine Learning Based Saliency Detection
    Lin, Heng-Sheng
    Ding, Jian-Jiun
    Huang, Jin-Yu
    2020 INTERNATIONAL SYMPOSIUM ON COMPUTER, CONSUMER AND CONTROL (IS3C 2020), 2021, : 292 - 295
  • [12] A superpixel-based framework for automatic tumor segmentation on breast DCE-MRI
    Yu, Ning
    Wu, Jia
    Weinstein, Susan P.
    Gaonkar, Bilwaj
    Keller, Brad M.
    Ashraf, Ahmed B.
    Jiang, YunQing
    Davatzikos, Christos
    Conant, Emily F.
    Kontos, Despina
    MEDICAL IMAGING 2015: COMPUTER-AIDED DIAGNOSIS, 2015, 9414
  • [13] SUPERPIXEL-BASED SEGMENTATION OF REMOTE SENSING IMAGES THROUGH CORRELATION CLUSTERING
    Masi, Giuseppe
    Gaetano, Raffaele
    Poggi, Giovanni
    Scarpa, Giuseppe
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 1028 - 1031
  • [14] LIVER SEGMENTATION USING SUPERPIXEL-BASED GRAPH CUTS AND RESTRICTED REGIONS OF SHAPE CONSTRAINS
    Kilrungrotsakul, Titinunt
    Han, Xian-Hua
    Chen, Yen-Wei
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3368 - 3371
  • [15] EMS-GCN: An End-to-End Mixhop Superpixel-Based Graph Convolutional Network for Hyperspectral Image Classification
    Zhang, Hongyan
    Zou, Jiaqi
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [16] Two-stage Racetrack Segmentation Method using Color Feature Filtering and Superpixel-based Convolutional Neural Network
    Hollosi, Janos
    Horvath, Erno
    Pozna, Claudiu Radu
    2018 IEEE 12TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS (SACI), 2018, : 131 - 135
  • [17] Superpixel-based deep convolutional neural networks and active contour model for automatic prostate segmentation on 3D MRI scans
    Giovanni L. F. da Silva
    Petterson S. Diniz
    Jonnison L. Ferreira
    João V. F. França
    Aristófanes C. Silva
    Anselmo C. de Paiva
    Elton A. A. de Cavalcanti
    Medical & Biological Engineering & Computing, 2020, 58 : 1947 - 1964
  • [18] Superpixel-based deep convolutional neural networks and active contour model for automatic prostate segmentation on 3D MRI scans
    da Silva, Giovanni L. F.
    Diniz, Petterson S.
    Ferreira, Jonnison L.
    Franca, Joao V. F.
    Silva, Aristofanes C.
    de Paiva, Anselmo C.
    de Cavalcanti, Elton A. A.
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2020, 58 (09) : 1947 - 1964
  • [19] Graph Neural Network and Superpixel Based Brain Tissue Segmentation
    Wu, Chong
    Feng, Zhenan
    Zhang, Houwang
    Yan, Hong
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [20] Superpixel-Based Segmentation of Polarimetric SAR Images through Two-Stage Merging
    Wang, Wei
    Xiang, Deliang
    Ban, Yifang
    Zhang, Jun
    Wan, Jianwei
    REMOTE SENSING, 2019, 11 (04)