Beyond pixel: Superpixel-based MRI segmentation through traditional machine learning and graph convolutional network

被引:0
|
作者
Khatun, Zakia [1 ,2 ]
Jonsson Jr, Halldor [3 ]
Tsirilaki, Mariella [4 ]
Maffulli, Nicola [5 ,6 ,7 ]
Oliva, Francesco [8 ]
Daval, Pauline [9 ]
Tortorella, Francesco [1 ]
Gargiulo, Paolo [2 ,10 ]
机构
[1] Univ Salerno, Dept Informat & Elect Engn & Appl Math, Salerno, Italy
[2] Reykjavik Univ, Inst Biomed & Neural Engn, Dept Engn, Reykjavik, Iceland
[3] Landspitali Univ Hosp, Dept Orthopaed, Reykjavik, Iceland
[4] Landspitali Univ Hosp, Dept Radiol, Reykjavik, Iceland
[5] Univ Roma La Sapienza, Univ Hosp St Andrea, Fac Med & Psychol, Dept Trauma & Orthopaed Surg, Rome, Italy
[6] Keele Univ, Fac Med & Hlth Sci, Sch Pharm & Bioengn, Stoke on Trent ST4 7QB, England
[7] Queen Mary Univ London, Mile End Hosp, Ctr Sports & Exercise Med, Barts & London Sch Med & Dent, London, England
[8] San Raffaele Roma Open Univ, Dept Human Sci & Promot Qual Life, Rome, Italy
[9] Univ Aix Marseille, Biomed Dept, Ecole Polytech, Marseille, France
[10] Landspitali Univ Hosp, Dept Sci, Reykjavik, Iceland
关键词
Magnetic resonance imaging; Superpixel; Graph convolutional network; Segmentation via node classification; Achilles tendon; IMAGES;
D O I
10.1016/j.cmpb.2024.108398
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Tendon segmentation is crucial for studying tendon-related pathologies like tendinopathy, tendinosis, etc. This step further enables detailed analysis of specific tendon regions using automated or semi-automated methods. This study specifically aims at the segmentation of Achilles tendon, the largest tendon in the human body. Methods: This study proposes a comprehensive end-to-end tendon segmentation module composed of a preliminary superpixel-based coarse segmentation preceding the final segmentation task. The final segmentation results are obtained through two distinct approaches. In the first approach, the coarsely generated superpixels are subjected to classification using Random Forest (RF) and Support Vector Machine (SVM) classifiers to classify whether each superpixel belongs to a tendon class or not (resulting in tendon segmentation). In the second approach, the arrangements of superpixels are converted to graphs instead of being treated as conventional image grids. This classification process uses a graph-based convolutional network (GCN) to determine whether each superpixel corresponds to a tendon class or not. Results: All experiments are conducted on a custom-made ankle MRI dataset. The dataset comprises 76 subjects and is divided into two sets: one for training (Dataset 1, trained and evaluated using leave-one-group- out cross-validation) and the other as unseen test data (Dataset 2). Using our first approach, the final test AUC (Area Under the ROC Curve) scores using RF and SVM classifiers on the test data (Dataset 2) are 0.992 and 0.987, respectively, with sensitivities of 0.904 and 0.966. On the other hand, using our second approach (GCN-based node classification), the AUC score for the test set is 0.933 with a sensitivity of 0.899. Conclusions: Our proposed pipeline demonstrates the efficacy of employing superpixel generation as a coarse segmentation technique for the final tendon segmentation. Whether utilizing RF, SVM-based superpixel classification, or GCN-based classification for tendon segmentation, our system consistently achieves commendable AUC scores, especially the non-graph-based approach. Given the limited dataset, our graph-based method did not perform as well as non-graph-based superpixel classifications; however, the results obtained provide valuable insights into how well the models can distinguish between tendons and non-tendons. This opens up opportunities for further exploration and improvement.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Convolutional Neural Network Based Segmentation of Demyelinating Plaques in MRI
    Stasiak, Bartlomiej
    Tarasiuk, Pawel
    Michalska, Izabela
    Tomczyk, Arkadiusz
    Szczepaniak, Piotr S.
    BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES (BIOSTEC 2017), 2018, 881 : 163 - 188
  • [42] Graph Convolutional Network Based on Manifold Similarity Learning
    Si-Bao Chen
    Xiu-Zhi Tian
    Chris H. Q. Ding
    Bin Luo
    Yi Liu
    Hao Huang
    Qiang Li
    Cognitive Computation, 2020, 12 : 1144 - 1153
  • [43] Graph Convolutional Network Based on Manifold Similarity Learning
    Chen, Si-Bao
    Tian, Xiu-Zhi
    Ding, Chris H. Q.
    Luo, Bin
    Liu, Yi
    Huang, Hao
    Li, Qiang
    COGNITIVE COMPUTATION, 2020, 12 (06) : 1144 - 1153
  • [44] MSGATN: A Superpixel-Based Multi-Scale Siamese Graph Attention Network for Change Detection in Remote Sensing Images
    Shuai, Wenjing
    Jiang, Fenlong
    Zheng, Hanhong
    Li, Jianzhao
    APPLIED SCIENCES-BASEL, 2022, 12 (10):
  • [45] Dark Spot Detection from SAR Images Based on Superpixel Deeper Graph Convolutional Network
    Liu, Xiaojian
    Li, Yansheng
    Liu, Xinyi
    Zou, Huimin
    REMOTE SENSING, 2022, 14 (21)
  • [46] CNN-Enhanced Graph Convolutional Network With Pixel- and Superpixel-Level Feature Fusion for Hyperspectral Image Classification
    Liu, Qichao
    Xiao, Liang
    Yang, Jingxiang
    Wei, Zhihui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (10): : 8657 - 8671
  • [47] Study on TCM Tongue Image Segmentation Model Based on Convolutional Neural Network Fused with Superpixel
    Zhang, Han
    Jiang, Rongrong
    Yang, Tao
    Gao, Jiayi
    Wang, Yi
    Zhang, Junfeng
    EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE, 2022, 2022
  • [48] Segmentation of Medical Image Based on Superpixel Boundary Perceptual Convolutional Network in Cancer Diagnosis and Treatment
    Yi, Xiaochun
    Hou, Jing
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2021, 11 (01) : 254 - 260
  • [49] GRAPH-BASED MACHINE LEARNING Half a decade of graph convolutional networks
    Haghir Chehreghani, Mostafa
    NATURE MACHINE INTELLIGENCE, 2022, 4 (03) : 192 - 193
  • [50] PARALLEL GRAPH ATTENTION NETWORK MODEL BASED ON PIXEL AND SUPERPIXEL FEATURE FUSION FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Ma, Lisong
    Wang, Qingyan
    Zhang, Junping
    Wang, Yujing
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 7226 - 7229