Beyond pixel: Superpixel-based MRI segmentation through traditional machine learning and graph convolutional network

被引:0
|
作者
Khatun, Zakia [1 ,2 ]
Jonsson Jr, Halldor [3 ]
Tsirilaki, Mariella [4 ]
Maffulli, Nicola [5 ,6 ,7 ]
Oliva, Francesco [8 ]
Daval, Pauline [9 ]
Tortorella, Francesco [1 ]
Gargiulo, Paolo [2 ,10 ]
机构
[1] Univ Salerno, Dept Informat & Elect Engn & Appl Math, Salerno, Italy
[2] Reykjavik Univ, Inst Biomed & Neural Engn, Dept Engn, Reykjavik, Iceland
[3] Landspitali Univ Hosp, Dept Orthopaed, Reykjavik, Iceland
[4] Landspitali Univ Hosp, Dept Radiol, Reykjavik, Iceland
[5] Univ Roma La Sapienza, Univ Hosp St Andrea, Fac Med & Psychol, Dept Trauma & Orthopaed Surg, Rome, Italy
[6] Keele Univ, Fac Med & Hlth Sci, Sch Pharm & Bioengn, Stoke on Trent ST4 7QB, England
[7] Queen Mary Univ London, Mile End Hosp, Ctr Sports & Exercise Med, Barts & London Sch Med & Dent, London, England
[8] San Raffaele Roma Open Univ, Dept Human Sci & Promot Qual Life, Rome, Italy
[9] Univ Aix Marseille, Biomed Dept, Ecole Polytech, Marseille, France
[10] Landspitali Univ Hosp, Dept Sci, Reykjavik, Iceland
关键词
Magnetic resonance imaging; Superpixel; Graph convolutional network; Segmentation via node classification; Achilles tendon; IMAGES;
D O I
10.1016/j.cmpb.2024.108398
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Tendon segmentation is crucial for studying tendon-related pathologies like tendinopathy, tendinosis, etc. This step further enables detailed analysis of specific tendon regions using automated or semi-automated methods. This study specifically aims at the segmentation of Achilles tendon, the largest tendon in the human body. Methods: This study proposes a comprehensive end-to-end tendon segmentation module composed of a preliminary superpixel-based coarse segmentation preceding the final segmentation task. The final segmentation results are obtained through two distinct approaches. In the first approach, the coarsely generated superpixels are subjected to classification using Random Forest (RF) and Support Vector Machine (SVM) classifiers to classify whether each superpixel belongs to a tendon class or not (resulting in tendon segmentation). In the second approach, the arrangements of superpixels are converted to graphs instead of being treated as conventional image grids. This classification process uses a graph-based convolutional network (GCN) to determine whether each superpixel corresponds to a tendon class or not. Results: All experiments are conducted on a custom-made ankle MRI dataset. The dataset comprises 76 subjects and is divided into two sets: one for training (Dataset 1, trained and evaluated using leave-one-group- out cross-validation) and the other as unseen test data (Dataset 2). Using our first approach, the final test AUC (Area Under the ROC Curve) scores using RF and SVM classifiers on the test data (Dataset 2) are 0.992 and 0.987, respectively, with sensitivities of 0.904 and 0.966. On the other hand, using our second approach (GCN-based node classification), the AUC score for the test set is 0.933 with a sensitivity of 0.899. Conclusions: Our proposed pipeline demonstrates the efficacy of employing superpixel generation as a coarse segmentation technique for the final tendon segmentation. Whether utilizing RF, SVM-based superpixel classification, or GCN-based classification for tendon segmentation, our system consistently achieves commendable AUC scores, especially the non-graph-based approach. Given the limited dataset, our graph-based method did not perform as well as non-graph-based superpixel classifications; however, the results obtained provide valuable insights into how well the models can distinguish between tendons and non-tendons. This opens up opportunities for further exploration and improvement.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Superpixel-Based Graph Convolutional Network for UAV Forest Fire Image Segmentation
    Mu, Yunjie
    Ou, Liyuan
    Chen, Wenjing
    Liu, Tao
    Gao, Demin
    DRONES, 2024, 8 (04)
  • [2] PolSAR Image Classification With Multiscale Superpixel-Based Graph Convolutional Network
    Cheng, Jianda
    Zhang, Fan
    Xiang, Deliang
    Yin, Qiang
    Zhou, Yongsheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Superpixel-Based Attention Graph Neural Network for Semantic Segmentation in Aerial Images
    Diao, Qi
    Dai, Yaping
    Zhang, Ce
    Wu, Yan
    Feng, Xiaoxue
    Pan, Feng
    REMOTE SENSING, 2022, 14 (02)
  • [4] Superpixel-based and boundary-sensitive convolutional neural network for automated liver segmentation
    Qin, Wenjian
    Wu, Jia
    Han, Fei
    Yuan, Yixuan
    Zhao, Wei
    Ibragimov, Bulat
    Gu, Jia
    Xing, Lei
    PHYSICS IN MEDICINE AND BIOLOGY, 2018, 63 (09):
  • [5] Superpixel-Based Shallow Convolutional Neural Network (SSCNN) for Scanned Topographic Map Segmentation
    Liu, Tiange
    Miao, Qiguang
    Xu, Pengfei
    Zhang, Shihui
    REMOTE SENSING, 2020, 12 (20) : 1 - 21
  • [6] Superpixel Based Graph Convolutional Neural Network for SAR Image Segmentation
    Turkmenli, Ilter
    Aptoula, Erchan
    Kayabol, Koray
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVII, 2021, 11862
  • [7] Superpixel-Based Convolutional Neural Network for Georeferencing the Drone Images
    Feng, Shihang
    Passone, Luca
    Schuster, Gerard T.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 3361 - 3372
  • [8] Fast and Automatic Image Segmentation Using Superpixel-Based Graph Clustering
    Jia, Xiaohong
    Lei, Tao
    Liu, Peng
    Xue, Dinghua
    Meng, Hongying
    Nandi, Asoke K.
    IEEE ACCESS, 2020, 8 : 211526 - 211539
  • [9] An effective superpixel-based graph convolutional network for small waterbody extraction from remotely sensed imagery
    Shi, Weiyue
    Sui, Haigang
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 109
  • [10] Improving Scene Graph Generation with Superpixel-Based Interaction Learning
    Wang, Jingyi
    Zhang, Can
    Huang, Jinfa
    Ren, Botao
    Deng, Zhidong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1809 - 1820