Automated multi-class MRI brain tumor classification and segmentation using deformable attention and saliency mapping

In the diagnosis and treatment of brain tumors, the automatic classification and segmentation of medical images play a pivotal role. Early detection facilitates timely intervention, significantly improving patient survival rates. This study introduces a novel method for the automated classification and segmentation of brain tumors, aiming to enhance both diagnostic accuracy and efficiency. Magnetic Resonance (MR) imaging remains the gold standard in clinical brain tumor diagnostics; however, it is a time-intensive and labor-intensive process. Consequently, the integration of automated detection, localization, and classification methods is not only desirable but essential. In this research, we present a novel framework that enables both tumor classification and post-classification diagnostic feature extraction, allowing for the first-time classification of multiple tumor types. To improve tumor characterization, we applied data augmentation techniques to MR images and developed a hierarchical multiscale deformable attention module (MS-DAM). This model effectively captures irregular and complex tumor patterns, enhancing classification performance. Following classification, a comprehensive segmentation process was conducted across a large dataset, reinforcing the model's role as a decision support system. Utilizing a Kaggle dataset containing 14 different tumor types with highly similar morphologic structures, we validated the proposed model's efficacy. Compared to existing multi-scale channel attention modules, MS-DAM achieved superior accuracy, exceeding 96.5%. This study presents a highly promising approach for the automated classification and segmentation of brain tumors in medical imaging, offering significant advancements for diagnostic imaging clinics and paving the way for more efficient, accurate, and scalable tumor detection methodologies.