Segmentation of Gray Matters and White Matters from Brain MRI data

arXiv cs.CV / 4/1/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper presents a modified MedSAM-based foundation model for multi-class segmentation of brain tissues (gray matter and white matter) from MRI data.
  • It uses a preprocessing pipeline combining skull stripping (FSL BET) and tissue probability mapping (FSL FAST), then converts volumes into 2D axial/sagittal/coronal slices with multi-class labels.
  • The method adapts MedSAM’s mask decoder to predict three classes (background, gray matter, white matter) while freezing the pre-trained image encoder and fine-tuning the prompt encoder and decoder.
  • Experiments on the IXI dataset report Dice scores up to 0.8751, indicating strong segmentation performance.
  • The authors argue that prompt-based foundation models can be extended to broader and more diverse medical imaging scenarios with relatively small architectural changes.

Abstract

Accurate segmentation of brain tissues such as gray matter and white matter from magnetic resonance imaging is essential for studying brain anatomy, diagnosing neurological disorders, and monitoring disease progression. Traditional methods, such as FSL FAST, produce tissue probability maps but often require task-specific adjustments and face challenges with diverse imaging conditions. Recent foundation models, such as MedSAM, offer a prompt-based approach that leverages large-scale pretraining. In this paper, we propose a modified MedSAM model designed for multi-class brain tissue segmentation. Our preprocessing pipeline includes skull stripping with FSL BET, tissue probability mapping with FSL FAST, and converting these into 2D axial, sagittal, coronal slices with multi-class labels (background, gray matter, and white matter). We extend MedSAM's mask decoder to three classes, freezing the pre-trained image encoder and fine-tuning the prompt encoder and decoder. Experiments on the IXI dataset achieve Dice scores up to 0.8751. This work demonstrates that foundation models like MedSAM can be adapted for multi-class medical image segmentation with minimal architectural modifications. Our findings suggest that such models can be extended to more diverse medical imaging scenarios in future work.

Segmentation of Gray Matters and White Matters from Brain MRI data | AI Navigate