Component-Adaptive and Lesion-Level Supervision for Improved Small Structure Segmentation in Brain MRI

arXiv cs.CV / 4/10/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces CATMIL, a unified training objective that augments standard nnU-Net losses with two auxiliary supervision terms for brain MRI small structure/lesion segmentation.
  • Component-Adaptive Tversky reweights voxel contributions using connected-component information to better balance lesions of different sizes and improve handling of class imbalance.
  • A Multiple Instance Learning–based lesion-level term encourages correct identification of each lesion instance, linking lesion recall/detection to voxel-level optimization.
  • Experiments on the MSLesSeg dataset using a consistent nnU-Net setup (5-fold cross-validation) show improved Dice score (0.7834) and lower boundary error versus standard loss formulations.
  • The approach particularly boosts small lesion recall by reducing false negatives while keeping false positive volume low, and the authors provide code and pretrained models publicly.

Abstract

We propose a unified objective function, termed CATMIL, that augments the base segmentation loss with two auxiliary supervision terms operating at different levels. The first term, Component-Adaptive Tversky, reweights voxel contributions based on connected components to balance the influence of lesions of different sizes. The second term, based on Multiple Instance Learning, introduces lesion-level supervision by encouraging the detection of each lesion instance. These terms are combined with the standard nnU-Net loss to jointly optimize voxel-level segmentation accuracy and lesion-level detection. We evaluate the proposed objective on the MSLesSeg dataset using a consistent nnU-Net framework and 5-fold cross-validation. The results show that CATMIL achieves the most balanced performance across segmentation accuracy, lesion detection, and error control. It improves Dice score (0.7834) and reduces boundary error compared to standard losses. More importantly, it substantially increases small lesion recall and reduces false negatives, while maintaining the lowest false positive volume among compared methods. These findings demonstrate that integrating component-level and lesion-level supervision within a unified objective provides an effective and practical approach for improving small lesion segmentation in highly imbalanced settings. All code and pretrained models are available at \href{https://github.com/luumsk/SmallLesionMRI}{this url}.