A 3D SAM-Based Progressive Prompting Framework for Multi-Task Segmentation of Radiotherapy-induced Normal Tissue Injuries in Limited-Data Settings

arXiv cs.AI / 4/16/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper addresses automated 3D segmentation of radiotherapy-induced normal tissue injuries, highlighting difficulty from limited voxel-level labels and strong heterogeneity across injury types and imaging modalities.
  • It introduces a curated head-and-neck dataset spanning three manifestations—osteoradionecrosis (ORN), cerebral edema (CE), and cerebral radiation necrosis (CRN)—to support multi-task learning under limited-data conditions.
  • The proposed method uses a 3D SAM-based progressive prompting framework that incrementally adds task-aware text prompts, dose-guided box prompts for coarse localization, and click prompts for iterative refinement.
  • To better handle small and sparse lesions, the framework adds a small-target focus loss aimed at improving local predictions and boundary delineation.
  • Experimental results across ORN, CE, and CRN reportedly outperform existing state-of-the-art approaches while maintaining reliable segmentation performance across multiple injury types.

Abstract

Radiotherapy-induced normal tissue injury is a clinically important complication, and accurate segmentation of injury regions from medical images could facilitate disease assessment, treatment planning, and longitudinal monitoring. However, automatic segmentation of these lesions remains largely unexplored because of limited voxel-level annotations and substantial heterogeneity across injury types, lesion size, and imaging modality. To address this gap, we curate a dedicated head-and-neck radiotherapy-induced normal tissue injury dataset covering three manifestations: osteoradionecrosis (ORN), cerebral edema (CE), and cerebral radiation necrosis (CRN). We further propose a 3D SAM-based progressive prompting framework for multi-task segmentation in limited-data settings. The framework progressively incorporates three complementary prompts: text prompts for task-aware adaptation, dose-guided box prompts for coarse localization, and click prompts for iterative refinement. A small-target focus loss is introduced to improve local prediction and boundary delineation for small and sparse lesions. Experiments on ORN, CE, and CRN demonstrate that the proposed method achieves reliable segmentation performance across diverse injury types and outperforms state-of-the-art methods.