Synthetic Data Generation for Long-Tail Medical Image Classification: A Case Study in Skin Lesions

arXiv cs.CV / 5/6/2026

📰 NewsDeveloper Stack & InfrastructureIdeas & Deep AnalysisModels & Research

Key Points

  • The study tackles long-tailed medical image classification, where deep learning models often perform poorly on rare classes that are clinically high-risk.
  • It proposes a diffusion-model-driven synthetic data augmentation pipeline using a novel inpainting diffusion model plus an out-of-distribution (OOD) post-selection step to produce diverse, realistic, and clinically meaningful samples.
  • Experiments on the ISIC2019 skin lesion dataset show substantial overall performance gains, with especially large improvements for tail classes, including over 28% improvement for the class with the fewest samples.
  • The findings suggest diffusion-based augmentation can better mitigate class imbalance than prior approaches like rebalanced losses or deterministic handcrafted augmentation, and can improve robustness in medical settings.
  • Overall, the work presents a scalable way to generate synthetic data that targets minority classes without sacrificing clinical plausibility.

Abstract

Long-tailed class distributions are pervasive in multi-class medical datasets and pose significant challenges for deep learning models which typically underperform on tail classes with limited samples. This limitation is particularly problematic in medical applications, where rare classes often correspond to severe or high-risk diseases and therefore require high diagnostic accuracy. Existing solutions-including specialized architectures, rebalanced loss functions, and handcrafted data augmentation-offer only marginal improvements and struggle to scale due to their limited and largely deterministic variability. To address these challenges, we introduce a diffusion-model-driven synthetic data augmentation pipeline tailored for medical long-tailed classification. Our approach features a novel inpainting diffusion model combined with an Out-of-Distribution (OOD) post-selection mechanism to ensure diverse, realistic, and clinically meaningful synthetic samples. Evaluated on the ISIC2019 skin lesion classification dataset, one of the largest and most imbalanced medical imaging benchmarks, our method yields substantial improvements in overall performance, with particularly pronounced gains on tail classes with more than 28\% improvement on the class with the fewest samples. These results demonstrate the effectiveness of diffusion-based augmentation in mitigating long-tail imbalance and enhancing medical classification robustness.