IAD-Unify: A Region-Grounded Unified Model for Industrial Anomaly Segmentation, Understanding, and Generation

arXiv cs.CV / 4/15/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • IAD-Unify is a proposed dual-encoder unified vision-language framework that jointly supports industrial anomaly segmentation, region-grounded natural-language understanding, and controlled defect edit generation within one architecture and evaluation setup.
  • The method uses a frozen DINOv2-based region expert to provide precise anomaly evidence to a shared Qwen3.5-4B vision-language backbone via lightweight token injection, enabling mask-guided generation.
  • To standardize comparison across tasks, the authors introduce Anomaly-56K, a unified multi-task evaluation platform with 59,916 images spanning 24 categories and 104 defect variants.
  • Experiments show that region grounding is critical for understanding (removing it drops location accuracy by over 76 percentage points) and that region-grounded generation improves full-image fidelity and masked-region perceptual quality.
  • IAD-Unify also demonstrates strong performance on the MMAD benchmark, including generalization to categories unseen during training, suggesting robust cross-category transfer.

Abstract

Real-world industrial inspection requires not only localizing defects, but also explaining them in natural language and generating controlled defect edits. However, existing approaches fail to jointly support all three capabilities within a unified framework and evaluation protocol. We propose IAD-Unify, a dual-encoder unified framework in which a frozen DINOv2-based region expert supplies precise anomaly evidence to a shared Qwen3.5-4B vision-language backbone via lightweight token injection, jointly enabling anomaly segmentation, region-grounded understanding, and mask-guided generation. To enable unified evaluation, we further construct Anomaly-56K, a comprehensive unified multi-task IAD evaluation platform, spanning 59,916 images across 24 categories and 104 defect variants. Controlled ablations yield four findings: (i) region grounding is the decisive mechanism for understanding, removing it degrades location accuracy by >76 pp; (ii) predicted-region performance closely matches oracle, confirming deployment viability; (iii) region-grounded generation achieves the best full-image fidelity and masked-region perceptual quality; and (iv) pre-initialized joint training improves understanding at negligible generation cost (-0.16 dB). IAD-Unify further achieves strong performance on the MMAD benchmark, including categories unseen during training, demonstrating robust cross-category generalization.