Accelerating New Product Introduction for Visual Quality Inspection via Few-Shot Diffusion-Based Defect Synthesis

arXiv cs.CV / 4/28/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper addresses the lack of labeled defect data in industrial visual inspection during New Product Introduction (NPI), which limits the effectiveness of supervised defect detectors early on.
  • It proposes an end-to-end few-shot diffusion generative framework that synthesizes high-fidelity defects by separating defect morphology from background appearance using masked textual inversion, surface-aware conditioned generation, and gradient-aware post-processing.
  • The method supports both in-domain few-shot augmentation and cross-domain zero-shot transfer, enabling defect models to adapt to new surfaces without target-domain defect labels.
  • Experiments using RF-DETR on a private industrial dataset show large domain-gap reduction, with few-shot mAP improving from 78.8% to 83.3% and zero-shot mAP rising from 65.0% to 85.1%.

Abstract

Industrial visual inspection systems often suffer from a severe scarcity of labeled defect data, particularly during the early stages of New Product Introduction (NPI). This limitation hinders the deployment of robust supervised detectors precisely when automated quality control is most needed. We present an end-to-end generative framework for high-fidelity, few-shot defect synthesis that enables both in-domain augmentation and cross-domain transfer. Our approach disentangles defect morphology from background appearance by combining masked textual inversion for defect representation learning, noise-blended conditioned generation for surface-aware synthesis, and gradient-aware post-processing for seamless visual integration. We evaluate the framework in two practically relevant settings: few-shot data augmentation, where synthetic samples enrich a small set of real defects, and zero-shot adaptation, where defects learned from a source domain are transferred to a novel target surface without any real target-domain defect examples. Using RF-DETR as the downstream detector, we show that the proposed pipeline substantially narrows the domain gap on a private industrial dataset. In the few-shot setting, synthetic augmentation improves mAP from 78.8% to 83.3%. In the zero-shot setting, synthetic domain adaptation improves mAP from 65.0% to 85.1%. These results demonstrate that high-fidelity defect synthesis can meaningfully accelerate NPI by enabling effective inspection models before sufficient real defect data has been collected.