Few-shot拡散モデルによる欠陥合成で実現する、視覚品質検査の新製品導入(NPI)加速

arXiv cs.CV / 2026/4/28

📰 ニュースIdeas & Deep AnalysisModels & Research

要点

  • 本論文は、新製品導入(NPI)初期に起きやすい産業用のラベル付き欠陥データ不足が、教師ありの欠陥検出器の導入を妨げる問題を扱っています。
  • 欠陥の形状を背景の見えから分離し、masked textual inversion、表面対応の条件付き生成、勾配を考慮した後処理を組み合わせることで、高忠実度な欠陥のfew-shot合成を行うエンドツーエンドの枠組みを提案しています。
  • 同手法は、同一ドメインでのfew-shotデータ拡張と、ターゲット表面に対するターゲット側の欠陥ラベルなしのzero-shot転移という両方の用途に対応します。
  • RF-DETRを下流検出器として私有の産業データセットで評価した結果、ドメインギャップが大きく縮小し、few-shotではmAPが78.8%から83.3%に、zero-shotではmAPが65.0%から85.1%に改善しました。

Abstract

Industrial visual inspection systems often suffer from a severe scarcity of labeled defect data, particularly during the early stages of New Product Introduction (NPI). This limitation hinders the deployment of robust supervised detectors precisely when automated quality control is most needed. We present an end-to-end generative framework for high-fidelity, few-shot defect synthesis that enables both in-domain augmentation and cross-domain transfer. Our approach disentangles defect morphology from background appearance by combining masked textual inversion for defect representation learning, noise-blended conditioned generation for surface-aware synthesis, and gradient-aware post-processing for seamless visual integration. We evaluate the framework in two practically relevant settings: few-shot data augmentation, where synthetic samples enrich a small set of real defects, and zero-shot adaptation, where defects learned from a source domain are transferred to a novel target surface without any real target-domain defect examples. Using RF-DETR as the downstream detector, we show that the proposed pipeline substantially narrows the domain gap on a private industrial dataset. In the few-shot setting, synthetic augmentation improves mAP from 78.8% to 83.3%. In the zero-shot setting, synthetic domain adaptation improves mAP from 65.0% to 85.1%. These results demonstrate that high-fidelity defect synthesis can meaningfully accelerate NPI by enabling effective inspection models before sufficient real defect data has been collected.