DINOv3 Beats Specialized Detectors: A Simple Foundation Model Baseline for Image Forensics

arXiv cs.CV / 4/20/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes a simple yet strong image-forensics baseline using DINOv3 with LoRA adaptation and a lightweight convolutional decoder, aiming to localize realistic fake images more robustly than prior complex methods.
  • On the CAT-Net protocol, the best model achieves a 17.0-point improvement in average pixel-level F1 over the previous state of the art across four benchmarks, using only 9.1M trainable parameters on top of a frozen ViT-L backbone.
  • Under the data-scarce MVSS-Net protocol, LoRA attains an average F1 of 0.774 compared with 0.530 for the prior best method, while full fine-tuning is reported to be unstable, implying that pre-trained representations carry valuable forensic cues.
  • The baseline remains robust to common distortions including Gaussian noise, JPEG re-compression, and Gaussian blur, and the authors provide released code for reproducibility and as a starting point for future work.

Abstract

With the rapid advancement of deep generative models, realistic fake images have become increasingly accessible, yet existing localization methods rely on complex designs and still struggle to generalize across manipulation types and imaging conditions. We present a simple but strong baseline based on DINOv3 with LoRA adaptation and a lightweight convolutional decoder. Under the CAT-Net protocol, our best model improves average pixel-level F1 by 17.0 points over the previous state of the art on four standard benchmarks using only 9.1\,M trainable parameters on top of a frozen ViT-L backbone, and even our smallest variant surpasses all prior specialized methods. LoRA consistently outperforms full fine-tuning across all backbone scales. Under the data-scarce MVSS-Net protocol, LoRA reaches an average F1 of 0.774 versus 0.530 for the strongest prior method, while full fine-tuning becomes highly unstable, suggesting that pre-trained representations encode forensic information that is better preserved than overwritten. The baseline also exhibits strong robustness to Gaussian noise, JPEG re-compression, and Gaussian blur. We hope this work can serve as a reliable baseline for the research community and a practical starting point for future image-forensic applications. Code is available at https://github.com/Irennnne/DINOv3-IML.