Setup-Independent Full Projector Compensation

arXiv cs.CV / 4/3/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces SIComp, a setup-independent framework for full projector compensation that can correct geometric and photometric distortions on nonplanar or textured surfaces without retraining or fine-tuning for new setups.
  • Existing methods are described as highly setup-dependent and limited by small/diverse training data and geometry-correction models that fail to generalize to unseen projector-camera poses and lighting conditions.
  • SIComp uses a co-adaptive architecture that decouples geometry and photometry, employing an optical-flow-based module for online geometric correction and a dedicated photometric network for intensity/color compensation.
  • To improve robustness to changing illumination, the method incorporates intensity-varying surface priors into the photometric network design.
  • The authors report strong generalization results, validated with extensive experiments using a newly built real-world dataset covering 277 distinct projector-camera setups, and they release code and data publicly.

Abstract

Projector compensation seeks to correct geometric and photometric distortions that occur when images are projected onto nonplanar or textured surfaces. However, most existing methods are highly setup-dependent, requiring fine-tuning or retraining whenever the surface, lighting, or projector-camera pose changes. Progress has been limited by two key challenges: (1) the absence of large, diverse training datasets and (2) existing geometric correction models are typically constrained by specific spatial setups; without further retraining or fine-tuning, they often fail to generalize directly to novel geometric configurations. We introduce SIComp, the first Setup-Independent framework for full projector Compensation, capable of generalizing to unseen setups without fine-tuning or retraining. To enable this, we construct a large-scale real-world dataset spanning 277 distinct projector-camera setups. SIComp adopts a co-adaptive design that decouples geometry and photometry: A carefully tailored optical flow module performs online geometric correction, while a novel photometric network handles photometric compensation. To further enhance robustness under varying illumination, we integrate intensity-varying surface priors into the network design. Extensive experiments demonstrate that SIComp consistently produces high-quality compensation across diverse unseen setups, substantially outperforming existing methods in terms of generalization ability and establishing the first generalizable solution to projector compensation. The code and dataset are available on our project page: https://hai-bo-li.github.io/SIComp/