Learning Sparse BRDF Measurement Samples from Image

arXiv cs.CV / 4/30/2026

📰 NewsDeveloper Stack & InfrastructureIdeas & Deep AnalysisModels & Research

Key Points

  • The paper addresses the challenge of accurate BRDF acquisition by replacing slow, dense gonioreflectometer scans with a method that selects only a small number of informative BRDF measurement directions.
  • It proposes a learnable sampling strategy trained using gradients from both BRDF-space loss and rendered-image loss, while keeping a pretrained hypernetwork-based BRDF reconstructor fixed during sampler training.
  • The approach combines a set encoder for sparse coordinate–value observations, a pretrained reconstruction model, and a differentiable renderer to support end-to-end optimization of measurement locations.
  • Experiments on the MERL dataset show improved reconstruction quality at very low budgets (8 and 16 measurements) over neural reconstruction baselines, with PCA remaining competitive at higher measurement counts.
  • The authors also study how design choices such as image-space supervision, co-optimization, and image-only latent fitting affect performance on unseen materials.

Abstract

Accurate BRDF acquisition is important for realistic rendering, but dense gonioreflectometer measurements are slow and expensive. We study how to select a small number of BRDF measurements that are most useful for reconstructing material appearance under a learned reflectance prior. Our method combines a set encoder for sparse coordinate-value observations, a pretrained hypernetwork-based BRDF reconstructor, and a differentiable renderer. During sampler training, the reconstructor is kept fixed and gradients from BRDF-space and rendered-image losses are used to optimize measurement locations. This separates sample selection from prior fitting and encourages the sampler to choose directions that are informative under the learned material distribution. Experiments on the MERL dataset show that the proposed sampler improves low-budget reconstruction quality at 8 and 16 measurements compared with neural reconstruction baselines, while PCA-based methods remain strong at larger budgets. We further analyze the effect of image-space supervision, co-optimization, and image-only latent fitting for unseen materials.