SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation

arXiv cs.CL / 4/10/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces SYN-DIGITS, a synthetic control–inspired calibration framework to reduce bias and miscalibration in LLM-based digital twin (AI persona) simulations.
  • SYN-DIGITS is designed as a model-agnostic post-processing layer on top of any LLM simulator, learning latent structure from digital-twin responses and aligning predictions to human ground truth.
  • The authors develop a latent factor model and provide conditions (latent space alignment) that explain when calibration will succeed, aiming for theoretical grounding beyond empirical tuning.
  • Extensive evaluation compares ten calibration approaches across thirteen persona constructions, three LLMs, and two datasets, covering both individual-level and distributional simulations for unseen questions and populations.
  • Reported results show up to 50% relative gains in individual-level correlation and 50–90% relative reductions in distributional discrepancy versus uncalibrated baselines, with provable error guarantees.

Abstract

AI-based persona simulation -- often referred to as digital twin simulation -- is increasingly used for market research, recommender systems, and social sciences. Despite their flexibility, large language models (LLMs) often exhibit systematic bias and miscalibration relative to real human behavior, limiting their reliability. Inspired by synthetic control methods from causal inference, we propose SYN-DIGITS (SYNthetic Control Framework for Calibrated DIGItal Twin Simulation), a principled and lightweight calibration framework that learns latent structure from digital-twin responses and transfers it to align predictions with human ground truth. SYN-DIGITS operates as a post-processing layer on top of any LLM-based simulator and thus is model-agnostic. We develop a latent factor model that formalizes when and why calibration succeeds through latent space alignment conditions, and we systematically evaluate ten calibration methods across thirteen persona constructions, three LLMs, and two datasets. SYN-DIGITS supports both individual-level and distributional simulation for previously unseen questions and unobserved populations, with provable error guarantees. Experiments show that SYN-DIGITS achieves up to 50% relative improvements in individual-level correlation and 50--90% relative reductions in distributional discrepancy compared to uncalibrated baselines.