The $\textit{Silicon Society}$ Cookbook: Design Space of LLM-based Social Simulations

arXiv cs.AI / 5/4/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper argues that although LLM-based “Silicon Societies” for simulating human behavior are increasing, their design space remains insufficiently studied, limiting how well realism can be validated.
  • It presents a systematic analysis of how major design choices—especially the base model for individual agents and the way agents are connected—affect outcomes in simulated social networks.
  • The study uses surveys as a proxy for agent opinions to evaluate consequences and interactions among different design parameters.
  • Results show that the design space has a non-trivial structure: some parameters combine in roughly additive ways, while others produce more complex interactions.
  • The choice of the base LLM is identified as the most influential factor driving differences in simulation outcomes.

Abstract

Studies attempting to simulate human behavior with \textit{Silicon Societies} grow in numbers while LLM-only social networks have started appearing outside of controlled settings. However, the design space of these networks remains under-studied, which contributes to a gap in validating model realism. To enable future works to make more informed design decisions, we perform a systematic analysis of the consequences and interactions of key design choices in simulated social networks, including the choice of base model used to model individual agents, and how they are connected to each other. Using surveys as a proxy for agent opinions, our findings suggest that the geometry of the design space is non-trivial, with some parameters behaving in additive ways while others display more complex interactions. In particular, the choice of the base LLM is the most important variable impacting the simulation outcomes.