Calibrated Surprise: An Information-Theoretic Account of Creative Quality

arXiv cs.AI / 4/30/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper argues that high-quality creative writing arises from “calibrated surprise,” where multiple constraint dimensions jointly narrow the feasible solution space so the final choices appear hard to predict without constraints.
  • It formalizes “calibrated” and “surprise” using information theory, interpreting calibrated behavior as conditional entropy approaching zero and surprise as increasing entropy, with mutual information as the key measure.
  • The authors provide both a static view (combined constraints across ethos, mythos, lexis, and dianoia sharply collapse admissible options) and a dynamic view (sequential choices constrain what comes next, naturally changing each choice’s information contribution without manual weighting).
  • Case studies and “lightweight” LLM log-probability computations are used to show the framework can be operationalized, supporting the foundations for Creative Quality Alignment (CQA) and an associated professional evaluation benchmark.

Abstract

The essence of good creative writing is calibrated surprise: when constraints from all relevant dimensions act together, the feasible solution space collapses into a narrow region, and the surviving choices look least predictable from an unconstrained view. "Calibrated" has a precise meaning: the author's intent, the reader's reasonable expectation, and the logic of reality converge. When these three independent judgements agree on every dimension, the set of admissible writing choices is forced into a very small region. A mathematical corollary follows: full-dimensional accuracy and mediocrity are mutually exclusive -- two sides of one constraint structure, not separate goals. We use Shannon's mutual information I(X;Y) = H(X) - H(X|Y) as our analysis tool. "Calibrated" corresponds to conditional entropy going to zero; "surprise" to entropy going up; mutual information is the precise measure of the joint quantity. The argument rests on two pillars. Static: when constraints from ethos, mythos, lexis, and dianoia are imposed together, the admissible set collapses sharply, and surviving solutions show up as low-probability choices from an unconstrained view. Dynamic: the chain rule shows each writing choice is constrained by what came before and constrains what comes after; macro-level decisions naturally contribute a larger share of information, removing the need for hand-tuned weighting. Through case studies and lightweight LLM-logprob computations, we show the framework is both analytically useful and operational, laying the theoretical groundwork for Creative Quality Alignment (CQA) and a professional evaluation benchmark.