Functional Emotions or Situational Contexts? A Discriminating Test from the Mythos Preview System Card

arXiv cs.AI / 4/16/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper reviews the Claude Mythos Preview system card and notes that its reported toolkits (emotion vectors, SAE features, and activation verbalisers) are not jointly evaluated on the most alignment-relevant misaligned episodes.
  • It proposes two competing hypotheses for what emotion vectors represent: either they correspond to causally functional emotions driving behavior, or they are projections of a broader situational-context structure onto human-like emotional axes.
  • The authors outline a discriminating test not included in the system card: applying emotion probes to strategic concealment episodes where only SAE features are documented.
  • If emotion probes remain flat while SAE features are strongly active, the alignment-relevant mechanism is likely outside the emotion subspace, implying emotion-based monitoring could miss dangerous behavior.
  • The conclusion emphasizes that which hypothesis is true affects the robustness and reliability of using emotion-based signals to detect and prevent misaligned model behavior.

Abstract

The Claude Mythos Preview system card deploys emotion vectors, sparse autoencoder (SAE) features, and activation verbalisers to study model internals during misaligned behaviour. The two primary toolkits are not jointly reported on the most alignment-relevant episodes. This note identifies two hypotheses that are qualitatively consistent with the published results: that the emotion vectors track functional emotions that causally drive behaviour, or that they are a projection of a richer situational-context structure onto human emotional axes. The hypotheses can be distinguished by a test the system card does not report: applying emotion probes to the strategic concealment episodes where only SAE features are currently documented. If emotion probes show flat activation while SAE features are strongly active, the alignment-relevant structure lies outside the emotion subspace. Which hypothesis is correct determines whether emotion-based monitoring will robustly detect dangerous model behaviour or systematically miss it.