Across the Levels of Analysis: Explaining Predictive Processing in Humans Requires More Than Machine-Estimated Probabilities

arXiv cs.CL / 4/13/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper uses Marr’s levels of analysis to critique two common claims linking language processing to probabilistic prediction and suggesting psycholinguistic advances depend on large language models (LLMs).
  • It argues that explaining human predictive processing requires more than machine-estimated probabilities derived from language models.
  • The authors extend the discussion on how prediction is central to language processing, while questioning simplistic mappings between model likelihoods and human cognition.
  • The work proposes future research directions that integrate strengths of LLMs with psycholinguistic models to better account for human language behavior.

Abstract

Under the lens of Marr's levels of analysis, we critique and extend two claims about language models (LMs) and language processing: first, that predicting upcoming linguistic information based on context is central to language processing, and second, that many advances in psycholinguistics would be impossible without large language models (LLMs). We further outline future directions that combine the strengths of LLMs with psycholinguistic models.