The Missing Knowledge Layer in AI: A Framework for Stable Human-AI Reasoning

arXiv cs.AI / 4/17/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

共有:

Key Points

The paper argues that large language models can appear confident and fluent even when their internal reasoning is unstable or inconsistent, which is risky in high-stakes domains like healthcare, law, finance, engineering, and government.
It highlights a parallel human problem: users often mistake smooth responses for reliability and may drift alongside the model, causing shared uncertainty to go unnoticed.
The authors propose a two-layer framework to stabilize human-AI reasoning, combining human-side mechanisms (uncertainty cues, conflict surfacing, and auditable reasoning traces) with a model-side Epistemic Control Loop (ECL).
The model-side ECL is designed to detect instability and adjust generation accordingly, with the goal of increasing signal-to-noise at the point of use rather than relying solely on downstream enforcement.
The work positions traceable reasoning under real usage conditions as a missing governance substrate that supports emerging compliance efforts such as the EU AI Act and ISO/IEC 42001.

Abstract

Large language models are increasingly integrated into decision-making in areas such as healthcare, law, finance, engineering, and government. Yet they share a critical limitation: they produce fluent outputs even when their internal reasoning has drifted. A confident answer can conceal uncertainty, speculation, or inconsistency, and small changes in phrasing can lead to different conclusions. This makes LLMs useful assistants but unreliable partners in high-stakes contexts. Humans exhibit a similar weakness, often mistaking fluency for reliability. When a model responds smoothly, users tend to trust it, even when both model and user are drifting together. This paper is the first in a five-paper research series on stabilising human-AI reasoning. The series proposes a two-layer approach: Parts II-IV introduce human-side mechanisms such as uncertainty cues, conflict surfacing, and auditable reasoning traces, while Part V develops a model-side Epistemic Control Loop (ECL) that detects instability and modulates generation accordingly. Together, these layers form a missing operational substrate for governance by increasing signal-to-noise at the point of use. Stabilising interaction makes uncertainty and drift visible before enforcement is applied, enabling more precise capability governance. This aligns with emerging compliance expectations, including the EU AI Act and ISO/IEC 42001, by making reasoning processes traceable under real conditions of use. The central claim is that fluency is not reliability. Without structures that stabilise both human and model reasoning, AI cannot be trusted or governed where it matters most.