OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation

arXiv cs.RO / 4/21/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper addresses the high latency of autoregressive Chain-of-Thought (CoT) reasoning in vision-language-action (VLA) autonomous driving by proposing a one-step latent alternative.
  • It introduces OneVL, a unified VLA plus world model framework that compresses reasoning into compact latent tokens trained with dual auxiliary decoders.
  • Unlike prior latent CoT approaches that rely mainly on linguistic representations, OneVL adds a visual world model decoder to predict future-frame tokens and embed causal road-and-agent dynamics into the latent space.
  • A three-stage training pipeline progressively aligns latent tokens with trajectory, language, and visual objectives for stable joint optimization, and inference discards the auxiliary decoders while using a single parallel pass.
  • On four benchmarks, OneVL is reported to be the first latent CoT method to outperform explicit CoT, achieving state-of-the-art accuracy at answer-only latency.

Abstract

Chain-of-Thought (CoT) reasoning has become a powerful driver of trajectory prediction in VLA-based autonomous driving, yet its autoregressive nature imposes a latency cost that is prohibitive for real-time deployment. Latent CoT methods attempt to close this gap by compressing reasoning into continuous hidden states, but consistently fall short of their explicit counterparts. We suggest that this is due to purely linguistic latent representations compressing a symbolic abstraction of the world, rather than the causal dynamics that actually govern driving. Thus, we present OneVL (One-step latent reasoning and planning with Vision-Language explanations), a unified VLA and World Model framework that routes reasoning through compact latent tokens supervised by dual auxiliary decoders. Alongside a language decoder that reconstructs text CoT, we introduce a visual world model decoder that predicts future-frame tokens, forcing the latent space to internalize the causal dynamics of road geometry, agent motion, and environmental change. A three-stage training pipeline progressively aligns these latents with trajectory, language, and visual objectives, ensuring stable joint optimization. At inference, the auxiliary decoders are discarded and all latent tokens are prefilled in a single parallel pass, matching the speed of answer-only prediction. Across four benchmarks, OneVL becomes the first latent CoT method to surpass explicit CoT, delivering state-of-the-art accuracy at answer-only latency, and providing direct evidence that tighter compression, when guided in both language and world-model supervision, produces more generalizable representations than verbose token-by-token reasoning. Project Page: https://xiaomi-embodied-intelligence.github.io/OneVL