Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery

arXiv cs.RO / 5/5/2026

📰 NewsDeveloper Stack & InfrastructureSignals & Early TrendsModels & Research

共有:

Key Points

The paper introduces Sentinel-VLA, a vision-language-action model that uses a metacognitive “sentinel” module to monitor real-time execution status.
Sentinel-VLA performs dynamic reasoning and error recovery only when needed (e.g., during initial planning or after detecting errors), aiming to improve robustness while reducing compute overhead.
The approach relies on an automated training-data pipeline covering 44 tasks and over 2.6 million transitions, with data generated and annotated by the proposed system.
The work adds two learning components—Self-Evolving Continual Learning (SECL) to identify capability boundaries and gather new data, and Orthogonal Continual Adapter (OC-Adapter) to limit parameter updates and mitigate catastrophic forgetting.
In real-world experiments, Sentinel-VLA reportedly improves task success rate by more than 30% versus the prior state-of-the-art model PI0, and the authors plan to open-source code, weights, and the data-generation pipeline.

Abstract

Vision-language-action (VLA) models have advanced the field of embodied manipulation by harnessing broad world knowledge and strong generalization. However, current VLA models still face several key challenges, including limited reasoning capability, lack of status monitoring, and difficulty in self-correction. In this paper, we introduce \textbf{Sentinel-VLA}, a metacognitive VLA model equipped with an active ``sentinel'' module to monitor real-time execution status. Only when necessary, such as during initial planning or upon detecting an error, the model triggers a dynamic reasoning or formulate error recovery solutions. This on-demand reasoning mechanism ensures robust decision-making while minimizing computational overhead. Notably, all training data (spanning 44 tasks and over 2.6 million transitions) is automatically generated and annotated through our designed pipeline. We also propose the Self-Evolving Continual Learning (SECL) algorithm, which allows Sentinel-VLA to identify its capability boundaries and automatically collect data for expansion, paired with Orthogonal Continual Adapter (OC-Adapter) to constrain parameter updates to an orthogonal space, thereby preventing catastrophic forgetting. Real-world experiments demonstrate that Sentinel-VLA boosts the task success rate by over 30\% compared to the SOTA model, PI0. We will open-source all the code, weights, and data generation pipeline.