AI Navigate

RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation

arXiv cs.CV / 3/13/2026

📰 NewsSignals & Early TrendsModels & Research

Key Points

  • RC-NF provides real-time anomaly detection and intervention for VLA-based robotic systems, aligning the robot's state and the object's trajectory with the task requirements.
  • It uses a robot-conditioned normalizing flow that decouples processing of task-aware robot and object states and trains with only positive samples for unsupervised learning, enabling anomaly scores from the probability density function.
  • LIBERO-Anomaly-10 benchmarks three categories of robotic anomalies and RC-NF achieves state-of-the-art performance across anomaly types in simulation.
  • Real-world experiments show RC-NF operates as a plug-and-play module for VLA models (e.g., pi0) with sub-100 ms latency, enabling state rollback or task replanning when needed.

Abstract

Recent advances in Vision-Language-Action (VLA) models have enabled robots to execute increasingly complex tasks. However, VLA models trained through imitation learning struggle to operate reliably in dynamic environments and often fail under Out-of-Distribution (OOD) conditions. To address this issue, we propose Robot-Conditioned Normalizing Flow (RC-NF), a real-time monitoring model for robotic anomaly detection and intervention that ensures the robot's state and the object's motion trajectory align with the task. RC-NF decouples the processing of task-aware robot and object states within the normalizing flow. It requires only positive samples for unsupervised training and calculates accurate robotic anomaly scores during inference through the probability density function. We further present LIBERO-Anomaly-10, a benchmark comprising three categories of robotic anomalies for simulation evaluation. RC-NF achieves state-of-the-art performance across all anomaly types compared to previous methods in monitoring robotic tasks. Real-world experiments demonstrate that RC-NF operates as a plug-and-play module for VLA models (e.g., pi0), providing a real-time OOD signal that enables state-level rollback or task-level replanning when necessary, with a response latency under 100 ms. These results demonstrate that RC-NF noticeably enhances the robustness and adaptability of VLA-based robotic systems in dynamic environments.