StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observation

arXiv cs.RO / 3/31/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • StreamingVLAは、従来のVision-Language-Action(VLA)モデルが観測→行動生成→実行を逐次処理するために起きる待ち時間と高いレイテンシを、ストリーミング方式で低減することを狙った提案である。
  • 行動生成の遅延と実行の遅延を重ねるために、アクションのチャンク分割に依存せず「action flow matching」を用いて、チャンク単位のデノイズではなくアクションフロー軌跡を学習する設計になっている。
  • さらに「action saliency-aware adaptive observation」により、実行と観測のレイテンシを並列化(オーバーラップ)し、頻繁な停止(halting)を抑えつつ実行の流暢性を維持する。
  • 性能を落とさずに、レイテンシを2.4倍高速化し、実行の halting を6.5倍減らしたと報告している。

Abstract

Vision-language-action (VLA) models have demonstrated exceptional performance in natural language-driven perception and control. However, the high computational cost of VLA models poses significant efficiency challenges, particularly for resource-constrained edge platforms in real-world deployments. However, since different stages of VLA (observation, action generation and execution) must proceed sequentially, and wait for the completion of the preceding stage, the system suffers from frequent halting and high latency. To address this, We conduct a systematic analysis to identify the challenges for fast and fluent generation, and propose enabling VLAs with the ability to asynchronously parallelize across VLA stages in a "streaming" manner. First, we eliminate the reliance on action chunking and adopt action flow matching, which learns the trajectory of action flows rather than denoising chunk-wise actions. It overlaps the latency of action generation and execution. Second, we design an action saliency-aware adaptive observation mechanism, thereby overlapping the latency of execution and observation. Without sacrificing performance, StreamingVLA achieves substantial speedup and improves the fluency of execution. It achieves a 2.4 \times latency speedup and reduces execution halting by 6.5 \times.