FlashVLA: Streaming Action Decoding for Fast and Asynchronous VLA Inference
Zekai Li, Jiaming Tang, Zhijian Liu
Abstract
Vision-Language-Action (VLA) models are increasingly promising for robotic manipulation, yet their real-world deployment remains bottlenecked by high inference latency and unstable asynchronous execution. This challenge is particularly pronounced in flow-matching-based VLA models, where action decoding requires multiple iterative steps conditioned on the VLM context. While efficient inference methods improve control frequency and asynchronous methods reduce execution idle time, existing approaches often fail to jointly achieve low-latency inference and accurate, temporally consistent asynchronous execution. We introduce FlashVLA, a streaming action decoding framework that addresses both challenges in a unified formulation. FlashVLA maintains a streaming action buffer with multiple chunks at different noise levels and decodes them using chunk-wise causal attention. This design allows FlashVLA to produce one executable action chunk per inference step. Moreover, its chunk-wise autoregressive formulation implicitly preserves action continuity, enabling smooth asynchronous execution without extra future-state conditioning. Across extensive simulated and real-world experiments, FlashVLA substantially improves inference speed while maintaining strong task performance. It can achieve ≥30\,Hz control frequency on a single GPU with smooth asynchronous inference in real-world deployment.
Create a lesson
Related papers
CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators
Kechen Liu, Ola Shorinwa
Embodied Scene Rearrangement Planning
Canzhi Chen, Zan Wang, Siqi Zhu et al.
STEP: State-Aware Task Estimation and Planning with Multi-Modal LLMs for Human-Robot Collaboration
Maitrey Gramopadhye, Prakash Baskaran, Xiao Liu et al.
Tensegrity Continuum Robots Enable Task-Adaptive Morphologies for Cooperative Behaviors
Mahmud Hasan Saikot, Sydney Spiegel, Sudheera Akalanka Kariyawasam et al.
Task-space model-based control of pneumatic soft actuators
Nithin S. Kumar, Joshua Gaston, D. Caleb Rucker et al.
Planning a Shared Modular Fixture Layout Across Robotic Disassembly Stages
Haohui Pan, Takuya Kiyokawa, Kensuke Harada