AtlasVLA: Persistent World-Ego State Modeling for Vision-Language-Action Models
Guiyu Zhao, Longteng Guo, Yanghong Mei, Zilin Zhu, Yu Zhang, Bin Cao, Mingming Yu, Xingjian He, Jie Jiang, Jing Liu
Abstract
While Vision-Language-Action (VLA) models have advanced embodied AI, their fundamentally reactive paradigm severely limits performance in partially observable and long-horizon tasks. When restricted to a single wrist-mounted camera, they inevitably suffer from perception forgetting as objects exit the field of view, and temporal task-progress forgetting during multi-step execution. To overcome these bottlenecks, we propose AtlasVLA, a novel framework that transitions from direct reactive manipulation to proactive reasoning through a persistent world-ego state. AtlasVLA features a dual-memory architecture: a 4D Persistent World State Memory that lifts transient 2D observations into a globally updated, voxel-hashed spatial state to resolve visual blind spots, and an Ego-Working State Memory that tracks historical ego state and task progress. By conditioning a diffusion transformer (DiT) on this joint World-Ego state, AtlasVLA enables robust spatial reasoning. Extensive evaluations across LIBERO, RLBench, and real-world benchmarks demonstrate that AtlasVLA achieves state-of-the-art performance using solely a wrist camera. Remarkably, it decisively outperforms multi-view baselines, yielding absolute success rate improvements of 9.4% on LIBERO-Long and 17.5% in real-world long-horizon tasks.
Create a lesson
Related papers
rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference
Kaijun Zhou, Zhiyang Li, Le Chen et al.
ElastiQP: An Always-Feasible QP Solver for Constrained Robot Control
Daniel Morton, Jon Arrizabalaga, Zachary Manchester et al.
"What's going to happen after I'm gone?": Parent Perspectives on Technology in Supporting Independent Living for Adults with Intellectual Disabilities
Alexander Tyshka, Andrea Macklem-Zabel, Absalat Getachew et al.
Learning Holistic Whole-Body Loco-Manipulation with a Bipedal Mobile Manipulator
Zhongyu Chen, Yuxuan Nai, Qian Chen et al.
CaSCo: Cascade-Aware Soft-Collision Motion Planning
Shivaram Kumar, Gaoyuan Liu, Yoonchang Sung
Examining the Difference in Human Behavior Between Virtual and Real-World Human-Robot Teaming
Sean Dallas, Absalat Getachew, Motaz AbuHijleh et al.