Noise Space Learning for VLA Adaptation
Junjie Lu, Chuheng Zhang, Yucen Wang, Yuhua Jiang, Xinyao Qin, Min Xu, Li Zhao
Abstract
Pretrained vision-language-action (VLA) models encode broad manipulation priors, yet adapting them to specific tasks requires balancing limited robot interaction, computational resources, and safety constraints. Noise space learning (NSL) adapts flow-matching-based VLAs by learning a context-conditioned distribution over noise while keeping the pretrained VLA fixed. Building on prior noise-steering methods, we formulate NSL as an interface for VLA adaptation that accommodates different learning algorithms and instantiate it with PPO, SAC, and AWR. Theoretically, we provide an information-theoretic analysis of how NSL enables efficient adaptation. Empirically, we study these NSL algorithms on LIBERO, RoboTwin, and four real-robot manipulation tasks under interaction, computation, and execution constraints. Across these settings, we develop a suite of effective NSL variants and derive practical recommendations for choosing among them under different resource and deployment regimes.
Create a lesson
Related papers
Splat2Act: From Captured Scenes to Personalized VLA Manipulation
Xiaomeng Ye, Krishna Jaganathan, Gyubeum Lim et al.
Chronos Policy: Learning Robot Policies on Physical Time
Changhao Wang, Jaden Clark, Shuran Song
BT-Agent: Deploying Onboard Robot Agents with Behavior Trees and Multi-Fidelity Evaluation
Fabio Hübel, Adam Lilja, Yue Yin et al.
HorizonNav: Geometry-Guided Video Diffusion for Anticipatory 3D Robot Navigation
Hajira Amjad, Valerii Serpiva, Viacheslav Liubimov et al.
Mapless, Stabilizing, and Anti-Stuck Flipper Control for Articulated Tracked Robots
Valentýn Číhala, Pavel Sarga, Martin Pecka et al.
MC-EvoBench: Auditing Experience-Driven Self-Improvement in Minecraft Agents
Jingwei Song, Zhisheng Chen, Bingfan Zeng et al.