Seeing Through the Illusion: Test-Time Scaling for World Action Models
Cheikh Ahmed, Mahdi Mostajabdaveh, Milad Yazdani, Zirui Zhou
Abstract
World action models (WAMs) jointly generate actions and imagined futures, but a plausible prediction need not be realized by its co-generated action. We introduce WISE (World Action Inference Scaling through Evaluation), a pre-execution selector that scores each sampled rollout on action validity and temporal regularity, inverse-dynamics consistency between the proposed action and the imagined motion, and instruction-conditioned task progress, and executes the highest-scoring candidate while keeping the WAM frozen. With four candidates per decision, WISE raises closed-loop success from 6.0\% to 24.0\% on RoboLab with Cosmos~3 Edge and from 75.1\% to 78.3\% mean success on LIBERO with DreamZero, and exceeds the best existing selector in aggregate by 4.0 and 0.9 points. Component ablations and agreement analyses show that the three scores rank candidates differently and that task progress carries the largest weight in the fused decision.
Create a lesson
Related papers
ActOR: Ambient AI-Based Agentic Orchestration for Humanoid Autonomy in Operating Rooms
Han Zhang, Sicheng Lu, Aleks Santari et al.
DiMuRe: Diagnosis-Guided Multilevel Recovery for Robotic Task Execution
Renkai Yi, Yuwei Wu, Haoyu Zhang et al.
Online iLQR-MPC with Whole-Body Control for Robust Humanoid Locomotion
Xiang Li, Linlin Ou, Ruihan Wu et al.
Grasping and Stabilizing Tumbling Objects with Rotating-Base Multi-Arm Space Manipulators
Farhad Aghili
Online Hamilton-Jacobi Reachability Onboard the Robot Control Loop: A Real-Time GPU Solver for Safety-Critical Autonomy
Kevin Weekly, Alexandre M. Bayen
VARP: A Visual Adaptive Rearrangement Planner for Non-Monotone Object Rearrangement Planning
Hanwen Ren, Meng Zheng, Zhongpai Gao et al.