SCOUT: Planning under Occlusion via Object-Centric World Model Rollouts
Amir Hossain Raj, Xuesu Xiao
Abstract
Robots manipulating in cluttered spaces must often plan from partial views where foreground objects occlude the target, surrounding geometry, and usable free space. Reactive policies often miss these hidden constraints, while exhaustive search becomes computationally prohibitive in dense clutter. We present SCOUT, an occlusion-aware planning framework that bridges high-level deliberation with grounded physical rollouts. SCOUT leverages an object-centric scene representation to reconstruct hidden geometry and derive a relational planning state capturing blocker hierarchies and accessibility corridors. To navigate the vast action space in clutter, an LLM proposes structured action candidates which are then rigorously evaluated via Monte Carlo Tree Search (MCTS) using a learned action-conditioned world model. Evaluations on 'Reveal' and 'Placement' tasks show that SCOUT outperforms Vision-Language-Action (VLA) policies, embodied agents, and 3D world models, with significant gains in long-horizon tasks requiring reasoning over occluded geometry. We further validate the framework's robustness through real-world robotic manipulation in a cluttered shelf environment.
Create a lesson
Related papers
ActOR: Ambient AI-Based Agentic Orchestration for Humanoid Autonomy in Operating Rooms
Han Zhang, Sicheng Lu, Aleks Santari et al.
DiMuRe: Diagnosis-Guided Multilevel Recovery for Robotic Task Execution
Renkai Yi, Yuwei Wu, Haoyu Zhang et al.
Online iLQR-MPC with Whole-Body Control for Robust Humanoid Locomotion
Xiang Li, Linlin Ou, Ruihan Wu et al.
Grasping and Stabilizing Tumbling Objects with Rotating-Base Multi-Arm Space Manipulators
Farhad Aghili
Online Hamilton-Jacobi Reachability Onboard the Robot Control Loop: A Real-Time GPU Solver for Safety-Critical Autonomy
Kevin Weekly, Alexandre M. Bayen
VARP: A Visual Adaptive Rearrangement Planner for Non-Monotone Object Rearrangement Planning
Hanwen Ren, Meng Zheng, Zhongpai Gao et al.