Pixel: A Co-Designed Full-Stack Robot System for Learning General-Purpose Mobile Manipulation
Tony Tao, Jason Jingzhou Liu, Ruslan Salakhutdinov, Deepak Pathak
Abstract
General-purpose mobile manipulation requires a combination of capable robot hardware, scalable demonstration collection, expressive whole-body control, and effective policy learning. Yet these components are often developed independently, creating mismatches that limit the capabilities of the complete system. We present Pixel, a co-designed full-stack system for learning general-purpose mobile manipulation. Pixel combines a low-cost wheeled humanoid with human-aligned kinematics and compliant grippers, multiple teleoperation and robot-free human data-collection interfaces, a unified whole-body controller, and a common policy learning pipeline across human and robot demonstrations. A hierarchical learning stack further enables language-conditioned visuomotor control and long-horizon task execution. We evaluate the system across hardware, data collection, and policy learning, and demonstrate mobile-manipulation behaviors requiring dexterity, active perception, navigation, and whole-body coordination. We hope that Pixel provides an integrated and extensible foundation for studying how robot hardware, data, control, and learning can be designed together for robot learning. More results at https://pixel-robot.com/pixel
Create a lesson
Related papers
ActOR: Ambient AI-Based Agentic Orchestration for Humanoid Autonomy in Operating Rooms
Han Zhang, Sicheng Lu, Aleks Santari et al.
DiMuRe: Diagnosis-Guided Multilevel Recovery for Robotic Task Execution
Renkai Yi, Yuwei Wu, Haoyu Zhang et al.
Online iLQR-MPC with Whole-Body Control for Robust Humanoid Locomotion
Xiang Li, Linlin Ou, Ruihan Wu et al.
Grasping and Stabilizing Tumbling Objects with Rotating-Base Multi-Arm Space Manipulators
Farhad Aghili
Online Hamilton-Jacobi Reachability Onboard the Robot Control Loop: A Real-Time GPU Solver for Safety-Critical Autonomy
Kevin Weekly, Alexandre M. Bayen
VARP: A Visual Adaptive Rearrangement Planner for Non-Monotone Object Rearrangement Planning
Hanwen Ren, Meng Zheng, Zhongpai Gao et al.