Democratizing Robot-Use Agents: A Unified Harness with Open Models
Jiarui Yuan, Yuxin Zuo, Xiaoyu Huang, Wenbo Zhang, Kwanyoung Park, Junlin Yang, Tianxiang Zhang, Ruoqu Chen, Yutao Ouyang, Bingxiang He, Xingtai Lv, Hongjin Wu, Jiajun Liu, Jiahao Zhao, Tianwei Luo, Haozhan Li, Cheng Qian, Jiaxin Ge, Huan-ang Gao, Kaisen Yang, Jiaqi Deng, Qixin Xu, Siqiao Huang, Bowen Zhou, Mengdi Xu, Zhiyuan Liu, Pieter Abbeel, Ning Ding
Abstract
Robot-use Agents (RUAs) have shown promising zero-shot manipulation capabilities, but reliance on frontier, proprietary models limits research into further training. To democratize RUA research, we introduce uni-robot-agent, a unified harness for competitive open-weight robot use that supports further training. Without privileged inputs, an out-of-the-box Qwen3.8-Flash-Next achieves a RoboDojo Score of 31.39, surpassing the published GPT-6 Astra-RoboProbe result of 28.97 and many VLA/WAM baselines, and performs competitively on 19 real-world tasks. Our analysis across model generations, families, and sizes links effective robot use to four general capabilities, suggesting that future RUA training should develop them jointly.
Create a lesson
Related papers
ActOR: Ambient AI-Based Agentic Orchestration for Humanoid Autonomy in Operating Rooms
Han Zhang, Sicheng Lu, Aleks Santari et al.
DiMuRe: Diagnosis-Guided Multilevel Recovery for Robotic Task Execution
Renkai Yi, Yuwei Wu, Haoyu Zhang et al.
Online iLQR-MPC with Whole-Body Control for Robust Humanoid Locomotion
Xiang Li, Linlin Ou, Ruihan Wu et al.
Grasping and Stabilizing Tumbling Objects with Rotating-Base Multi-Arm Space Manipulators
Farhad Aghili
Online Hamilton-Jacobi Reachability Onboard the Robot Control Loop: A Real-Time GPU Solver for Safety-Critical Autonomy
Kevin Weekly, Alexandre M. Bayen
VARP: A Visual Adaptive Rearrangement Planner for Non-Monotone Object Rearrangement Planning
Hanwen Ren, Meng Zheng, Zhongpai Gao et al.