OC-VLA++: Monocular Geometry-Guided Cross-View Consistency for Viewpoint-Robust Robotic Manipulation
Tianyi Zhang, Ziyang Gong, Zhenjie Yang, Zhe Qian, Haonan Duan
Abstract
We propose OC-VLA++, an extension of OC-VLA for viewpoint generalization under limited camera coverage. While OC-VLA grounds robot actions in the camera coordinate system to align action supervision with visual observations, camera-space grounding alone can still overfit to the few viewpoints observed during training. OC-VLA++ addresses this limitation by introducing geometry-guided paired-view supervision and an explicit cross-view action-equivariance objective. Given paired observations of the same manipulation scene from geometrically related viewpoints, the model is trained such that their camera-space predictions correspond to the same robot-frame action. This objective explicitly supervises how action predictions should transform across viewpoints, rather than relying solely on image-level augmentation. Experiments demonstrate substantial improvements in unseen-view generalization under limited camera coverage, with performance degrading more gracefully under increasing camera displacement. These results establish cross-view action equivariance as an effective complement to observation-centric action grounding for robust real-world deployment.
Create a lesson
Related papers
rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference
Kaijun Zhou, Zhiyang Li, Le Chen et al.
ElastiQP: An Always-Feasible QP Solver for Constrained Robot Control
Daniel Morton, Jon Arrizabalaga, Zachary Manchester et al.
"What's going to happen after I'm gone?": Parent Perspectives on Technology in Supporting Independent Living for Adults with Intellectual Disabilities
Alexander Tyshka, Andrea Macklem-Zabel, Absalat Getachew et al.
Learning Holistic Whole-Body Loco-Manipulation with a Bipedal Mobile Manipulator
Zhongyu Chen, Yuxuan Nai, Qian Chen et al.
CaSCo: Cascade-Aware Soft-Collision Motion Planning
Shivaram Kumar, Gaoyuan Liu, Yoonchang Sung
Examining the Difference in Human Behavior Between Virtual and Real-World Human-Robot Teaming
Sean Dallas, Absalat Getachew, Motaz AbuHijleh et al.