P-BFM: Perceptive Behavioral Foundation Models for Humanoid Control via Unsupervised Reinforcement Learning
Xue Wang, Yitang Li, Yiming Zhang, Siqin Wang, Junhan Sun, Zhihao Liu, Yaojie Shen, Jingbo Yuan, Hao Zhao, Qingdu Li
Abstract
Behavioral foundation models (BFMs) provide humanoids with reusable repertoires of whole-body behaviors; in real-world humanoid control, the same behavioral intent may require fundamentally different motions under different terrain constraints. Covering such variation with terrain-matched demonstrations requires enumerating a combinatorial space of behaviors and terrain geometries. We introduce P-BFM, a perceptive behavioral foundation model that factorizes humanoid control into terrain-invariant intent and terrain-conditioned realization. A forward-backward representation maps motion references, target states, and reward functions into a shared intent space without terrain information, while a perceptive policy learns how to realize each intent under the surrounding terrain geometry. We further identify a complementary limitation of purely latent control: behavioral latents can preserve local motion patterns while losing precise global progress. We therefore introduce Explicit Root Instructions (ERI), which separates global transport (e.g., heading and planar velocity) from behavioral intent, while leaving local whole-body adaptation to the perceptive policy. This decomposition leads to a characteristic capability absent from conventional BFMs: one fixed intent induces different, terrain-appropriate behaviors, including changes in step height, stride, posture, foothold placement, and contacts, without terrain-specific demonstrations. Across challenging terrains, P-BFM improves motion fidelity, root-control precision, and perturbation recovery over strong baselines. A single frozen policy further supports motion tracking, goal reaching, reward inference, teleoperation, and terrain-aware recovery, and transfers zero-shot to a Unitree G1 using onboard depth sensing.
Create a lesson
Related papers
Design and Analysis of a Nonlinear Parallel Mechanism Coupling for Dynamic Humanoid Legs
Rohit Kumar, Heiner Peters, Felix Wiebe et al.
Learning Reachability-Based Safety Representations for Real-Time Robot Navigation in Unknown and Dynamic Environments
Bojan Derajić
Trust-Calibrated VLA Policy Post-Training with Evolving Imagination
Wenzhan Li, Yiran Qin, Heng Zhou et al.
DeTac: Dual-branch Decoupling of Texture and Force Signals in Vision-Based Tactile Sensors
Zhirui Zhang, Yunkai Tang, Jiahang Li et al.
SHOES: Sim-to-real Hardware-adaptation via On-policy Expansion of Skills for Legged Robots
Kota Tsuruhara, Tsung-Yuan Chen, Kento Kawaharazuka
Estimating the Causal Impact of Social Navigation Signals in Corridor Scenarios
Francesco Baldo, Luca Castri, Gloria Beraldo et al.