Tactile-Guided Robot Learning: From Representation Learning to Foundation Models
Kiyanoush Nazari, Luchen Li, Haoshu Fang, Nima Fazeli, Zhibin Li, Fumiya Iida, Thomas George Thuruthel
Abstract
Tactile sensing is becoming central to robust, adaptive, and dexterous robotic manipulation. Beyond its traditional role in contact detection and reactive control, touch is increasingly used to learn transferable representations, condition manipulation policies, and support embodied physical reasoning. Yet existing surveys largely emphasize tactile hardware and perception, leaving the rapid shift toward learning-based tactile manipulation insufficiently synthesized. This paper reviews tactile-guided skill learning from a learning-centric perspective, organized by the functional role of touch across the learning and control pipeline. We examine tactile representation and policy learning, tactile foundation models, predictive and adaptive control, and generalization across objects, tasks, sensors, embodiments, and simulation-to-real transfer. Across these directions, we identify common design principles and remaining challenges in learning transferable physical representations, integrating semantic reasoning with contact-level control, and scaling tactile learning across heterogeneous data and hardware. Finally, we outline emerging directions toward tactile foundation and world models that can predict, reason about, and adapt physical interactions. Together, this review characterizes the transition of touch from a task-specific feedback signal toward a core modality for general-purpose embodied intelligence. An accompanying database of the reviewed literature and associated resources is available at https://sites.google.com/view/touch-in-robot-learning-review.
Create a lesson
Related papers
SafeDriveVLA: Navigation-Conditioned World Model Dreaming for Conflict-Aware End-to-End Autonomous Driving
Shaoyuan Xie, Zihan Zhang, Jingxuan Wang et al.
Hierarchical Residual Policy Learning for Real-World Mobile Manipulation with Sparse Human Guidance
Zhefei Gong, Hefeifei Jiang, Zehao Wang et al.
Modeling and Understanding Neural Weights of Humanoid Policies with Diffusion
Huixuan Cheng, Bike Zhang, Shankar Sastry et al.
CoWear: Towards Collaborative Wearable Inertial Localization with Multiple Smart Devices
Zhuoyuan She, Zhanpeng Zhang, Yapeng Chen et al.
PingpongDuo: Agile Humanoid Table Tennis Doubles with Safe Team Coordination
Haoran Jiang, Yichao Zhong, Kai Zhang et al.
KinoGen: Customizable Humanoid Loco-Manipulation References via Kinematically Grounded Video Generation
Qi Wu, Lulu Zhao, Sanghyun Hahn et al.