ADAPT: Audio-Depth Action Planning with Transition-Aware Rewards for Lights-Out Industrial Navigation
Wenjun Huang, Shenghao Fu, Yian Jin, Yang Ni, Yifan Li, Lichi Li, Xingjian Diao, Pengfei Zhang, Yutong Song, Hanning Chen, Jiarui Cui, Tianyu Yang, Shilong Li, Yu Kong, Mohsen Imani
Abstract
Vision-language-action models for embodied navigation typically rely on RGB observations, limiting their applicability in lights-out industrial environments where visible illumination may be unavailable. We study illumination-independent navigation using spatial audio for target localization and depth for obstacle-aware geometry. To support this setting, we introduce DarkNav-Bench, a benchmark with 24 industrial scenes and four progressively challenging acoustic conditions. We further propose ADAPT, an audio-depth action-planning framework equipped with spatial-audio perception and optimized for closed-loop navigation through reinforcement learning (RL). Our key RL contribution, transition-aware reward shaping (TARS), defines a pose-aware shortest-action potential over a position-heading graph. Unlike conventional geodesic-progress rewards, TARS accounts for both feasible movements and in-place rotations, providing action-consistent feedback for policy optimization. Experiments show that ADAPT consistently outperforms training-based navigation baselines and zero-shot multimodal models on both seen and unseen scenes. On unseen environments, it achieves 90.6% success under Clean conditions and retains 60.0% success under the most challenging Localized Noise setting. These results demonstrate the potential of spatial audio and depth as complementary modalities for reliable RGB-free navigation in lights-out industrial environments.
Create a lesson
Related papers
Double-Rollout Reinforcement Learning with Sampling-based Reward Estimation
Haifeng Qian, David Mosallanezhad, Christian Munley et al.
G2WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigation
Ke Gui, Chenghao Shi, Ziyue Wang et al.
AI Discovery in Combinatorics: From Problems to Solutions and Back to Bigger Problems
Eugenio Cainelli, Lorenzo Luccioli, Alessandro Iraci et al.
Making Language the Low-Rate Code of Vision: Successive Refinement from Words to Pixels
Ruilin Gong, Hao Gong
Overtaught, Underlearned: Learner-Centered Distillation from Multi-Agent Discussion
Mengtao Zhou, Jianxiao Wang, Xiupeng Chen et al.
Does the Explanation Drift Before the Guarantee? Label-Free Early Warning on Evolving Graphs
Tomasz Szandała, Damian Raczkowski