AnyVIO: Feed-Forward Streaming Visual-Inertial Odometry Across Platforms
Omoruyi Atekha, Marcus Greiff, Ray Zhang, Luca Carlone
Abstract
Geometric foundation models (GFMs) estimate camera mo- tion and scene structure from images without requiring ex- pert parameter tuning, but either lack metric scale or rely on learned priors to infer scale, which is unobservable from monocular images alone. Inertial sensing offers a way to observe metric scale, but existing methods add inertial in- formation through a filter or factor graph, which reintro- duces bespoke parameter tuning and optimization costs that can grow with the trajectory. To bridge this gap, we present AnyVIO, a real-time, feed-forward streaming model for monocular visual-inertial odometry (VIO), which combines a streaming GFM with an inertial foundation model (IFM). Both the GFM and IFM predict the metric motion between consecutive frames, and a lightweight learned fusion head quantifies the reliability of each estimate and blends them in a single forward pass. Across nine datasets recorded from cars, legged and ground robots, and handheld and head- mounted devices, AnyVIO reduces the metric position error of its visual model by 36% while publishing each pose esti- mate 70 ms after an image is received. We further deploy AnyVIO onboard two real vehicles at up to 140 km/h, where it remains accurate in poor lighting and heavy dust.
Create a lesson
Related papers
Susceptibility source separation via Closed-form Alternating Newton-type Optimization
Ignacio Contreras-Zúñiga, Cristian Tejos, Carlos Milovic
Physics-Informed Deep Learning for Shear Wave Speed Estimation in MR Elastography
Stefan Martin, Jakob Schattenfroh, Patrick Schuenke et al.
LBW-NPS: A Local Band-Weighted Noise Power Spectrum Loss for Texture-Preserving Low-Dose CT Denoising
Fatma Elif Yalçındağ, Mehmet Ozan Ünal, Metin Ertaş et al.
Life-IQA+: Boosting Blind Image Quality Assessment via GCN-enhanced Layer Interaction and Flexible Hierarchical Expert Specialization
Long Tang, Guoquan Zheng, Huiyu Duan et al.
Uncertainty-Aware Multimodal Deep Learning for Prediction of Radiation-Induced Xerostomia in Head and Neck Cancer
Jin Yang, Tian Liu, Jose Penagaricano et al.
AIstatLab at BraTS-GoAT 2026 Task 3: Quality-Controlled Consensus Pseudo-Labeling and Dense Expert Adaptation
Heeseung Shin, Changwon Lim