OmniAI: A Surface-Adaptive Aerial Projection Interface for Human--Drone Interaction
Nikita Kuzmin, Yuhua Jin, Georgii Demianchuk, Mariya Lezina, Fawad Mehboob, Ivan Valuev, Nikolai Lutsenko, Miguel Altamirano Cabrera, Dzmitry Tsetserukou
Abstract
Drones in human environments often lack spatially grounded in- terfaces for situated communication. We present OmniAI, an em- bodied aerial agent that supports surface-adaptive interaction by switching projection between an onboard screen and nearby en- vironmental surfaces. A servo-actuated MEMS laser projector renders text-and-image responses from a web-augmented LLM pipeline. Projection surfaces are detected online using RGB-D sensing and RANSAC plane fitting, without pre-mapped geometry. OmniAI provides functionally equivalent voice and gesture con- trol for both drone motion and projected content. By combining speech, mid-air gestures, adaptive projection, and aerial mobility, OmniAI demonstrates a mobile spatial AR interface for context- aware human-drone interaction.
Create a lesson
Related papers
rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference
Kaijun Zhou, Zhiyang Li, Le Chen et al.
ElastiQP: An Always-Feasible QP Solver for Constrained Robot Control
Daniel Morton, Jon Arrizabalaga, Zachary Manchester et al.
"What's going to happen after I'm gone?": Parent Perspectives on Technology in Supporting Independent Living for Adults with Intellectual Disabilities
Alexander Tyshka, Andrea Macklem-Zabel, Absalat Getachew et al.
Learning Holistic Whole-Body Loco-Manipulation with a Bipedal Mobile Manipulator
Zhongyu Chen, Yuxuan Nai, Qian Chen et al.
CaSCo: Cascade-Aware Soft-Collision Motion Planning
Shivaram Kumar, Gaoyuan Liu, Yoonchang Sung
Examining the Difference in Human Behavior Between Virtual and Real-World Human-Robot Teaming
Sean Dallas, Absalat Getachew, Motaz AbuHijleh et al.