GazeTune: Facilitating Precise Gaze-Driven Interactions with Cascaded Touch Input
Jina Kim, Eric J. Gonzalez, Yang Zhang, Sang Ho Yoon
Abstract
Eye gaze has become an essential input for spatial computing, but its coarse targeting and saccadic nature limit precision and complicate continuous interactions such as dragging, especially under user motion. Gaze+pinch has also become standard in XR for its convenience, yet mid-air gestures remain imprecise, fatiguing, and socially unacceptable. These limitations underscore the need for an approach that preserves the speed of gaze while enabling stable, fine control. We present GazeTune, a cascaded multimodal interaction technique combining gaze and touch to refine gaze-based selection and manipulation. Touch serves as a refinement channel within gaze pointing, allowing precise cursor and target control. Our work investigates how gaze-and-touch enhances dragging and mitigates Motion-Induced instability. In a study (N=20), we compared GazeTune against gaze-only and gaze-pinch methods in 2D dragging. Results show that GazeTune achieves significantly lower error with comparable execution time, validating its effectiveness and balanced trade-off between time and accuracy.
Create a lesson
Related papers
BuildOcc: A Large Language Model Occupant Agent Platform for Building Energy Research
Wooyoung Jung
Large Language Model-Driven Context-Aware Eco-Feedback Generation and Evaluation
Wooyoung Jung, Prosper Babon-Ayeng
The PIONEER Project: A PrIvacy companion for mOtivatioN and knowlEdge transfER
Simon Althaus, Nina Gerber, Sara Hahn et al.
Beyond Problem Solving: Large Language Models for Emotional and Reflective Support in Mathematics Learning
Vera Rief, Mirella Hladký, Minju Yoo et al.
EEG-based Visual Retrieval and Reconstruction: From Neurally Visible Optimal Layer to Hierarchical Diffusion Generation
Minyi Wang, Zhenqin Wu, Rihui Li
Decoding Decision Correctness from EEG Under High Cognitive Workload in Virtual Reality: Implications for Collaborative Brain-Computer Interface Teams
Christopher Baker, Stephen Hinton, Tom Reed et al.