Exploring Keyboard Positioning and Ten-Finger Typing in Mixed Reality

Abstract

Accuracy and speed are pivotal when typing. Mixed reality typing is typically performed by typing on a midair keyboard with your index fingers. This deprives users of both the tactile feedback available on physical devices and the ability to press keys with the most convenient finger. Our first experiment investigated providing tactile feedback by positioning the virtual keyboard on a table or wall. The keyboard was deterministic (without auto-correct), supported mixed case typing with symbols, and relied only on the hand-tracking provided by a commodity headset's egocentric cameras. Users preferred and had the highest entry rate of 12 words-per-minute using a midair keyboard. Error rates were similar in all conditions. Our second experiment explored ten-finger typing and used a novel eye-tracking technique to avoid accidental key presses. This technique was preferred for ten-finger typing and halved corrections. However, participants were faster using their index fingers without eye-tracking at 11 words-per-minute.