UniKey: Enabling Surface-Based Typing with Commodity Smartwatches via Cross-Modal Learning

Unikey InferenceFigure 1: Figure illustrates our vision for how Unikey can enable users to type on any surface without a physical keyboard, using only a accelerometer and microphone aboard a commodity smartwatch to sense keystrokes.What sets Unikey apart is its out-of-the-box functionality, requiring no lengthy collection of training data on watch sensors.Instead, it applies typing patterns learned from a user's regular typing on physical keyboard to infer typed text.