AirType: An Air-tapping Keyboard for Augmented Reality Environment

The ON-AIR Virtual Keyboard is an innovative technology for a human-computer interface. It allows users to compose text using hand gestures from mid-air. It employs hand-tracking technology and executes machine learning algorithms to conduct gesture recognition without contact, in a hygienic as well as versatile typing method. Since it utilizes real-time OpenCV and Mediapipe libraries for hand detection coupled with Pynput that simulates keystrokes; the virtual keyboard offers easy input methods, flexible according to the environment. This paper describes the implementation of the ON-AIR Virtual Keyboard, evaluates its performance, and discusses its application areas in accessibility, augmented reality, and interactive systems. The results show good real-time responsiveness with small latencies, making this an attractive alternative to classical input methods. This is particularly relevant in situations in which a traditional keyboard may not be practical or preferable, such as in the medical environment, virtual reality, or smart home interface.