Text Input Through Swipe Gestures Based Personalized AI Agent

Text input based on virtual reality is a common technique in interactive systems, but it may face challenges related to input efficiency and task load when interacting with VR hardware and applications. The development of artificial intelligence interaction technologies offers new approaches to addressing text input challenges. In this paper, we propose a swipe gesture-based text input method under a personalized AI agent framework, combining portable devices (e.g. smartphones) with VR input and incorporating user profile information, input habits, and conversational intent. By integrating the GPT-3.5 model to train a personalized AI agent, we emphasize the importance of understanding and responding to human behavior or capabilities from the agent's perspective, enabling text prediction based on specific contexts. The keyboard layout design is based on a disk divided into 8 equal regions, where the outer circle is subdivided into key areas containing letters, and the inner circle serves as the input buffer area. By resolving word ambiguities based on user input and leveraging the extensive capabilities of large language models in context awareness and text prediction, the system allows complete sentences to be generated from keywords. This reduces the number of manual inputs required by the user, improving text input efficiency and enhancing the overall user experience.

Authors

Institutions

Publication Details

Published
2024-12-17
DOI
https://doi.org/10.1109/icarce63054.2024.00088
Primary Topic
Human Motion and Animation
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Text Input Through Swipe Gestures Based Personalized AI Agent

Zihao Li, Jie Hao, Xu Qi, Dongdong Weng
Human Motion and Animation
article

Text Input Through Swipe Gestures Based Personalized AI Agent

Zihao Li, Jie Hao, Xu Qi, Dongdong Weng
article en

Abstract

Text input based on virtual reality is a common technique in interactive systems, but it may face challenges related to input efficiency and task load when interacting with VR hardware and applications. The development of artificial intelligence interaction technologies offers new approaches to addressing text input challenges. In this paper, we propose a swipe gesture-based text input method under a personalized AI agent framework, combining portable devices (e.g. smartphones) with VR input and incorporating user profile information, input habits, and conversational intent. By integrating the GPT-3.5 model to train a personalized AI agent, we emphasize the importance of understanding and responding to human behavior or capabilities from the agent's perspective, enabling text prediction based on specific contexts. The keyboard layout design is based on a disk divided into 8 equal regions, where the outer circle is subdivided into key areas containing letters, and the inner circle serves as the input buffer area. By resolving word ambiguities based on user input and leveraging the extensive capabilities of large language models in context awareness and text prediction, the system allows complete sentences to be generated from keywords. This reduces the number of manual inputs required by the user, improving text input efficiency and enhancing the overall user experience.

Beijing Institute of Technology (CN)
National Key Research and Development Program of China
Openalex Percentile: Top 63%
Human Motion and Animation
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.