Affective Mirroring in Video Game NPCs: A Pilot Study Evaluating Player Engagement

Advancements in Artificial Intelligence (AI) technologies and Affective Computing have created new possibilities in video game design, particularly in enhancing the interactivity and emotional depth of non-player characters (NPCs). This study explores the potential of AI-driven affective mirroring to enhance player attachment to non-player characters (NPCs) in video games by dynamically recognizing and responding to player emotions. Using a visual novel dating game prototype, the research employs facial expression analysis to recognize and match player emotions with NPC reactions, aiming to create emotionally responsive interactions. Ten participants, aged 21 to 24, including both gamers and non-gamers, were involved in the testing. Results show that while affective mirroring can strengthen player attachment, subtle and context-aware responses are key to maintaining immersion and believability. Ethical concerns are discussed in the context of privacy issues related to the collection and use of emotional data, with recommendations for transparent data practices and safeguards against emotional manipulation. The study suggests that, with further development, affective mirroring could improve player engagement in games and expand to other fields that involve virtual agents such as healthcare, education, or customer service.