Losing Control! The Role of Sense of Agency in Using Highly Invasive AI Systems

This paper examines the impact of highly invasive artificial intelligence (AI) systems on the sense of agency (SoA) and the intention to use AI. As AI becomes increasingly integrated into everyday decision-making, its opacity and persuasive capabilities present challenges to user autonomy and transparency. This study examines the psychological effects of AI-induced loss of agency, utilizing a pilot study with scenarios designed to enhance awareness of AI’s nudging capabilities. By examining the relationship between the SoA, perceived usefulness, anxiety, and behavioral intentions towards AI, the research highlights the critical role of users’ SoA in technology adoption. The findings indicate that awareness of AI manipulation significantly diminishes SoA, which in turn affects user engagement negatively.