Loving an algorithm – the story of Replika and the limits of artificial intimacy

Abstract The case proposes an ethical and regulatory analysis of affective artificial intelligence (AI) systems, focusing on “companion AI” applications such as Replika. Through a narrative based on real and current situations, the activity challenges students to formulate opinions on the social, legal, and emotional risks of using technologies that simulate emotional bonds with humans. Issues related to the collection and use of sensitive data, continuous emotional engagement, mental health, privacy, autonomy, and vulnerability of users (especially adolescents and people in emotional distress) will be addressed. Based on regulatory frameworks and discussions, students should propose governance and risk classification guidelines.