The Limits of Care: A Critical Analysis of AI Companions' Capacity for Good Care

The rapid proliferation of AI companions, exemplified by Replika's 30 million global users as of 2024, raises critical questions about their capacity to provide genuine care. Through three theoretical frameworks�Tronto's care ethics [1], Mol's logic of care [2], and Foucault's technologies of self [3]—this study examines whether AI can deliver “good care” while analyzing real-world cases of AI companionship. The analysis reveals three fundamental limitations: AI's lack of moral understanding and responsibility essential for care phases, the inadequacy of its choice-based design to provide dynamic care, and its potential to reinforce power structures rather than foster authentic self-reflection. These limitations are evidenced through cases including Replika's controversial feature removal and the Chail incident, demonstrating how AI companions, while potentially alleviating loneliness, may simultaneously exploit users' psychological vulnerabilities. The analysis argue that AI should be positioned as an assistive tool within broader human-centered care networks rather than as an independent caregiver. This study contributes to both theoretical understanding of AI care limitations and practical guidelines for developing more responsible AI companion systems.

Authors

Institutions

Publication Details

Published
2025-06-06
DOI
https://doi.org/10.1109/ethics65148.2025.11098184
Citations
1
Primary Topic
Digital Mental Health Interventions
Type
article
Field-Weighted Citation Impact
1.54
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Limits of Care: A Critical Analysis of AI Companions' Capacity for Good Care

M Wang
1 citations
Digital Mental Health Interventions
1.54
article

The Limits of Care: A Critical Analysis of AI Companions' Capacity for Good Care

M Wang
article en
1 citations

Abstract

The rapid proliferation of AI companions, exemplified by Replika's 30 million global users as of 2024, raises critical questions about their capacity to provide genuine care. Through three theoretical frameworks�Tronto's care ethics [1], Mol's logic of care [2], and Foucault's technologies of self [3]—this study examines whether AI can deliver “good care” while analyzing real-world cases of AI companionship. The analysis reveals three fundamental limitations: AI's lack of moral understanding and responsibility essential for care phases, the inadequacy of its choice-based design to provide dynamic care, and its potential to reinforce power structures rather than foster authentic self-reflection. These limitations are evidenced through cases including Replika's controversial feature removal and the Chail incident, demonstrating how AI companions, while potentially alleviating loneliness, may simultaneously exploit users' psychological vulnerabilities. The analysis argue that AI should be positioned as an assistive tool within broader human-centered care networks rather than as an independent caregiver. This study contributes to both theoretical understanding of AI care limitations and practical guidelines for developing more responsible AI companion systems.

University of Auckland (NZ)
Openalex Percentile: Top 15%
Digital Mental Health Interventions
1.54
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.