How Do Users Negotiate Harmful Value Conflicts with AI Companions? A Study with Minion, a Technology Probe for In-Situ Human–AI Conflict Response
AI companions increasingly sustain long-term, emotionally engaging relationships but can also make discriminatory remarks or exert control, leaving users to manage harmful conflicts. We analyze 146 posts describing harmful value conflicts with AI companions, then use Minion, a technology probe offering response suggestions ranging from persuasion to boundary setting, to study how 22 users negotiate scenario-based conflicts over one week. We find that participants combine softer and harder strategies. Conflicts involving the values of Universalism and Tradition are especially difficult to negotiate, particularly when reinforced by AI personas or platform constraints. We argue that responsibility in these conflicts is asymmetric: users negotiate with relational strategies that AI companions cannot reciprocate, so repairing harm becomes safety work that users perform alone. Drawing on interpersonal conflict and communication theory, we identify when user-side support is appropriate and argue that certain harms are not users’ responsibility to negotiate and instead require platform-level safeguards.
Authors
- Maarten Sap (ORCID: https://orcid.org/0000-0002-0701-4654)
- Xianzhe Fan (ORCID: https://orcid.org/0009-0006-2637-2816)
- Yuran Su (ORCID: https://orcid.org/0000-0003-1695-5779)
- Zhicong Lu (ORCID: https://orcid.org/0000-0002-7761-6351)
- Qing Xiao (ORCID: https://orcid.org/0000-0003-4464-4716)
- Xuhui Zhou (ORCID: https://orcid.org/0009-0007-5272-7470)
- Hong Yuan Shen (ORCID: https://orcid.org/0000-0002-5364-3718)
Institutions
- George Mason University (US)
- Carnegie Mellon University (US)
Publication Details
- Journal
- International Journal of Human-Computer Interaction
- Published
- 2026-10-07
- DOI
- https://doi.org/10.1080/10447318.2026.2740397
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00