From Reliance to Overreliance: Taxonomizing and Detecting Relational Risks in AI Companionship
Viet Cuong Nguyen, Fiona Li, Chang Wan, Sheyril Agarwal, Nhi Nguyen, Angel Hsing-Chi Hwang, Munmun De Choudhury
Abstract
Companion AIs are increasingly used for emotional support, yet distinguishing meaningful engagement from harmful reliance remains difficult. We introduce the Taxonomy of Relational Risks (TRR), which operationalizes users' emotional overreliance (EO) as observable conversational behaviors and separately identifies evidence of relational harm (RH), enabling empirical examination of when reliance behaviors co-occur with adverse consequences. Using naturalistic Character.AI and Replika conversations from 110 adults, we found EO-related behaviors in 63.2% of non-roleplay conversations, while observable relational harms appeared in 10.5%. Although EO did not necessarily lead to harm, recurring patterns often co-occurred with harmful outcomes, suggesting value as risk indicators. Open-source LLMs satisfactorily detected 12 of 14 EO behaviors in at least one configuration. Qualitative analysis revealed expectations of care, repeated support seeking, dependency, distress, and reduced confidence in personal judgment. We argue for graduated safety interventions tailored to patterns and trajectories of EO-related behavior.
Create a lesson
Related papers
Introducing ReTiNA-Cinema: Real-Time Neuro-Augmented Cinema via Generative AI
Antoine Bellemare-Pepin, Philipp Thölke, Yann Harel et al.
Rethinking Utility in Differentially Private Visualization: A Channel-Centric Perspective
Jing Yang, Sarayu Pacca, Zhaocong Yang et al.
Presenting Your Figures: Data-informed Animated Transitions Across Scientific Figure Panels
Lu Ying, Can Liu, Yuxiao Yang et al.
Ground Truth Bias in AI-Assisted Medical Annotation: A Crossover Study Using an Independent Radiologist Reference Standard
Márton Baltay, Tamás Ilcsik, Márton Borbély
Embodied Human-Data Interaction
Niklas Elmqvist
GenAI-DBT: Evaluating a DBT-Informed Generative AI Platform for Mindfulness Skills Training: A Pilot Randomized Study
Jingchen Ye, Yujia Chen, Leyang Han et al.