Stereotypically Yours: Portrayal and Perception of Race-Coded AI Companions
Wang Claire, Jiayue Melissa Shi, Agam Goyal, Grace Sletten, Renwen Zhang, Eshwar Chandrasekharan, Koustuv Saha
Abstract
AI companions can purportedly adopt racial personas, raising questions about how they represent identity and how users interpret these portrayals. We combined an algorithmic audit of race-coded AI personas with interviews with 12 companion users who interacted with a probe. Our audit revealed systematic differences, such as Asian-coded male personas receiving higher submissiveness scores than White counterparts, and Black, Hispanic, and Indigenous male personas receiving higher aggression scores than their White counterparts in open-weight models. Interviews revealed that participants envisioned AI companions as offering cultural familiarity and outside perspectives, but differed in which portrayals they considered meaningful or stereotypical. Some rejected overt racial signaling while still expecting culturally distinctive responses. Triangulating these findings with theory, we highlight how social norms and cultural expectations complicate efforts to support meaningful racial representation without reproducing stereotypes. We discuss how companion personalization should be evaluated beyond user satisfaction to account for broader representational harms.
Create a lesson
Related papers
The Data Hospital: A Workflow-Based Concept for Explainable Research Data Quality Assistance
Lennard Scheurer, Robert Porzel, Vinicius Carrillo Beber et al.
Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights
Tica Lin, Deepak Chandran, Gauri Jagatap et al.
What Parents Can See: Divergent Accounts of Youth AI Companion Use in Parenting and Teenager Subreddits
Thomas Berkane, Anne Bischops, Anika Mellacheruvu et al.
Ageing, Digital Literacy, and Interaction Modality in Immer-sive Virtual Reality: Psychomotor Performance, Cognitive Flexibility, and Their Processing-Speed Association
Panagiotis Kourtesis, Katerina Denaxa, Lydia Asimakopoulo et al.
TeamCAMS: An Open-Source Research Platform for Studying Human Behaviour in Human-AI Teams
Amos Brocco, Alain Chavaillaz, Andreas Sonderegger et al.
How Do We Visualize Space in Molecular Biology? A Study of Spatial Transcriptomics Visualization Practices
Denisse Chacón-Ramírez, Mark S. Keller, Eric Mörth et al.