Perceived Trust and Transparency in AI-Altered vs. Human-Written LinkedIn Posts
Thomas Christian Joos, Azza Bouleimen, Anikó Hannák, Nicolò Pagan
Abstract
People increasingly draft a social media post themselves and then let an AI model refine it (AI-altered), a common but understudied middle case between fully human-written and fully AI-generated content. We ask whether this changes how trustworthy and transparent readers perceive the post to be, and whether they can even tell. We first analyze real ChatGPT conversations (WildChat) to find how people actually alter social media posts, which we use to design realistic alteration prompts. We then run a pre-registered, within-subjects online experiment (n=214) in which participants rate unlabeled human-written and AI-altered LinkedIn-style posts for perceived trustworthiness and transparency, and separately judge whether each post was AI-altered. We find that AI-alteration itself has no detectable effect on either perceived trustworthiness or transparency (both estimates near zero, not significant). At the same time, readers did not reliably detect AI-alteration (49\% accuracy, near chance) and defaulted to assuming human authorship when unsure. However, our analysis shows significant differences in transparency and trustworthiness ratings across the specific post, the AI model, as well as the prompt used to alter it. For instance, more detailed prompts raise both perceived trustworthiness and transparency but also make the alteration more detectable. Surprisingly, the prompt that shifted ratings most also asked the model to add one new idea absent from the original post: readers nonetheless rated this AI-invented, unverifiable content as more trustworthy and transparent.
Create a lesson
Related papers
A Frame-Level View and Image-Quality Annotation Tool for Fetal Echocardiography: Comparison with Spreadsheet Annotation
Mohamed Azzam, Ziyang Xu, Quinlan Couch et al.
Go-Go-Go: the game of Go without turns
Andrea Cambiaghi, Marco Tarini
Smartphone-Aided VR Exergames for HIIT: Gamifying Fitness with Real-Time Pose Estimation
Abhiram Kothagundu, Pheelip Pritipal Raipure, Abhijit Chandrakant Patil et al.
You Know What You Will Like: People Predict Their Own Ratings Better Than Recommender Systems
Zihan Chen, Lei Nico Zheng, Di Zhu
Measuring the collaboration, not the agent
Xinxiao Li, Eisei Nakahara
Today's Work, Tomorrow's Workforce: Incentivizing Learning in AI-Assisted Work
Moritz Diener, Daniel Hendriks, Philipp Spitzer et al.