When Truth Is Distributed: Misinformation Derails Collective Fact Recovery in LLM-Based Multi-Agent Systems
Chenfei Yan, Zeyang Yue, Feifei Zhao, Erliang Lin, Lu Jia, Haibo Tong, Mingyang Lyu, Chengyi Sun, Yi Zeng
Abstract
LLM-based multi-agent systems promise effective collaborative reasoning, but communication may amplify local errors into collective risks, and while existing evaluations emphasize final outcomes, they leave the reliability and propagation dynamics of distributed information aggregation unclear, so we introduce ForesightSafety-TIDE, a controlled evaluation framework that strictly pairs all-honest collaboration with controlled deception by a key evidence holder and analyzes the aggregation process through multi-stage voting, testimony adoption, and evidence-root lineage propagation, and using 120 five-agent object-movement environments where partial observations jointly determine a unique endpoint, we evaluate 3 homogeneous LLM-based multi-agent systems, and across these paired conditions, aggregate truth recovery falls from 72.50% to 14.17%, with significant declines for every system, while process tracing and exit ablations show that a single false testimony is adopted more readily than truthful testimony, propagates to higher orders, and persists through honest agents after the deceiver exits, and observers without first-hand evidence suppress incorrect consensus but do not improve truth recovery, so together, these findings reveal both the fragility of distributed fact recovery and its underlying mechanism: false evidence gains collective influence through its adoption and continued propagation by other agents after entering communication.
Create a lesson
Related papers
Social Laws for Multi-agent Coordination in Stochastic Environments
Rolando Fernandez, Caleb Probine, Tyler Lee et al.
ABM-SIRTEM: A Hybrid Agent-Based and Epidemiological Model for Pandemic Response
Sheryl Paul, Samuel Williams, Preetom K. Biswas et al.
Agentic Societies Need a Social Harness
Tapan Chugh, Vidushi Singh, Krish Jain et al.
Decomposition Buys Integrity, Not Yield
Rong He
Emergence World: Adversarial Stress-Testing of Long-Horizon Multi-Agent Systems
Deepak Akkil, Tamer Abuelsaad, Karthik Vikram et al.
Mo' Models, Mo' Problems: How to best select model pools when designing Multi-Agent Systems
Sara Vera Marjanović, Jiacheng Xu, Aleksandr Laptev et al.