When Collaboration Becomes a Trigger: Collective Evidence-Threshold Backdoors in Multi-Agent Systems
Jia-Hao Xiao, Lei Feng, Min-Ling Zhang
Abstract
LLM-based multi-agent systems (MAS) extend LLM capabilities through iterative communication and shared contexts. However, this collaboration introduces a vulnerability: backdoor behavior can be activated when peer evidence reaches a hidden threshold, rather than being determined by any single message. We introduce a collective evidence-threshold backdoor paradigm for MAS and Boundary-Conditioned Backdoor Injection (BCBI), which constructs counterfactual boundary pairs to separate benign behavior before the threshold from the adversarial objective after it, and learns latent progression aligned with evidence. To mitigate this threat, we propose LAtent Transition Test-time Evaluation (LATTE), a clean-only latent-transition defense that learns benign communication dynamics and quarantines anomalous agent updates before their responses propagate. Across several benchmarks, BCBI yields selective activation with little premature activation; without knowing the attack target or trigger, LATTE limits propagation with minimal disruption.
Create a lesson
Related papers
Social Laws for Multi-agent Coordination in Stochastic Environments
Rolando Fernandez, Caleb Probine, Tyler Lee et al.
ABM-SIRTEM: A Hybrid Agent-Based and Epidemiological Model for Pandemic Response
Sheryl Paul, Samuel Williams, Preetom K. Biswas et al.
Agentic Societies Need a Social Harness
Tapan Chugh, Vidushi Singh, Krish Jain et al.
Decomposition Buys Integrity, Not Yield
Rong He
Emergence World: Adversarial Stress-Testing of Long-Horizon Multi-Agent Systems
Deepak Akkil, Tamer Abuelsaad, Karthik Vikram et al.
Mo' Models, Mo' Problems: How to best select model pools when designing Multi-Agent Systems
Sara Vera Marjanović, Jiacheng Xu, Aleksandr Laptev et al.