CORTEXA
← Browse
arxivcs.LGcs.AIcs.MA2026-07-08

Multi-Agent AI Control: Distributed Attacks Hamper Per-Instance Monitors

Oliver Makins, Orazio Angelini, Zohreh Shams, Mary Phuong

AI control is a family of techniques to prevent an AI with malicious goals from subverting its operator's intent. AI Control usually studies a single agent in one trajectory, but real deployments run many agents over shared infrastructure, and the most severe risks (model-weight exfiltration, training-run poisoning) plausibly need several agents acting in concert. We initiate the empirical study of multi-agent AI control, formalising distributed attacks in which several agents jointly aim for a malicious goal. We develop FakeLab: a synthetic AI-lab codebase (9 services, 86 benign tasks, 4 attack objectives). We evaluate single agent monitoring against distributed attacks, varying the number of agents, their coordination, model capabilities and precise monitoring configuration. Our central finding is the fragmentation effect: as more agents coordinate to attack, per-agent monitoring becomes less likely to catch any of the attackers. Secondly, this is not driven by the ratio of benign to malicious code -- we argue this is likely dependent on model capability. Third, an explicit planner amplifies the fragmentation effect, raises the rate of completing the attack up to sevenfold, and mildly sharpens executors' poor monitor-theory-of-mind. Finally: a weak "trusted" monitor misses most attacks, while a stronger one cuts undetected success by more than an order of magnitude but remains imperfect. We are happy to share FakeLab, our control setting, with safety researchers on request.

View free PDFSource page

Related papers

arxivcs.CRcs.AIcs.IRcs.LGcs.MA2026-07-08

Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems

Yufei Xia, Anjun Gao, Yueyang Quan, Zhuqing Liu, Minghong Fang

Large language model (LLM) based multi-agent systems enable complex problem solving through coordinated reasoning and action, but their distributed structure also introduces new challenges in diagnosing system-level failures. When an execution fails, identifying which agent is re…

View free PDFSource page
arxivcs.AIcs.CLcs.LGcs.MA2026-07-07

Norm Enforcement for AI Agents: Robustly Shaping Behavior in Multi-Agent Systems

Yaowen Ye, Jacob Steinhardt

AI agents are increasingly deployed in shared environments where they pursue diverse goals and compete for rewards. This multi-agent competition can lead to behaviors that serve individual gains at collective cost -- for instance, marketing agents may post misleading content as a…

View free PDFSource page
arxivcs.GTcs.AIcs.CRcs.LGcs.MA2026-07-10

A Knowledge-Based Multi-Agent Framework for Security Control Recommendation

Carolina Fernández-Martínez, Shuaib Siddiqui, Vanesa Daza

Hardening IT on-premises environments can be a daunting task for teams without access to adequate cybersecurity expertise. In this regard, Decision Support Systems (DSS) with embedded expert knowledge can assist users by guiding them with security recommendations to meet their ob…

View free PDFSource page
arxivcs.LGcs.AIcs.IRcs.MA2026-06-27

Multi-Agent Routing as Set-Valued Prediction: A WildChat Benchmark and Cost-Aware Evaluation

Ananto Nayan Bala, Faisal Muhammad Shah

Tool and agent routing from natural-language prompts is naturally a set-valued prediction problem: a single query may require multiple agents, while over-selection increases execution cost. The benchmark introduced here is derived from WildChat and contains 3,000 prompts over a f…

View free PDFSource page
arxivcs.LGcs.AIcs.MA2026-07-06

Relational Multi-Agent Reinforcement Learning for Dynamic Pricing in High-Speed Railway Markets

Enrique Adrian Villarrubia-Martin, David Muñoz-Valero, Luis Rodriguez-Benitez, Giovanni Montana, Luis Jimenez-Linares

In liberalised railway systems, operators must set prices dynamically in an environment with partial observability, as they retain private information about their objectives and performance, where regulatory constraints prohibit communication or direct information exchange betwee…

View free PDFSource page
arxivcs.LGcs.AIcs.CLcs.MA2026-07-20

MADA-RL: Multi-Agent Debate-Aware Reinforcement Learning for Parameter-Efficient Reasoning in Compact Models

Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov, Zifeng Ding, Volker Tresp, Yunpu Ma

Large language models achieve strong reasoning performance, but often at prohibitive training cost - a challenge that is especially acute for compact models ($\leq 4 \, \mathrm{B}$ parameters) trained under limited budgets. We introduce MADA-RL, a post-training framework that spe…

View free PDFSource page