top of page
Search

Your AI Agents Are Probably All Running the Same Playbook. That's a Systemic Risk.

Writer: Carlos Cabana
Carlos Cabana
Sep 23
6 min read

The most dangerous AI failure in capital markets may not be a rogue agent.

It may be thousands of well-governed agents making the same decision at the same time.

That is the uncomfortable conclusion emerging from three developments this month:

The common thread is simple:

Model risk is no longer only about what one agent does. It is about what an entire population of agents does together.

If every firm deploys agents trained on similar data, tuned against similar benchmarks, connected to similar market feeds, and optimized for similar objectives, then “diversification” can become an illusion.

You may have 500 agents.

You may still have one trade.

The systemic risk is correlation

Capital markets understand concentration risk. Firms measure exposure to one issuer, one counterparty, one funding source, one technology provider, or one clearing arrangement.

AI introduces another form of concentration risk: behavioral concentration.

Agents can be technically separate while remaining strategically identical.

They may run in different business units. They may have different names, prompts, and user interfaces. But if they share:

  • The same foundation model

  • The same historical training data

  • The same market narratives

  • The same risk thresholds

  • The same optimization target

  • The same benchmark definition

  • The same vendor infrastructure

Then their decisions may converge under stress.

That convergence is not a bug in one agent. It is a property of the system.

A portfolio of agents that all interpret a tariff announcement as a reason to reduce the same exposure can accelerate a market move. Agents responding to a sudden rate repricing may all shorten duration, widen funding assumptions, or escalate the same exception. Agents monitoring cyber events may all trigger the same defensive workflow, creating operational congestion at precisely the wrong time.

The individual decisions can be reasonable.

The collective outcome can still be destabilizing.

A precise network diagram showing shared infrastructure hubs and correlated risk moving across financial institutions

Better models can make the problem worse

The September 3 paper, Why Better Models Can Create Riskier Systems, puts evidence behind this concern.

Its central finding is a capability paradox: improving individual model capability does not necessarily improve system-level outcomes.

More capable models can behave more similarly, particularly when they share training methods, architectures, and information environments. When their shared reasoning is accurate, that correlation can improve outcomes. But when the shared information is incomplete, misleading, or wrong, the same correlation amplifies the damage.

This is the problem with treating model quality as a proxy for system safety.

A firm can test an agent in isolation and conclude that it is accurate, compliant, and robust. Another firm can run the same tests and reach the same conclusion. Both firms can deploy the model successfully.

Then a common shock arrives.

The models recognize the same signal, prioritize the same explanation, and recommend the same response. The system has no independent judgment left to offset the first mistake.

Better agents have become a more efficient transmission mechanism for a shared error.

The market environment makes this more urgent

This is not a theoretical concern separated from current operating conditions.

Trade policy can change faster than investment committees and operating teams can update their assumptions. Tariffs, export restrictions, sanctions, and supply-chain policies can alter inflation expectations, earnings forecasts, collateral values, and counterparty exposure in hours.

An agent that monitors policy headlines and recommends portfolio or operating changes is useful. Ten thousand agents reacting to the same headline with the same logic can create a feedback loop.

Rates and debt create a similar problem. Funding costs, refinancing schedules, sovereign exposures, private credit marks, and liquidity buffers are all scenario-sensitive. If agents are optimized to minimize a narrow risk metric, they may recommend similar actions when a rate scenario moves outside the historical range.

The right question is not simply:

“Did the agent make a defensible recommendation?”

It is:

“How many other agents are about to make the same recommendation, and what happens if they do?”

Labor scarcity adds another dimension. Firms need automation to offset capacity constraints across operations, compliance, reporting, reconciliation, and trade lifecycle support. Productivity is the product. But scaling automation without monitoring behavioral correlation can scale common-mode failure just as efficiently as it scales productivity.

Automation without system-level visibility is not resilience. It is synchronized exposure.

The BIS warning: speed changes the operating model

The BIS FSI paper focuses on frontier AI and cyber risk, but its operational lesson applies broadly.

Frontier models can autonomously identify vulnerabilities, develop exploits, and conduct increasingly complex multi-step operations. That compresses the window between vulnerability discovery and exploitation.

For financial firms, the consequence is not merely “buy better cybersecurity.”

It is that governance must operate at machine speed.

The same principle applies to agentic workflows. If an agent can detect a market event, classify an exception, draft a client communication, route an order, or initiate an operational response in seconds, then the firm needs controls that can evaluate:

  • Which agents are acting

  • What signals they share

  • Which models produced the recommendations

  • Whether their outputs are becoming correlated

  • What policies apply

  • Which actions require approval

  • Whether the response is proportionate to the scenario

  • How the firm can reverse or contain the action

A post-event review is not enough. By the time the review begins, the correlated action may already be in the market.

Heterogeneity is now a control objective

The answer is not to ban capable models or pretend that every firm can build an entirely independent AI stack.

The answer is to design for useful heterogeneity.

That means deliberately varying the factors that influence decisions:

  • Model families and reasoning approaches

  • Data sources and information windows

  • Scenario assumptions

  • Risk preferences

  • Escalation thresholds

  • Agent roles and areas of responsibility

  • Human review points

  • Validation and challenge functions

Heterogeneity does not mean introducing random behavior. It means preventing every agent from failing for the same reason at the same time.

One agent may optimize for execution efficiency. Another may challenge liquidity assumptions. A third may test for policy uncertainty. A fourth may identify operational dependencies. A human approver may be required when the outputs converge beyond a defined threshold.

The firm needs to know when its agents are disagreeing: and when they are agreeing too quickly.

A governed AI control plane coordinating diverse agents, approval gates, and capital-markets systems

The control plane must see across agents

This is where an AI control plane becomes more important than another model upgrade.

The control plane is the layer that connects data, systems, people, and agents. It should not only route tasks. It should understand the decision graph across the firm.

At QUANTEX, we think of this as a Governed Brain: a neurosymbolic AI layer combining model-based reasoning with explicit symbolic controls.

The distinction matters.

Neural systems are useful for interpreting unstructured information, identifying patterns, and generating recommendations. Symbolic controls are necessary for policies, permissions, thresholds, escalation paths, and audit requirements.

Together, they enable a system that can ask:

  • Are multiple agents responding to the same source?

  • Are recommendations converging across desks or workflows?

  • Has a model changed its behavior after a vendor update?

  • Is an agent operating outside its approved mandate?

  • Does a tariff, rate, or cyber scenario require a different response path?

  • Should an action be paused because correlated exposure has crossed a limit?

  • Can the firm explain exactly why the output was produced?

This is not a chatbot with a compliance disclaimer attached.

It is orchestration, supervision, policy enforcement, real-time monitoring, and auditability across the agent population.

Explainability is not optional

In regulated markets, “the model recommended it” is not an explanation.

A governed system must provide 100% explainable outputs: the relevant inputs, the applicable rules, the model or agent involved, the reasoning path, the approvals, the exceptions, and the final action.

Every decision should be attributable.

Every workflow should be reviewable.

Every policy breach should be visible before it becomes an incident.

That includes the decision not to act.

If an agent suppresses an alert because another agent classified the same event as low risk, the system needs to preserve that chain. If a control plane forces divergence by routing the event to an independent challenge agent, that intervention should also be recorded.

Auditability is not paperwork after the fact. It is how the firm proves that automation remains inside its mandate.

An auditable sequence of AI decisions moving through monitoring and approval checkpoints

The question every firm should ask now

Do not ask only whether your AI agents are accurate.

Ask whether they are becoming identical.

Measure correlation across:

  • Recommendations

  • Escalations

  • Exception classifications

  • Portfolio actions

  • Funding assumptions

  • Cyber responses

  • Vendor dependencies

  • Human overrides

Then define intervention rules.

If five agents agree, perhaps that is useful consensus. If 500 agents agree because they share one model, one data source, and one objective, that may be concentration risk disguised as intelligence.

The next phase of AI governance will not be won by firms with the most agents.

It will be won by firms that can see the entire agent population, identify synchronized behavior, and deliberately keep decision-making resilient under stress.

That is the role of the AI control plane.

Explore the QUANTEX AI Control Plane for Capital Markets or book a demo to see how governed, auditable AI workflows can connect your systems, supervise your agents, and keep your firm differentiated as models converge.

 
 
 

Comments


bottom of page