The artificial intelligence industry is currently obsessed with one question:
How capable are the agents?
Every benchmark, leaderboard, product launch, and research paper seems to focus on capability.
- Can the model write code?
- Can it use tools?
- Can it browse the web?
- Can it build applications?
- Can it complete tasks autonomously?
The assumption behind almost all current development is simple:
More capability leads to more useful agents.
But there is growing evidence that this may not be the most important question at all.
A different question may be emerging:
How closely does an agent's perception of reality match reality itself?
Because capability without reality alignment can become extraordinarily dangerous.
The Fundamental Assumption
Most agentic systems are built around an implicit assumption:
Observe → Reason → Act
The agent observes the environment.
The agent reasons about what it sees.
The agent takes action.
If the reasoning improves, the actions improve.
Simple.
Elegant.
Widely accepted.
Unfortunately, reality is not quite that simple.
The assumption hides a critical weakness:
The agent never directly experiences reality.
It experiences representations of reality.
This distinction is easy to overlook.
But it may prove fundamental.
The Map Is Not The Territory
Humans have known this problem for decades.
The philosopher and semanticist Alfred Korzybski famously observed:
The map is not the territory.
A map can be useful.
A map can be accurate.
A map can even be highly predictive.
But the map is still not reality.
Agentic systems face the same challenge.
An agent never sees reality directly.
Instead it sees:
- prompts
- logs
- files
- databases
- APIs
- sensor streams
- status messages
- model outputs
These are maps.
Not territory.
The difficulty arises when the agent begins treating the map as reality.
This is where many modern failures originate.
The Emergence of AEDD
This leads to a useful concept:
Agentic Emergence Delusion Delta (AEDD)
AEDD represents the gap between:
The reality the agent believes exists
and
The reality that actually exists.
In simple terms:
AEDD = Perceived Reality − Actual Reality
Small AEDD:
The agent's understanding closely matches reality.
Large AEDD:
The agent's understanding has drifted away from reality.
This is not merely a technical problem.
It is potentially the defining limitation of autonomous systems.
Why Capability Is Not Enough
Imagine two agents.
Agent A:
- Highly intelligent
- Excellent reasoning
- Strong planning
- Excellent coding
But:
- Poor reality alignment
Agent B:
- Less intelligent
- Less sophisticated
But:
- Strong reality alignment
Which would you trust to deploy software?
Which would you trust to move money?
Which would you trust to control machinery?
Which would you trust to operate infrastructure?
The answer is not obvious.
Because capability and reality alignment are not the same thing.
In fact, increasing capability may amplify the consequences of poor reality alignment.
The Agentic Illusion
Consider a common software example.
The agent reports:
"Authentication implemented."
What does that actually mean?
Possible interpretations include:
- Login page created
- Authentication service created
- Session handling created
- User database connected
- Password reset implemented
- Route protection enabled
Or perhaps only one of those things happened.
The statement sounds complete.
Reality may be incomplete.
This creates what might be called:
The Agentic Illusion.
The appearance of completion without verified completion.
The appearance of understanding without verified understanding.
The appearance of reality without reality.
Why Current Benchmarks Miss The Problem
Most current benchmarks evaluate:
- reasoning quality
- code generation
- tool use
- task completion
They rarely evaluate:
- reality correspondence
- outcome verification
- dependency completeness
- operational correctness
As a result, agents are frequently rewarded for producing convincing outputs rather than correct outcomes.
The benchmark may say:
Success.
Reality may say:
Failure.
This creates a dangerous blind spot.
The Dependency Problem
The issue becomes clearer when viewed through dependencies.
Suppose a user asks:
"Create customer login."
Most systems immediately think:
Create login page.
Yet customer login is not a page.
It is an outcome.
That outcome depends upon:
- User records
- Authentication
- Sessions
- Security
- Navigation
- Error handling
- Recovery mechanisms
- Access control
Without understanding dependencies, the system cannot determine whether the outcome exists.
It can only determine whether an artefact exists.
This is a fundamental distinction.
Most agents currently operate at the artefact level.
Businesses operate at the outcome level.
Why AEDD Is Difficult To Measure
AEDD sounds simple.
In practice it is difficult.
Reality is often:
- delayed
- incomplete
- noisy
- inaccessible
A bank transfer may be pending.
A deployment may be propagating.
A machine may still be executing.
Reality exists.
But verification may not yet exist.
This means systems require a third state:
Unknown.
Current agent architectures frequently collapse:
Unknown
into
True.
The result is gradual reality drift.
Humans Suffer From AEDD Too
This is not an AI problem.
It is a cognition problem.
Humans exhibit exactly the same behaviour.
- Managers believe projects are on track.
- Investors believe assumptions are valid.
- Engineers believe systems are working.
Entire organisations can become trapped inside self-reinforcing belief structures.
History is full of examples.
The difference is scale.
Agentic systems can accumulate reality divergence at machine speed.
The Hidden Danger Of Emergence
Recent research has focused heavily on emergence.
- Can agents self-organise?
- Can graphs self-stabilise?
- Can attractors form?
- Can behaviours emerge?
The answer increasingly appears to be:
Yes.
The more important question is:
Can emergent systems remain coupled to reality?
Because emergence alone guarantees nothing.
- A self-reinforcing structure can be wrong.
- A stable attractor can be wrong.
- A resilient topology can be wrong.
- A highly emergent system can possess a very large AEDD.
This may be one of the most important observations in the entire field.
The Coming Agentic Liability Crisis
The industry currently measures:
Capability
while largely ignoring:
Reality Alignment
As agents gain authority, this imbalance becomes dangerous.
The risk is not:
- Low Capability
- High AEDD
The risk is:
- High Capability
- High AEDD
Because such systems can produce large numbers of plausible actions while remaining disconnected from reality.
This creates a new form of operational liability.
The agent is not malicious.
The agent is not incompetent.
The agent is simply acting upon an inaccurate representation of reality.
The Future May Depend On Reality Coupling
The next generation of systems may need to be evaluated differently.
Instead of asking:
How intelligent is the agent?
We may need to ask:
- How reality-coupled is the agent?
- How effectively can it detect reality divergence?
- How quickly can it reduce AEDD?
- How accurately can it recognise uncertainty?
- How effectively can it distinguish assumptions from facts?
These questions are far less glamorous than capability benchmarks.
Yet they may ultimately prove more important.
A New Foundation
For decades, computing focused on correctness.
Modern AI shifted attention toward capability.
The next phase may require a third dimension:
Reality Alignment.
Not merely:
Can the system think?
Not merely:
Can the system act?
But:
Can the system remain coupled to reality while thinking and acting?
That challenge sits at the heart of AEDD.
And solving it may prove more important than building ever more capable agents.
Because intelligence disconnected from reality is not intelligence.
It is simply a more sophisticated form of delusion.
AuthOrigin
Preserving the difference between knowing, believing, inferring and acting.
The problems explored in this essay — plausible answers replacing genuine knowledge, inferences treated as facts, decisions made without traceable authority — are not separate issues. They share a common cause: the epistemic state of information is lost in transit.
AuthOrigin preserves the knowledge-to-consequence chain. Every piece of information carries its epistemic state — not just what it says, but what it is:
Before knowledge is reused: what is it? Before it is trusted: where did it come from? Before it is acted upon: who has authority? Before the outcome is forgotten: what happened?
"AuthOrigin doesn't need to know what the problem is. It needs to preserve the evidence from which the problem can be demonstrated — and the conditions under which a solution can be trusted."
Newsletter
Stay in the loop.
New essays on AI, systems thinking, and the infrastructure of the future — delivered when they're ready.