Skip to main content
Target Audience:Product EngineersArchitectsPlatform TeamsAgent Runtime Builders

What is Agent Experience (AX)?

Agent Experience (AX) is a design discipline that treats AI agents as first-class product consumers. Just as User Experience (UX) designs for human perception, cognition, and behavior, AX designs for agent perception, planning, and execution.

The Problem

Modern software interfaces are designed exclusively for human users. Every button label, layout decision, navigation pattern, and interaction flow is optimized for human visual processing and manual interaction. When AI agents attempt to interact with these interfaces, they must:

  1. Infer meaning from visual layout, CSS classes, and button text
  2. Guess relationships between form fields, validation rules, and submission actions
  3. Reconstruct intent from ambiguous labels like "Submit", "Go", or "Process"
  4. Navigate state machines that were never documented for non-human consumers
  5. Handle side effects that are only described in human-readable tooltips or documentation

This approach is fundamentally brittle. It fails whenever:

  • A CSS class name changes
  • A button label is reworded
  • A component is replaced with a different visual design
  • A page layout is restructured
  • Localization changes text content
  • Dynamic rendering alters the DOM tree
  • Anti-bot defenses are activated

The AX Discipline

AX addresses this by establishing a parallel design dimension:

DimensionUX (Human)AX (Agent)
PerceptionVisual rendering, color, layoutSemantic annotations, structured metadata
UnderstandingLabels, tooltips, documentationDeclared intent, entity types, action semantics
InteractionClick, type, drag, scrollStructured operation invocation
ValidationVisual error messages, inline hintsDeclared constraints, preconditions, error codes
SafetyConfirmation dialogs, undo buttonsRisk classification, approval requirements, idempotency declarations
DiscoveryNavigation menus, search barsSemantic manifests, tool registries

AX does not replace UX. AX complements UX by making the semantic layer of an interface explicit and machine-readable.

Core Principles of AX

1. Agents Are Consumers, Not Scrapers

An agent should be able to discover what operations are available, what parameters they require, what constraints apply, and what side effects they produce — without parsing visual layout or inferring meaning from presentation.

2. Intent Must Be Explicit

A button labeled "Go" tells a human what to do through visual context. An agent has no visual context. AX requires that every interactive element carries declared intent: product.search, order.cancel, ticket.escalate.

3. Constraints Must Be Declared

Validation rules that only exist in client-side JavaScript are invisible to agents. AX requires that constraints — required fields, value ranges, format rules, preconditions — are part of the semantic contract.

4. Safety Must Be Engineered

An agent that can submit a form can also submit a destructive operation. AX requires that risk levels, confirmation requirements, approval gates, and side-effect declarations are part of every interaction's metadata.

5. Discovery Must Be Structured

Agents cannot browse a navigation menu visually. AX requires that available operations are discoverable through structured manifests and tool registries.

AX vs Accessibility (A11Y)

AX is conceptually adjacent to accessibility but serves a different consumer:

AspectA11YAX
ConsumerHumans with disabilitiesAI agents
MediumScreen readers, keyboard navigationSemantic manifests, tool registries
GoalEqual access for all humansMachine-readable interaction contracts
StandardWCAG, ARIAAXAG
Annotationsaria-label, role, aria-describedbyaxag-intent, axag-entity, axag-action-type

Both disciplines share a common insight: explicit semantics improve interaction quality for non-visual consumers. ARIA annotations help screen readers understand interface structure. AXAG annotations help agent runtimes understand interaction semantics.

Why AX Matters Now

The proliferation of AI agents — from customer service bots to autonomous workflow engines — has created an urgent need for reliable, deterministic agent–interface interaction. Current approaches rely on:

  • Screen scraping — parsing rendered DOM to extract data and trigger actions
  • Prompt engineering — instructing LLMs to interpret screenshots or HTML dumps
  • Custom API integration — building bespoke connectors for every product

Each of these approaches is expensive, brittle, and non-portable.

AX, implemented through the AXAG standard, provides a universal semantic contract layer that any agent runtime can consume without product-specific integration work.

Next Steps