AgentBoundary
The result belongs to the system that was tested, not the one running today.
An AgentBoundary assessment records one workflow, one configuration and one test date. A new model, a new prompt, a new connector or a changed permission can turn it into a different workflow. Before you rely on an older result, check what has changed.
Using a result
The report describes the system that was tested. Keep it that way.
- The workflow and configuration covered by the report
- Changes that may affect earlier findings
- Questions to resolve before reusing a result
- Information to include when sharing the report
- Current assessment and certification status
01
Assessment, publication and certification are three different things
No AgentBoundary certifications have been issued or published, and the eligibility criteria haven't been published either. The work available today is scoped assessment or readiness review. Giving us permission to publish a test result doesn't earn a badge; any future certification would need published program criteria and a result that meets them.
02
What the public benchmark measures
The published AgentBoundary study evaluates how models respond to instruction-boundary scenarios through chat-completion APIs. Its model-judge results have limited agreement and no human ground-truth validation. They don't establish that an application's tools, permissions or downstream controls work. Any commissioned assessment has to state its own methods and limits in its own report.
03
Changes that can invalidate a result
- Model swaps or material model configuration changes
- Prompt, system instruction, policy, or guardrail changes
- Memory behavior changes
- Tool additions, removals, or permission changes
- Architecture changes that alter authority, isolation, retrieval, or approval flows
- Major retrieval changes including new document sources, metadata policies, or tenant boundaries
04
How to describe a result
Say what was tested, when, with which scenario set, at which versions, and which changes would call for a reassessment. If a description leaves any of those out, ask.
Limits
Scope and limitations.
- To verify a specific vendor's result, ask for its test record through the verification registry.
Related services and resources
Next step