Admin asking for SSO
The system prompt says to route SSO questions to sales. The SSO help article tells users to enable it themselves in settings.
AI and agent builders
Your agent is only as good as what you tell it. Subjourney runs your instructions, knowledge base and process docs as journeys, with simulated users and the agent's own path, so you find the gaps in context before they become wrong answers in production.
A person who hits a gap in a doc stops and asks. An agent fills it, confidently, and moves on. Every ambiguous instruction becomes a behaviour you didn't choose.
Evals tell you the output was wrong. They rarely tell you which line of context made it wrong, or what was missing.
The unstated rule.
Your support agent's instructions cover refunds and cancellations, but not the customer who wants both.
The knowledge gap.
The agent is told to “follow the escalation policy”. The escalation policy isn't in its context.
The instruction conflict.
The system prompt says “never promise timelines”; the help-centre article it retrieves promises 48 hours.
The goal it can't reach.
A user persona with a reasonable request and no path through the agent's tools and docs to get there.
| Evals alone | Evals plus context runs | |
|---|---|---|
| A wrong answer | You know the output failed | You see the instruction or doc that caused it |
| Missing context | Shows up as a hallucination in production | Shows up as a stall, traced to the gap |
| Conflicting sources | Agent picks one, silently | Conflict flagged, both paragraphs named |
| Test cases | Written one at a time | Personas generated from the journeys your context describes |
| Context changes | Re-run the eval set and diff the scores | Re-run the journeys and see exactly what broke |
A wrong answer
Missing context
Conflicting sources
Test cases
Context changes
In practice
A team building an onboarding agent runs its context against five new-customer personas. Four reach a working setup. The fifth, on a legacy plan, stalls at data import: the agent's docs only describe the current plan's limits. The finding goes straight to their coding agent, the docs get a legacy-plan section, and the re-run passes.
A run, step by step
01Import.
The team brings the onboarding agent's system prompt, twelve help-centre articles it retrieves, and the plans-and-limits doc.
02Model.
Subjourney builds the journey.
It flags that Import data depends on plan limits that only one article describes.
03Run.
Five simulated personas set off. Choose one to see what they want and what gets in their way.
CSV userAnalyst
A CSV, not a live connection.
04Findings.
Admin asking for SSO
The system prompt says to route SSO questions to sales. The SSO help article tells users to enable it themselves in settings.
Customer on a legacy plan
The plans doc covers current plans only. The agent has no basis for legacy import limits, so it would guess.
05Fix and re-run.
Findings go to the team's coding agent, which adds a legacy-plan section and aligns the SSO guidance. Re-run: all five personas reach a first result.
The eval would have caught a wrong answer eventually. The run named the paragraph first.
Personas to start with
No. Evals score outputs. Subjourney tests the context behind them, so when an eval fails you know which line to change.
System prompts, knowledge-base docs, process docs and specs: anything your agent reads or acts on.
Yes. Send findings to the agent you build with, then re-run to verify the fix.