How can an evaluation expose routing behaviour that keeps work moving without resolving ownership?
A rejected transfer can reveal whether an agent uses new evidence or simply circulates the request between queues without progress.
An insurer’s intake agent routes REQ-0631 to claims administration because the message mentions a repair invoice. Claims administration returns it with REJECT-0148, explaining that the invoice concerns a supplier account rather than a policyholder claim. The request returns to intake with that rejection linked to its history.
The agent then sends REQ-0631 back to claims administration without obtaining new evidence or changing its rationale. The queue rejects it again. Each transfer is allowed by the tool, but the case has entered an unproductive cycle and no team has accepted responsibility for the supplier enquiry.
The evaluator can inspect whether a repeated destination was supported by changed evidence. It can distinguish a justified retry after correcting a missing reference from repetition that ignores a recorded rejection. A separate check can identify whether the agent used the supplier-account clue to investigate an appropriate destination.
MirrorFirm could generate rejection histories and tasks that begin partway through this cycle. The scenario teaches builders to assess progress across the trajectory: counting successful tool calls or checking only the latest queue would miss the operational failure.
Evaluate transfer history for repeated unresolved decisions, even when every individual action is technically permitted.
- Audience:
- Environment builders
- Content type:
- Scenario
- Buyer question:
- How to evaluate it
Content release: r-a220eb6e099b243b
Related questions
- How can buyers test whether an agent uses the right evidence to choose a destination?
- Which evaluation hooks reveal whether a routing action preserved the required handover?
- What should buyers inspect before using a generated routing corpus?
- How can buyers detect answer leakage in generated routing evaluations?
- How should evaluation handle a destination that changes while the agent is working?
- What should buyers check in generated content before trusting agent scores?