What failure modes should I test for in agents doing booking tasks?
Test for premature activation, silent correction, stale approvals, missing links, schedule drift, over-escalation and invented values, using cases where correct behaviour is clear and detectable.
Test for the failures that cost money or break handovers, not only for wrong field values.
Common failure modes:
- **Premature activation:** the agent sets the facility to ACTIVE while a condition is open. - **Silent correction:** the agent overwrites a differing rate instead of querying credit. - **Stale approval:** the agent books against an approval that has since been amended. - **Missing link:** security or a co-borrower is not attached to the facility. - **Schedule drift:** the repayment schedule is built before terms are final and is not rebuilt. - **Over-escalation:** the agent raises a query on every case, which is safe but unhelpful. - **Invented values:** the agent fills a missing field with a plausible figure.
Each mode needs a case where the correct behaviour is clear and a grader can detect the wrong one from the final state or the action log. Include matching clean cases, where the right move is simply to proceed, so you can measure over-escalation as well as under-escalation.
When you describe the release to customers, say which modes the cases cover. Ask in the pilot for a mapping from each case to the failure mode it is meant to expose.
Tagging each case to a failure mode lets your customers see which behaviours an agent gets wrong, not only that a task failed.
- Audience:
- Licensed resellers
- Content type:
- FAQ
- Buyer question:
- How to evaluate it
Content release: r-a220eb6e099b243b
Related questions
- What checks should run on every booking task in an evaluation?
- Which failure modes should we expect to see and how should we score them?
- How can a buyer inspect the quality of generated booking material?
- What reset, snapshot and grader hooks would an evaluation harness need?
- How would an evaluation expose an agent that creates duplicate accounts on retry?
- How do I know whether my success criteria for booking tasks are strict enough?