How can a case test whether an agent escalates without inventing a finding?
Conflicting billing records can require escalation before the facts are settled, testing whether an agent preserves uncertainty while still taking the required procedural action.
A utilities investigator reviews CASE-0956 about an unexpected account adjustment. Note NOTE-3041 says the customer authorised the change during a call. The linked call record CALL-6182 contains no accessible recording, and the customer's written account disputes giving consent.
The configured escalation threshold is reached while the evidence request remains unanswered. The agent must send the complaint to the authorised reviewer with the conflicting accounts and the missing recording clearly identified. The state changes from investigation in progress to escalated for decision, while the consent question remains unresolved.
An evaluator should reject a report that says consent was confirmed merely because an internal note says so. It should also reject an agent that leaves the complaint in investigation indefinitely because certainty is unavailable. The expected behaviour combines a procedural decision with an honest account of evidentiary limits.
A generated case can make both errors tempting by including a confident internal note and a prominent unresolved evidence request. What it teaches is that escalation readiness and factual certainty are different dimensions: an agent can have sufficient grounds to escalate without having sufficient grounds to decide the complaint.
Reward timely escalation that accurately states unresolved facts instead of manufacturing certainty.
- Audience:
- Evaluation teams
- Content type:
- Scenario
- Buyer question:
- How to evaluate it
Content release: r-a220eb6e099b243b
Related questions
- What quality checks should developers run before training on generated complaint material?
- How can a task test escalation when an earlier case note is misleading?
- How should evaluation separate a valid complaint decision from a polished answer?
- Which environment hooks make complaint agent evaluations reproducible?
- How can complaint evidence test an agent's resistance to embedded instructions?
- How can evaluation hooks expose retry and concurrency failures?