How should an evaluation represent the lifecycle of a handover?
Representing a transfer as linked events lets evaluators distinguish attempted handovers from accepted work and detect invalid lifecycle transitions.
A generated environment could represent each transfer as an event sequence rather than a mutable assignment field. Useful fields include `transfer_id`, `case_id`, `event_id`, `event_type`, `actor_role`, `from_team`, `to_team` and `occurred_at`. A `caused_by_event_id` link can connect a receipt or rejection to the dispatch that prompted it.
Define permitted transitions in a separate schema. A transfer might move through prepared, dispatched, received and accepted, with rejected and withdrawn as alternative outcomes. Keep the transfer lifecycle separate from the case lifecycle: accepting responsibility does not resolve the underlying work.
Tool actions could include `prepare_transfer`, `dispatch_transfer`, `accept_transfer` and `reject_transfer`. Each action should declare its preconditions and return the resulting event identifier. Invalid transitions should produce structured errors that the evaluator can inspect.
An evaluation hook can compare the emitted event sequence with the permitted transition graph. This catches agents that claim acceptance without a receiving action, accept a withdrawn transfer or confuse case closure with transfer completion. JSONL can preserve the ordered events for replay and inspection.
Make handover progress observable through explicit events and transition rules.
- Audience:
- Evaluation teams
- Content type:
- Integration
- Buyer question:
- What it is and why it matters
Content release: r-a220eb6e099b243b
Related questions
- What happens when a receiving team acts before a prerequisite is satisfied?
- Why should an agent see handover events as well as current record state?
- Which process boundaries make useful training cases for connected agents?
- Why does a transfer of ownership matter more than forwarding a record?
- Why are ordinary document summaries insufficient for handover training?
- Which handover characteristics make a useful environment-building target?