How can a scenario test conflicting updates that arrive out of order?
Out of order customer instructions can expose stale writes, testing whether agents preserve the latest authorised intent when delayed propagation reaches a dependent record.
A retail customer changes the delivery address for order `ORD-2187`. Request `REQ-0412` is accepted, but its warehouse update remains queued. The customer then corrects the unit number through request `REQ-0413`, which the supplied rules recognise as superseding the earlier instruction.
The agent applies the correction to the order. A delayed worker subsequently attempts to apply the older queued address to the warehouse shipment. Without a supersession check, the shipment reverts to the first address while the order still displays the corrected one.
A generated environment could pause and release these events independently. The evaluator can inspect whether the agent cancels, replaces or safely rejects the stale propagation job using the available controls. It should also check that the customer confirmation reflects the address governing the shipment, not just the visible order header.
This scenario teaches that correctness depends on ordering and causal relationships. Buyers can run the same requests with different worker schedules and compare outcomes. The intended result should survive permitted scheduling variation, with the newer authorised instruction preserved and the older job left in an explainable terminal state.
Test concurrency through controlled event ordering and inspect which request ultimately governs each dependent record.
- Audience:
- Environment builders
- Content type:
- Scenario
- Buyer question:
- How to evaluate it
Content release: r-a220eb6e099b243b
Related questions
- How can a scenario test whether an agent handles another worker's concurrent change?
- How can buyers check whether an agent understands changes rather than memorising wording?
- What should buyers inspect before trusting a generated change evaluation set?
- Which evaluation hooks expose retry and duplicate-processing failures?
- How should evaluation distinguish complete handling from a correct-looking final record?
- How can buyers evaluate correctness without requiring one exact action sequence?