How can a sample reveal a missing scope decision before a pilot expands?
A closed-period correction sample exposes an unspecified accounting policy, giving the buyer a concrete issue to resolve before evaluating model behaviour.
A lab requests a sample involving a professional services expense charged to the wrong project. Source entry ENT-2187 belongs to period PER-0412, which is closed. Correction case CASE-0638 contains adequate evidence and a valid approval, but the brief does not specify how closed-period corrections should be handled.
During review, one evaluator expects a current-period adjustment. Another expects referral for a period reopening decision. Both interpretations depend on a policy the sample has not supplied. The disagreement therefore cannot yet support a useful judgement about the model.
The buyer asks for a defined period policy and chooses current-period adjustment as the pilot's permitted route. The generated sample gains policy record POL-0194 and a reporting explanation that preserves the relationship to the original period. Period reopening remains outside the selected scope.
This teaches a practical starting discipline: use a sample to expose missing business rules before fixing the evaluation criteria. A useful pilot brief records the resolved policy choice, the expected state change and the excluded alternative so later cases measure the intended behaviour.
Use sample disagreements to refine the task specification before treating them as model failures.
- Audience:
- Model labs
- Content type:
- Scenario
- Buyer question:
- Scope and getting started
Content release: r-a220eb6e099b243b
Related questions
- How can a pilot cover closed accounting periods without modelling an entire finance function?
- What licence questions should we resolve before using generated material in an agent pipeline?
- What should a correction pilot brief specify before generation begins?
- What integration details should we settle before loading a pilot into our agent harness?
- What is a useful first scope for an agent correction pilot?
- How can a pilot expose a scope boundary without implementing an entire finance system?