What does a first sample review look like for an environment team?
A scenario following an environment team through loading a first sample, running a reference solver and deciding what to change before a larger release.
An environment team building a lending simulator requests a sample covering three task families: clean booking, booking after an amendment, and a file that should be returned.
A platform engineer loads the Parquet tables and the JSONL task file into the harness. The manifest check passes, and a key-integrity script confirms that every `facility_id` resolves to an `approval_id`.
A second engineer runs a reference solver over the tasks. Two findings come out:
- TASK-0207 cannot be solved, because the policy document referenced by the task is missing from the folder. - TASK-0215 passes, but so does a deliberately wrong run that activates early, which shows the expected state omits the drawdown flag.
The team also reads a handful of handover notes. One note repeats the wording of another almost exactly, which they record as a variety concern.
They send a short list back: add the missing policy, include `drawdown_enabled` in the expected state, and vary the note phrasing. The next iteration of the sample addresses these items, and the team runs the same checks again.
**What it teaches:** the value of a first sample is the list of defects it surfaces. Decide in advance who runs the checks, what counts as a defect and how it is reported back.
A first review is a short loop of load, solve, grade and feed back, and the findings shape the next release.
- Audience:
- Environment builders
- Content type:
- Scenario
- Buyer question:
- Scope and getting started
Content release: r-a220eb6e099b243b
Related questions
- What does a first pilot look like for an agent team in vendor finance?
- What limits apply, and will we receive any real customer records?
- How could a pilot be delivered, versioned and wired into our CI?
- How should a team scope and license a generated booking pack?
- What should we ask for in a sample or pilot of generated booking material?
- How should a sample be delivered, versioned and load-checked in my pipeline?