What delivery layout should I ask for in a pilot so my harness can load it?
A pilot delivery is easier to review with a manifest, schemas, snapshots, task specifications, policies, reference traces, graders and a licence notice, with stable keys and versioning.
A pilot delivery is easier to review when it follows a predictable layout.
- **manifest.json**: release id, schema version, file list, and a content hash for each file - **schema/**: JSON Schema for each table plus the status transition table - **snapshots/**: starting state for each task as Parquet or JSONL - **tasks.jsonl**: task specifications with goal, scripted events, expected end state and protected fields - **policies/**: structured rules and readable policy text, linked by rule_id - **reference/**: a scripted solution trace for each task - **graders/**: code or declarative checks that read the diff and step log - **LICENCE and NOTICE**: the terms agreed for this delivery, and a statement that the contents are generated
Keys are stable across files, so case_id in documents matches case_id in cases. Version numbers change when a schema changes, and a changelog lists altered fields, which stops silent drift between releases.
Ask for a small loader script or a documented read path so your harness can ingest the files without guesswork. Also ask what the random seeds control, so you can reproduce a given snapshot.
What each directory contains and how large it is are scoping decisions. Settle them in the pilot rather than assuming a standard layout.
A predictable layout with hashes, stable keys and a changelog lets your team load, verify and compare releases without guesswork.
- Audience:
- Environment builders
- Content type:
- Integration
- Buyer question:
- Scope and getting started
Content release: r-a220eb6e099b243b
Related questions
- What does a scoped pilot for a claim lodgement agent look like?
- What should a pilot brief for intake include?
- What should we ask for in an intake sample or pilot?
- How should a team scope a first intake dataset or pilot?
- How do we connect pilot material to our agent harness?
- What does a first pilot look like for a professional services engagement request environment?