What file layout and formats can a pilot delivery use?
A pilot delivery can use a manifest, per-system Parquet tables, a links table, policy files, JSONL tasks and graders, split assignments, and optional environment snapshots with pinned schema versions.
A pilot delivery can be organised so a lab's pipeline ingests it without custom parsing. A buyer can ask for the following layout and confirm it during scoping.
- `manifest.json`: schema version, generation date, file list with checksums, the split rule and the generator seed - `systems/`: one Parquet file per source system, such as `bank_feed`, `ledger` or `claims`, each keyed by `record_id` - `links.parquet`: `from_id`, `to_id`, `link_type` and a flag for partial or absent links - `policies/`: policy text as Markdown plus a machine-readable `limits.json` with tolerances, approval limits and reason codes - `tasks.jsonl`: model-facing task statements with `task_id`, role, starting references and allowed tools - `grader.jsonl`: withheld fields such as `root_cause` and `target_state` - `trajectories.jsonl`: optional step-by-step working, one line per task - `splits.csv`: `task_id`, `split` and `template_id`
If an environment is requested, the delivery adds a seed snapshot per task and the reset and grade entry points. JSONL suits record-at-a-time training pipelines; Parquet suits joins and sampling.
Ask for schema versions to be pinned and for any change between pilot rounds to be listed in a changelog, so evaluation results from different rounds stay comparable. Checksums let you confirm exactly which files a given run used.
A predictable layout with a manifest, checksums and pinned schemas lets your pipeline ingest each round without custom parsing and keeps results comparable.
- Audience:
- Model labs
- Content type:
- Integration
- Buyer question:
- Scope and getting started
Content release: r-a220eb6e099b243b
Related questions
- What does a first sample review look like for a bank feed and ledger pilot?
- How is generated mismatch material licensed, and what limits apply?
- What technical steps make up a useful first end-to-end trial?
- How should I scope a pilot for this workflow?
- What should a pilot brief for a mismatch environment include?
- How should a pilot delivery be packaged so it loads into our environment?