How should a pilot package support installation, reset and later comparison?
A versioned package can bind schemas, initial state and evaluator configuration together so builders can reproduce runs and interpret changes between releases.
Ask for a package manifest containing `release_id`, `schema_version`, `tool_contract_version`, `policy_bundle_digest`, `initial_state_digest` and `evaluator_version`. These fields identify the components used in a run without relying on a folder name or download date.
The installation contract should state how records are loaded and references validated before a session starts. JSONL event fixtures and Parquet state tables can coexist if the manifest identifies their roles and loading order. Reject incompatible schemas before creating partial environment state.
Define `reset` as restoration of a named initial snapshot plus any documented seeded variation. A reset response can return `session_id`, `snapshot_id` and `seed`, allowing an evaluation record to identify its exact starting conditions.
Keep a package change log that distinguishes content corrections from changes to business rules or scoring. Results from different evaluator versions may require rerunning before comparison. A useful first integration step is to load the sample, execute its supplied walkthrough and reset it, confirming that the restored state matches the declared snapshot.
Treat the pilot as a reproducible environment dependency with explicit compatibility and reset contracts.
- Audience:
- Environment builders
- Content type:
- Integration
- Buyer question:
- Scope and getting started
Content release: r-a220eb6e099b243b
Related questions
- How can a pilot cover closed accounting periods without modelling an entire finance function?
- What licence questions should we resolve before using generated material in an agent pipeline?
- What should a correction pilot brief specify before generation begins?
- What integration details should we settle before loading a pilot into our agent harness?
- What is a useful first scope for an agent correction pilot?
- How can a pilot expose a scope boundary without implementing an entire finance system?