Skip to content
MirrorFirm

What should we ask for in an approval-authority sample or pilot?

A checklist of eight requests that make a pilot specific enough to accept or reject against written checks, from domain and splits to acceptance tests and permitted use.

A useful sample or pilot request is specific enough that you can accept or reject it against written checks.

- State the domain, roles and authority dimensions you want covered, and the exceptions you expect to see. - Ask for linked tables, policy documents in at least two versions, and a data dictionary. - Request expected outcomes and reason codes held separately from the model-visible inputs. - Specify a held-out split by organisation or policy variant, and say how you will use it. - Ask for the generation method to be described, including how grounding and disclosure risk are addressed. - Agree the formats you need, such as JSONL, Parquet or Markdown, and the tool schema if an environment is involved. - Write your acceptance checks first, including label recomputation and perturbation tests. - Confirm permitted use, retention and versioning before any material is loaded into a training run.

A specific, check-driven pilot request lets you reach a clear continue-or-stop decision from the first sample.

Audience:
Model labs
Content type:
Checklist
Buyer question:
Scope and getting started

Content release: r-a220eb6e099b243b

More on Delegated approval