Skip to content
MirrorFirm

What should I prepare before a scoping conversation for a pilot?

A checklist of decisions and information to bring to a scoping conversation so a conditional approval pilot can be defined narrowly and reviewed quickly.

Bring these items to a scoping conversation so a pilot can be defined narrowly and reviewed quickly.

- Name the intended use, whether training, evaluation or both, and whether results will be shared outside your organisation. - Pick one starting domain and the approval type within it, such as a loan, an insurance policy or a network connection. - List the failure modes you want exercised, for example outdated evidence or pressure to proceed early. - State the delivery format you need, such as JSONL, Parquet, or an environment with tool schemas and a reset. - Ask for policy text, labels and graders to accompany the cases, not records alone. - Nominate who will review the sample for realism, label correctness, grounding and disclosure risk. - Agree the sample size and the success criteria for the pilot before it begins. - Raise licence questions early, including training use, retention and redistribution of derived results.

Arriving with intended use, domain, failure modes, format and reviewers named makes the first sample faster to define and easier to judge.

Audience:
Model labs
Content type:
Checklist
Buyer question:
Scope and getting started

Content release: r-a220eb6e099b243b

More on Approval conditions