What should we ask for in a sample, and what limits and licence questions come up?
Answers on what a first sample should contain, what to ask about generation, the synthetic nature of the output, licence limits and how scope can change after review.
**What should we ask for in a first sample?** A small set of cases in your target format, each with policy text, a timeline, a labelled outcome and a grader. Ask for a spread that includes clean cases and the difficult ones you care about.
**What can we ask about how it was generated?** Ask how cases were derived from observation of operating practice, what is generated and what is authored, and what checks were run. Judge the answers against your own review of the sample.
**Is any of it real business data?** No. The commercial product is generated, synthetic material. Review for grounding and disclosure risk is still your call, and the sample is the place to do it.
**What limits apply to use?** Use terms are set in the licence, which is agreed per engagement. Raise anything you need early, such as permitted training use, evaluation-only use, sharing of results or retention.
**Can the scope change after the first sample?** Yes. Domain, volume, difficulty mix, tool surface and format are all scoping choices, so a pilot is a reasonable place to change them.
**How long will it take and what will it cost?** Those depend on scope and are agreed in conversation; no fixed figures are published here.
Ask for cases with policy, labels and graders, raise licence questions early, and expect to adjust scope after reviewing the first sample.
- Audience:
- Model labs
- Content type:
- FAQ
- Buyer question:
- Scope and getting started
Content release: r-a220eb6e099b243b
Related questions
- What does a first pilot review look like for a referral-processing agent team?
- How is generated conditional-approval material licensed, and what limits apply?
- What should a pilot request include so the first sample can be judged quickly?
- How should I scope a first pilot for conditional-approval material?
- How do I wire a pilot sample into my agent harness for a first run?
- What should I ask for in a first sample or pilot?