How should a model lab scope and license escalation material?
Scoping combines a domain, a form such as dataset, task pack or environment, and an intended use, and the licence should reflect training, evaluation and publication plans.
Scoping starts with three choices: the domain, the form of the material, and the use. Domain could be lending, insurance claims, utilities hardship or another setting where delegated authority applies. Form could be a generated dataset, a task and evaluation pack, or a simulated environment with tools and reset. Use could be training, evaluation, or both.
Each use changes what you should ask for. Training material benefits from variety across authority structures and case types. Evaluation material benefits from labelled gold outcomes, held-out cases and graders. If you intend to do both, ask how to keep evaluation items separate from anything used for training, so contamination is controlled.
Licensing terms are agreed with MirrorFirm for each engagement. Raise your intended use early, including whether you plan to train a model, evaluate one, publish results, or share the material with partners, because these affect which licence fits. This entry does not set prices, timelines or terms; those are discussed when you scope.
Limits to plan for: the output is generated, so it does not represent any specific organisation, and you should inspect it for grounding and disclosure risk. It will cover the structures and variations you specify, not every possible practice. Policies and limits in the material are constructed and should not be treated as advice about how a real business must operate.
A sensible first step is a small sample in one domain, reviewed against the checks in your own evaluation plan.
Decide domain, form and use first, then state them early so the licence matches what you intend to do.
- Audience:
- Model labs
- Content type:
- Explanation
- Buyer question:
- Scope and getting started
Content release: r-a220eb6e099b243b
Related questions
- What licensing questions should I raise for generated escalation material?
- What might a first escalation pilot show an agent team?
- What should my team prepare to start an escalation pilot?
- How should I scope a first escalation pilot with MirrorFirm?
- What should I ask for in an escalation sample or pilot?
- What licensing, limits and boundaries should a buyer ask about before a pilot?