Skip to content
MirrorFirm

Which licence questions matter for generated review benchmarks?

Licence discussions should distinguish internal evaluation, training, external distribution and publication of derived artifacts rather than treating every downstream use as equivalent.

**What should we ask about the licence?**

Describe each intended use separately: internal benchmarking, model training, contractor access, hosted evaluation and redistribution of task material. Ask which uses a proposed licence would cover. Do not assume permission for one establishes permission for the others.

**What about publishing benchmark results?**

Explain whether publication would contain aggregate results, task excerpts, complete prompts, generated records or agent traces. Traces may reproduce substantial task content. Ask how each artifact would be treated, including publication through a public tool interface or downloadable export.

**Can related teams reuse the pack?**

Identify the teams and systems that need access, including external evaluators and shared data platforms. Ask how the proposed scope handles that access and any copies retained in evaluation logs or training pipelines.

**What is a useful first step?**

Prepare a short usage map showing who receives the material, what transformations occur and which artifacts leave the organisation. MirrorFirm and the buyer can use that map to discuss licence scope. Specific rights and restrictions need to be established in the proposed agreement.

Describe the intended flow of generated material so the licence discussion covers the uses your evaluation programme actually needs.

Audience:
Evaluation teams
Content type:
FAQ
Buyer question:
Scope and getting started

Content release: r-a220eb6e099b243b

More on Periodic review