Skip to content
MirrorFirm

Can a task pack include reference answers, rationales and hard negatives?

Answers on what a task pack can carry beyond instructions: reference outcomes, rationales, near-miss distractors, time-based events and domain framing, with a reminder that all content is generated.

**Can a task pack include the correct answers?**

Yes. A pack could carry a reference final state for each task, such as the allocations that should be posted, the amounts that should be parked and the cases that should be opened. It could also carry an acceptable-alternatives list where policy allows more than one valid outcome.

**Can it include the reasoning behind them?**

A buyer can ask for a short rationale per task that cites the policy rule and the records used. This helps reviewers audit the reference and helps you build rubric-based scoring.

**Can I get hard negatives?**

Ask for near-miss cases: invoices with close numbers, customers with similar names, amounts that match two open items, and references that point to a cancelled document. These are the cases where weak agents tend to guess.

**Can the data include time?**

Yes. Records can carry dates, and a scenario can include later events such as a bank reversal or a late credit note. That lets you test whether an agent revisits an earlier allocation.

**Can I choose the domain?**

The workflow can be framed in financial services, insurance, utilities, logistics, healthcare administration, retail operations or professional services. The policies and vocabulary change with the domain, which is worth specifying in a pilot.

**Is any of it real?**

No. The output is generated, not real business records. Inspect samples for grounding and disclosure risk before you use them.

Request reference outcomes with rationales and near-miss cases, so you can audit the pack and see where agents guess.

Audience:
Evaluation teams
Content type:
FAQ
Buyer question:
What can be generated

Content release: r-a220eb6e099b243b

More on Payment allocation