Can a dataset distinguish missing evidence from evidence that never existed?
Generated cases can separate retrieval gaps, retention losses and omitted process steps, allowing evaluation of how agents investigate and report different kinds of absence.
**Can the release contain missing records?**
Yes. A release can include cases where an expected record is absent, but the generation specification should distinguish the reason for that absence. Otherwise, an evaluation may reward confident guesses about information the agent cannot establish.
**Which distinctions are useful?**
A record may exist in an unsearched archive, be unavailable because its retention period has elapsed, or never have been created because a required step was omitted. Another case may have no record because the step was not applicable. These conditions call for different conclusions and follow-up actions.
**How can the task make those differences discoverable?**
An archive index can point to another repository. A disposal register can explain a retention loss. A process event log can show that a required step was skipped. Applicability rules can explain why no record was expected.
**Must every case have a discoverable answer?**
No. Some cases can remain unresolved within the agent’s permitted information. The evaluator should then accept a bounded statement of uncertainty and a targeted evidence request. It should not require the agent to infer hidden facts that the task never exposes.
Specify the cause of absence so the evaluation rewards an appropriate investigation and conclusion.
- Audience:
- Evaluation teams
- Content type:
- FAQ
- Buyer question:
- What can be generated
Content release: r-a220eb6e099b243b
Related questions
- What generated artefacts can define the evidence package an agent must produce?
- What can generated material contain beyond approvals and attachments?
- Can a task pack represent evidence that should exist but cannot be found?
- How can generated exports preserve precise evidence references?
- How can generated records represent corrections without erasing earlier evidence?
- How can generated policy and authority records create a useful evidence task?