What file layout and fields would a generated sufficiency release use?
Sets out a linked JSONL or Parquet layout with stable keys, field lists for each file and two design choices that protect evaluation integrity.
A sufficiency release can be delivered as linked JSONL files, or as Parquet if your pipeline prefers columnar reads. Keys are stable strings, so joins work without fuzzy matching.
- `cases.jsonl`: `case_id`, `case_type`, `jurisdiction`, `amount`, `opened_at`, `status_history[]`, `requirement_set_id` - `requirements.jsonl`: `requirement_set_id`, `requirement_id`, `description`, `validity_rule`, `allowed_substitutes[]`, `waiver_condition` - `documents.jsonl`: `document_id`, `case_id`, `doc_type`, `issuer`, `issued_on`, `expires_on`, `text`, `defects[]` - `links.jsonl`: `document_id`, `requirement_id`, `relation` (meets, partial, fails, irrelevant), `reason_code` - `messages.jsonl`: `message_id`, `case_id`, `direction`, `sent_at`, `requested_requirement_ids[]`, `in_reply_to` - `gold.jsonl`: `case_id`, `decision`, `unmet_requirement_ids[]`, `acceptable_actions[]`
Two design choices help evaluation. Keep `gold.jsonl` separate from the files the agent can read, so labels are never exposed by accident. And derive `relation` and `unmet_requirement_ids` from the policy fields, so changing a requirement can regenerate the labels consistently.
For Parquet, nested lists such as `status_history` can be stored as list columns. A schema file shipped with the release should state types, nullability and the enumerations for `decision` and `relation`, so a loader can validate before any run starts.
Stable keys, a separate gold file and policy-derived labels make joins reliable, prevent label leakage and let labels regenerate when a requirement changes.
- Audience:
- Evaluation teams
- Content type:
- Integration
- Buyer question:
- What can be generated
Content release: r-a220eb6e099b243b
Related questions
- Which records and relationships can a sufficiency dataset or task pack contain?
- Will a release include the documents themselves, or only metadata about them?
- What might the JSONL or Parquet schema look like for sufficiency cases?
- What should I include in a release specification for a sufficiency task pack?
- What would a generated insurance case with conflicting documents contain?
- How can one freight import case be expanded into controlled variants?