Which quality checks should we run on a release before listing it?
A checklist of rule, time, conflict, boundary, coverage, consistency and text checks that a reseller can run on an authority-limited approval release.
Run these checks on each version of a release, and keep the queries so the results can be repeated.
- **Limit adherence:** every approval's amount sits within the approver's matrix limit or active delegation cap, unless the record is labelled as an exception. - **Delegation validity:** every delegation is valid on each decision date it supports, and revoked delegations are not used after revocation. - **Separation of duties:** no request is approved by the role that submitted it, except in labelled conflict-of-interest cases. - **Boundary cases:** amounts exist exactly at, just below and just above each limit, so threshold behaviour can be tested. - **Outcome spread:** approvals, partial approvals, rejections, escalations and withdrawals all appear across amount bands and risk ratings. - **Policy agreement:** the policy text and the structured matrix agree on limits; sample a handful of rows by hand. - **Text review:** notes and reason codes are checked for repeated templates and for wording that could trace back to a real person or organisation.
Record which checks were run, on which version, and what was found.
These checks are mostly simple queries, so a reseller can run them on every version and keep the results as evidence of what was inspected.
- Audience:
- Licensed resellers
- Content type:
- Checklist
- Buyer question:
- How to evaluate it
Content release: r-a220eb6e099b243b
Related questions
- Which failure modes should an approval agent evaluation include?
- How do I inspect the quality of generated authority rules and approval cases?
- How do environment reset, state diffs and grader hooks work for approval tasks?
- What success criteria should I use for an agent handling approvals?
- How does an evaluation catch an agent approving its own requester's credit adjustment?
- What checks should I run before accepting a generated approval sample?