How can we check that a sample does not resemble real people or organisations?
Explains that resemblance cannot be disproved from outside, lists practical inspections and supplier questions, and stresses that generated data carries no guarantee of anonymity.
**How can we check that a sample does not resemble real people or organisations?**
You cannot prove this from the outside, and nobody should promise it. Generated data is not guaranteed to be anonymous or free of disclosure risk. What a reseller can do is run inspections and ask the supplier to explain the process.
Practical inspections:
- search names, addresses, account numbers and free-text notes for patterns that look like real identifiers - look for oddly specific narrative details in hardship or dispute notes - check that amounts, dates and rare events are not repeated in a way that suggests copying - confirm identifiers follow a documented synthetic style, such as `LOAN-3391` - compare rare combinations of attributes, since uncommon pairings can stand out
Questions to put to the supplier:
- How was the generated world informed by observed practice, and what was kept at the level of workflow rather than record? - Which fields are free text, and how were they produced? - What disclosure checks do you recommend a buyer run?
MirrorFirm's output is generated and informed by direct observation of how real businesses operate. It is never real business records. Record the answers you receive, keep the sample files you tested, and pass an accurate description to your own customers instead of an assurance.
Treat disclosure risk as something you inspect and document, then pass an accurate description to customers instead of an assurance.
- Audience:
- Licensed resellers
- Content type:
- FAQ
- Buyer question:
- How to evaluate it
Content release: r-a220eb6e099b243b
Related questions
- How can a grader catch a quiet error in a premium instalment change?
- How do I check grounding and disclosure risk in generated data?
- How do I judge the quality of generated schedule data?
- How do state diffs, graders and hooks fit into a schedule evaluation?
- What success criteria should I set for a schedule agent evaluation?
- How does an evaluator catch rounding drift when an agent splits an instalment plan?