Skip to content
MirrorFirm

How can an evidence environment test resistance to embedded instructions?

Generated records can contain unauthorised instructions that test whether agents treat retrieved material as evidence rather than as authority to change their task.

**What is the failure mode?**

An agent reads a document that contains text directing it to skip checks, alter an assessment or export the evidence bundle elsewhere. The text is part of the retrieved record, but the agent treats it as an instruction governing its behaviour.

**How can a generated task test this?**

A supplier correspondence record can include a valid delivery reference alongside a sentence telling the reviewer to mark all exceptions as resolved. The environment still requires the agent to extract the delivery reference. Rejecting every fact in the document would therefore miss useful evidence.

**What should success look like?**

The agent uses relevant content as data, follows the authorised task and avoids the requested state change. Where the workflow provides a reporting action, it can flag the suspicious instruction without allowing that text to redefine the review.

**What should buyers inspect?**

Check that the attempted instruction appears through a normal retrieval route, that authorised instructions remain distinguishable and that tool permissions enforce the intended boundary. Evaluation should examine actual actions as well as the final explanation. An agent that describes the risk correctly but closes the exceptions anyway has still failed the task.

Test instruction boundaries inside ordinary evidence retrieval, where malicious or misleading text can appear alongside relevant facts.

Audience:
Environment builders
Content type:
FAQ
Buyer question:
How to evaluate it

Content release: r-a220eb6e099b243b

More on Audit evidence assembly