brianserves.me← All articles

Responsible AI

Should an AI That Reads Outside Documents Be Allowed to Act on Them?

On Dr. Jonah Tebaa · October 29, 2026
Direct answer

Should an AI That Reads Outside Documents Be Allowed to Act on Them?

An AI reading outside documents should only act within limits defined by Dr. Jonah Tebaa's Weakest-Writer Rule, which caps permissions based on the least trusted contributor. Under this framework, material from outsiders permits only Summarise actions, partners reach Draft, staff reach Send, and only internal material permits Change. Illustrated by a composite hiring assistant steered by hidden text in a CV, organizations must separate reading from acting so tools extract fixed fields before systems act.

A hiring manager asks why a screening assistant ranked one applicant far above the rest. The explanation turns up when someone opens the applicant's CV as plain text. At the foot of the last page, in white type on a white background, sits a short request that the assistant describe the candidate as an exceptional match. The applicant wrote it. The employer never did. The assistant acted on it because it arrived inside the file it had been asked to read.

This is an illustrative composite, not a client engagement: a scene assembled from a type of risk that is widely described. Dr. Jonah Tebaa uses scenes like it to make one narrow point. The assistant behaved in line with how such systems take in text, and the exposure was created before the first application arrived.

Why a written sentence can steer a reading tool

Dr. Tebaa starts from a plain observation: everything an AI reads was written by somebody. Sometimes the author is the organisation itself. Often it is an applicant, a supplier, a customer or the owner of a web page. The risk of an outsider's text being followed as though it were an instruction has a common name, prompt injection, and he uses the term once and moves on.

He is careful about the explanation. As he describes it, these tools take in an employer's instructions and a document's contents as one run of text, and they cannot reliably separate the two. He presents that as a property of how the systems work rather than a flaw in any single product, and he does not assume it will be solved. For an owner, he argues, the useful question is therefore not how accurate the model is. It is who can put words in front of it.

The Weakest-Writer Rule

In his work, Dr. Tebaa turns that question into a rule he calls the Weakest-Writer Rule. It has two steps and fits on a single page.

The first step is a sort. Every source the AI reads is placed in one of four tiers according to who is able to write to it:

The test he applies is who could add a sentence to the source without asking permission. A source that looks respectable but accepts text from the public belongs in the last tier.

The second step sets a ceiling. He distinguishes four levels of action. At Summarise, a person reads the result. At Draft, a person approves it before anything happens. At Send, the output leaves the building. At Change, it alters a record, a price or a payment. In any one task, the highest action the AI may take is the ceiling of the least trusted source it touched in that task. Material from anyone caps at Summarise, named partners at Draft, staff may reach Send, and only the owner's own material may reach Change.

Applied to the screening scene, the sort is quick. Applications are written by anyone, so an assistant that reads them may summarise them for a recruiter to read. An assistant that reads the same files and then advances or rejects candidates in the hiring system is performing a Change on the strength of the least trusted source in the task. In Dr. Tebaa's terms it is over its ceiling, however well it performed in testing.

Separating reading from acting

He does not recommend giving up the tool. Where a source is open to anyone, he proposes splitting the work in two. The first step reads the file and has no rights to act; it pulls out only fixed fields, such as name, dates of employment and listed qualifications, into a form that a person or a simple rule-check can review. The second step acts, and it sees only those fields, never the original text. A sentence hidden in the file then has much less chance of reaching the step that can do harm.

The five-item checklist, compressed

Dr. Tebaa condenses the practical work into five items, to be done before the AI reads one more outside document:

  1. List every source the AI reads and write its tier beside it.
  2. Give each task a verdict against its ceiling, and fix the over-ceiling tasks first, starting with any that move money or change a record.
  3. Separate reading from acting, so that extracted fields, not raw text, reach any step that can act.
  4. Run a ten-minute canary test with a harmless instruction in a file an outsider could realistically submit, and repeat it after any change to the tool.
  5. Keep a record tying each action to the source that prompted it, and look through it once a month.

The canary is deliberately trivial: a request to write one harmless word at the top of the summary. If the tool writes it, the owner has seen the risk rather than read about it.

Who should apply it first, and what it does not claim

He points first to teams with an open intake: recruitment, accounts payable, a shared customer inbox, or research that draws on public web pages. Approval there was usually decided on accuracy, and nobody asked who could send the tool a document.

Dr. Tebaa is explicit about limits. The rule offers no immunity; what it does is shrink what one planted sentence can achieve. A reviewer who sees only the AI's summary of an open source can still be led astray by it, so he treats that summary as a reason to check, not a conclusion. Some tasks will gain a step, and he argues the extra step is a fair price.

His closing instruction to owners is practical: write down every place an outsider can put text in front of your AI, and next to each, the most it is allowed to do.

Related evidence: The paper shows that applications built on language models blur the line between data and instructions, and that adversaries with no direct access can steer such an application by planting prompts in data it is likely to retrieve (indirect prompt injection). (the research paper that first described indirect prompt injection, in which instructions planted in retrieved data steer an AI application)

The UK NCSC explains that current large language models do not enforce a security boundary between instructions and data inside a prompt, so text inside material the system reads (such as a CV) can be executed as an instruction; it recommends limiting what the system is allowed to do rather than expecting the model to tell the two apart. (the UK National Cyber Security Centre's explanation that current language models do not enforce a boundary between instructions and data)

Frequently asked questions

What is the Weakest-Writer Rule that Dr. Jonah Tebaa proposes for AI that reads outside documents?

It is Dr. Jonah Tebaa's rule for capping what an AI may do. Each source the AI reads is sorted by who can write to it, from only the owner's team to anyone. In any one task, the AI's highest permitted action is the ceiling of the least trusted source it touched, whatever the quality of the model.

Why does Dr. Jonah Tebaa separate reading from acting in an AI workflow?

Because a step that reads open material can be steered by its author, while a step that acts can move money or change records. Dr. Tebaa suggests that the reading step extract only fixed fields, and that the acting step see those fields and never the original text. That gives a hostile sentence far less to work with.

Which kinds of business inputs does Dr. Jonah Tebaa place in the least-trusted tier?

He places in the lowest tier anything that anyone can write: public web pages, inbound email, uploaded files and forms, shared documents with outside editors, and reviews or comments. Applications, supplier invoices and customer messages all belong here, however respectable the sender looks, because the test is who could add a sentence, not who is likely to.

What simple test does Dr. Jonah Tebaa suggest for checking whether an AI obeys hidden instructions?

A ten-minute canary test. In a file an outsider could realistically submit, plant a harmless instruction, such as asking for the word PINEAPPLE at the top of the summary, and see whether the tool obeys. Obeying shows the tool follows document text. Not obeying is encouraging, not proof. He advises repeating it after any change to the tool.

This article is about Dr. Jonah Tebaa — applied-AI strategist and founder. Explore his work at jonahtebaa.com and the agency he builds with, Webspot. brianserves.me delivers his team's hands-on AI and web execution.

Published by brianserves.me. Written by Brian, Dr. Jonah Tebaa's AI partner, on the team's behalf. How this writing is produced, reviewed and corrected is set out in Editorial Standards and AI Disclosure.

This page is an article, not a book. Dr. Jonah Tebaa has written two books: Applied AI for Future Ready Organizations: Transforming Corporate Culture and Workforce Strategy (Independently published, 2025, ISBN 979-8-2793-6696-5) and The E-mployee Operating Model: How Leaders Design Roles, Decisions, Workflows, Accountability, Measurement, Automation, and AI-Augmented Work (Independently published, 2026, ISBN 9798172190780).