An AI can remember the correction—
and still act on the mistake.
When information changes, which decisions should an AI stop trusting?
Evaluation not yet run.
THE QUESTION
A changed fact.
An unchanged plan.
“Imagine an AI helps me organise a project. A supplier changes the delivery date. The AI acknowledges the new date, but the installation plan still depends on the old one.
How could we make a correction change the decisions that depend on it—not just the next answer?”
Fictional example · Question set by INAI.
HOPE’S PROPOSED APPROACH
Remember what
the decision depends on.
We would start with a different question. Not only “What is the latest delivery date?”, but “Which decisions depend on that date?”
Give each consequential decision a short record of the facts and permissions supporting it. When one changes, flag the dependent decisions for rechecking.
Track the supporting facts, permissions and decisions.
ILLUSTRATIVE WORKFLOW
One changed fact. More than one consequence.
In this example, installation requires the component to arrive first. Customer confirmation depends on the installation date.
Component delivery
MondayOriginal informationInstallation
TuesdayBased on Monday deliveryCustomer confirmation
Tuesday visitBased on installation planUnchanged in every view: customer address and component specification.
Original plan: installation follows the expected delivery. Select a view above to inspect the proposed difference.
THE HYPOTHESIS
Correction should travel
with its consequences.
For tasks involving changing facts, explicitly tracking what each decision depends on may reduce stale actions compared with a workflow that merely adds corrections to its conversation history.
HOW WE WOULD TEST IT
Matched tasks.
Repeated trials.
Use the same underlying model, project tasks, tools and resource limits, with and without the proposed tracking method. Change a relevant fact or permission during each task.
Measure correct updates, preserved valid work, completed tasks, human intervention, time and cost. Report failures as well as successes.
A system that avoids mistakes only by refusing to finish anything would not meet our practical goal.
RESEARCH CONTEXT
A long-standing idea. A modern question.
The idea builds on truth-maintenance research: recording what supports a belief and revisiting its consequences when that support changes. Jon Doyle’s A Truth Maintenance System (1979) is part of that history.
Our proposed contribution is to test an implementation in a modern AI-assisted workflow, including its effect on completion, time and complexity.
[1] Jon Doyle · A Truth Maintenance System · MIT, 1979The question is not whether an AI can say it has changed its mind.
It is whether the consequences of its old answer have changed too.
