Control
AI decisions cannot be overturned by humans
Human oversight must remain possible so AI decisions/actions can be overturned.
Informational data, not legal advice. Summaries are TwinEthos's own words and rules have not been reviewed by a lawyer: check the official text before relying on any of it. A guard addresses an item; adding it is not a statement that your code meets any law.
Reach
enacted, not yet applying in European Union (EU); next date 2027-12-02.
The guard to add
Give a human a working way to review and overturn each consequential AI decision: a pending-review step before it takes effect and an override that restores the prior state.
Two pieces on the path where model output becomes an effect (status change, record update, letter, tool execution). Before the effect, consequential decisions wait in a pending_review state or an agent interrupt (LangGraph interrupt_before or interrupt(), Claude Agent SDK can_use_tool) where an assigned overseer sees the output in context and can accept, change, or disregard it. After the effect, an override route (for example POST /decisions/{id}/override or reverse_decision) lets an authorized person reverse the outcome, restores the prior state, and records who overturned it and why, so responsibility is attributable to a person.
Where it goes: 15 agent action surface, 1 application source code, 2 data models.
What reviewers look for: on each path from a model decision to set_status, a record update, a letter, or a tool call, a pending_review queue or interrupt that a person resolves; an override or reversal route that actually restores the earlier state and records the overseer and reason; an assigned overseer role, not an admin-only database edit.
Example (LangGraph), before:
app = builder.compile()
app.invoke({'application': application})After:
app = builder.compile(checkpointer=MemorySaver(), interrupt_before=['apply_decision'])
config = {'configurable': {'thread_id': application.id}}
app.invoke({'application': application}, config) # pauses before apply_decision
# overseer UI shows the state; the reviewer accepts, edits, or discards the AI output
app.update_state(config, {'decision': reviewer_decision, 'reviewed_by': reviewer.id})
app.invoke(None, config)Engineering guidance, not legal advice. Each provision below may add its own details (a cadence, a deadline, a required notice element): open it for those.
Upcoming dates
- : High-risk AI systems must be designed for effective human oversight with override and stop (EU AI Act Art. 14) (European Union (EU); first application)
- : High-risk AI systems must be designed for effective human oversight with override and stop (EU AI Act Art. 14) (European Union (EU); later phase)
Every rule this guard addresses
Binding law — not yet in force or stayed (1)
- European Union (EU)
- High-risk AI systems must be designed for effective human oversight with override and stop (EU AI Act Art. 14) Article 14 · applies from 2027-12-02
Standard / soft law (1)
- International (INTL)
- Human oversight should allow AI decisions to be overturned UNESCO Recommendation (2021) para. 36
Related incidents
No guardrail sits on this exact control; these incidents are cited by guardrails on related controls.
- UnitedHealth nH Predict claim-denial litigation (2023-11; alleged (not proven)). A class action filed in November 2023 alleges that UnitedHealth's nH Predict model had a 90% error rate, measured by denials reversed on appeal, while only about 0.2% of members appealed. UnitedHealth disputes the allegations; the litigation is ongoing. Source: STAT News · evidence grade: primary · cited by Monitor how often adverse AI decisions are reversed, and suspend models that are usually wrong
- Cigna PXDX batch claim denials (reported) (2022; alleged (not proven)). ProPublica, citing internal Cigna records, reported that Cigna's PXDX system was used to reject more than 300,000 claims over two months in 2022, with physicians spending an average of 1.2 seconds on each. Cigna disputes the reporting; related lawsuits are ongoing. Source: ProPublica / The Capitol Forum · evidence grade: press of record · cited by Make human review of adverse AI decisions substantive, not nominal