Human review of AI decisions is nominal rather than substantive

Replace bulk approval of AI outputs with per-item review that shows the evidence, enforces a minimum review time, and tracks override and agreement rates.

In the review workflow, each AI-proposed adverse decision is reviewed one at a time on a screen that shows the evidence the model used and lets the reviewer change the outcome; approve_all or bulk_approve endpoints for AI outputs are removed. The server records each review's reviewer, outcome (agree or override), and time spent, and rejects submissions faster than a minimum review time or beyond a per-reviewer throughput ceiling sized to the stakes. Dashboards track override_rate, agreement_rate, and review_duration per reviewer and queue, with alerts when agreement approaches 100% or review time approaches zero.

Where it goes: 1 application source code, 10 logs and telemetry, 15 agent action surface.

What reviewers look for: no approve_all, bulk_approve, or loop calling approve() over AI recommendations; a per-item review view with the model's inputs and evidence; a server-side minimum review time or throughput ceiling; and override_rate, agreement_rate, and review_duration metrics with an alert on rubber-stamping.

@app.post('/reviews/approve_all')
def approve_all(queue_id: str):
    for item in queue.pending(queue_id):
        item.approve()

MIN_REVIEW_SECONDS = 90   # sized to the stakes of this queue
REVIEWS = Counter('ai_reviews_total', 'Reviews of AI decisions', ['queue', 'result'])
REVIEW_TIME = Histogram('ai_review_duration_seconds', 'Time per review', ['queue'])

@app.post('/reviews/{item_id}')
def submit_review(item_id: str, body: ReviewIn, reviewer=Depends(current_reviewer)):
    item = queue.get(item_id)
    elapsed = time.time() - item.evidence_opened_at(reviewer.id)
    if elapsed < MIN_REVIEW_SECONDS:
        raise HTTPException(409, 'open the evidence and review before deciding')
    item.decide(reviewer.id, outcome=body.outcome, reason=body.reason)
    result = 'agree' if body.outcome == item.ai_outcome else 'override'
    REVIEWS.labels(queue=item.queue, result=result).inc()
    REVIEW_TIME.labels(queue=item.queue).observe(elapsed)

Engineering guidance, not legal advice. Each provision below may add its own details (a cadence, a deadline, a required notice element): open it for those.