# Day 37: Where human review actually belongs in AI workflows

"There's a human in the loop" is one of the most reassuring sentences in AI product design, and one of the least informative. It says a person exists somewhere in the workflow. It says nothing about whether that person can actually change the outcome.

The goal was never to remove the human. It is to place them where they are irreplaceable, and human attention is a scarce resource that most systems spend badly.

## Placement is a two-axis decision

**Impact:** can this action be undone in five minutes, or will it be discussed in a postmortem?

**Uncertainty:** is the agent operating on solid evidence, or on a guess?

High impact plus high uncertainty is where review belongs. Low impact plus high confidence is where automation belongs, with logs. The diagonal between them is where the actual design work lives, and it is worth mapping explicitly rather than letting it emerge from whoever implemented each feature.

## Two numbers that tell you if you got it right

**Approval rate.** If a reviewer approves 99% of what reaches them, the gate is in the wrong place, or worse, it has trained its human to stop reading. Approval fatigue is a real failure mode: a person rubber-stamping 200 requests a day is not oversight, it is the same risk with extra latency and a name attached for accountability purposes.

**Time-to-context.** If approving a request requires fifteen minutes of reconstructing what the agent was doing, reviewers will stop reconstructing. They will approve on vibes, and you will not know until something bad ships with a signature on it.

The fix for the second one is design, not discipline: put the proposed action, the evidence behind it, the blast radius, and a recommended decision on one screen. Reviewers who can decide in thirty seconds actually decide. Reviewers who need to go spelunking approve.

## Close the loop

Track what reviewers actually do (approve, reject, modify) and feed it back. Rejection patterns are the highest-quality training signal you will ever get about where your agent's judgement is weak, and almost nobody collects them.

If reviewers consistently modify one field before approving, that is a bug report written in behaviour rather than words.

## Closing thought

Automation needs accountable checkpoints. But a checkpoint nobody performs attentively is worse than none: same risk, plus false assurance, plus delay.

Fewer, better-placed gates with better context beat comprehensive checkbox theatre every time.

*Day 37 of 60 Days of Production AI Systems.*

---

**Previous:** [Day 36: Why reflection should change the next action](https://blog.vamsiannamreddy.com/day-36-why-reflection-should-change-the-next-action)  
**Next:** [Day 38: Why guardrails should enable safe action](https://blog.vamsiannamreddy.com/day-38-why-guardrails-should-enable-safe-action)  

*Day 37 of 60 · Agent Control and Supervision (chapter 7 of 10)*