3

Question of the month

Can oversight fatigue be solved with better training for overseers and better design of the AI system, or is it just an unavoidable cost of automation?

In 1983, Lisanne Bainbridge's Ironies of Automation paper pointed out a paradox that still holds today: the more reliable a system becomes, the harder it is for a human to stay alert while monitoring it. This same dynamic plays out in human oversight of AI systems, including behaviours such as overreliance, automation bias and rubber-stamping. It raises the question of whether we can train or design our way out of these behaviours, or whether it's simply a risk we must accept when humans oversee increasingly capable AI systems. We're curious what you think: we read every answer.

Gradient Briefs #004 · August 2026 · Gradient Institute