No. 325 / 339
Does the human grid operator still make the real-time call, or is that now an AI system's job?
The shift
Real-time balancing and optimization of the grid — matching generation to load second by second, ranking contingencies, sequencing switching actions, recommending the dispatch — goes from scarce operator attention and slow manual analysis to abundant, fast, and near-continuous. What stays scarce is an accountable human authorized to commit a safety-critical public system to an action, and the judgment to override the system when the situation is one no model has a pattern for.
The axioms
- Real-time balancing and contingency analysis require a human watching the state and calling the moves, because synthesizing high-volume grid telemetry into a decision fast enough is scarce operator capacity.
- Optimizing dispatch, power flow, and switching sequences under normal conditions is scarce engineering-and-operator analysis applied faster than events move.
- Someone licensed and authorized must commit the grid to a control action, because a safety-critical public system requires an accountable operator with the standing to act.
- Handling a novel or cascading emergency — an unprecedented storm, a first-of-its-kind fault chain, a control-system attack — rests on scarce human judgment where there is no reliable pattern to match.
- When a blackout happens, a specific human and organization can be held responsible, because accountability for a safety-critical public service is a legal and regulatory requirement, not a technical one.
- The operator maintains physical-world awareness — what crews are in the field, what's actually energized, what the weather is doing to the lines — because situational awareness of the physical grid is scarce and can't be reconstructed from the model's inputs alone.
- The operator stays ready for the rare emergency by staying continuously engaged with routine operations, because skill and readiness are maintained through scarce hands-on practice.
Invalid axioms
- Real-time balancing and contingency analysis require a human continuously synthesizing telemetry into the decision. Ranking thousands of contingencies, spotting the anomaly in the SCADA stream, and recommending the redispatch under normal conditions is synthesis-at-speed AI is now cheap and continuous at — faster and across more state than an operator can hold at once. The habit-trap: control rooms are still staffed and shift-structured as if a human eyeballing screens were the thing keeping the grid balanced, rather than as if a human were verifying and authorizing decisions a system produces continuously.
- Optimizing dispatch and switching sequences under normal conditions is scarce operator-and-engineer analysis. First-draft optimization — economic dispatch, power-flow adjustment, restoration switching order — is now abundant and near-instant. The habit-trap: procedures and timelines still treat producing the plan as the slow, skilled step, when the slow step is now deciding whether to trust the plan and owning the action.
Unchanged axioms
- A licensed, authorized human must commit the grid to a control action. Authority over a safety-critical public system is granted to accountable people, not software; a model can't hold operator certification, can't be the entity a regulator authorizes to act, and can't be answerable for the commitment. This is the load-bearing distinction — automation can recommend and even execute inside pre-approved envelopes, but the standing to own a consequential action stays human. (Fast-moving: the envelope of actions AI executes autonomously under normal conditions is widening, and where the authorized-human line sits is a live regulatory question, not a fixed one.)
- Judgment in a novel or cascading emergency stays human. A fault chain no one has seen, a storm outside the training distribution, a control-system attack designed to feed the operator false state — these are the low-pattern, high-stakes situations where confidently-wrong output is most dangerous and where the whole reason a human is in the loop shows up. The rarer and stranger the event, the less the model's fluency on normal conditions transfers.
- A specific human and organization can be held responsible for a blackout. Accountability didn't get cheaper. A commission, a court, and the public need an answerable party after a major outage; a model can't testify, can't hold a license, and can't absorb liability. This is a requirement of running a public service, and it doesn't move just because the decision was AI-assisted.
- The operator's awareness of the physical grid stays scarce and partly human. What's actually energized, which crew is where, what a lineman is reporting by radio, what the ice is doing to a span the sensors don't cover — situational awareness of the physical world is exactly the ground-truth the model doesn't have unless it's in the feed, and acting on wrong or incomplete state is how automation causes an outage rather than prevents one.
New axioms
- Automation bias erodes the operator's readiness for the rare emergency that is the entire reason the operator is there. When the system makes the right routine call thousands of times, the human drifts from active decision-maker to passive monitor — and passive monitors are demonstrably slow to detect, diagnose, and override when the system is wrong. The scarce skill the operator is retained for is exactly the one that atrophies when everything works, and readiness for the once-a-decade event now has to be manufactured deliberately rather than accruing from daily practice.
- Accountability for an AI-driven grid decision that causes an outage has no settled owner. If a human authorizes a recommendation they had seconds to evaluate and it triggers a cascade, holding them fully responsible is a legal fiction; holding no one responsible is unacceptable for a public service; holding the vendor responsible is untested at grid scale. The accountability that STILL HOLDS in principle needs a real allocation between operator, utility, and system-supplier that regulation hasn't drawn yet.
- The operator is present on paper but deskilled in practice. Keeping a human "in the loop" as a compliance and liability formality — a named, certified person on shift — is not the same as keeping a human capable of catching and correcting the system in the moments that matter. The role can be preserved on the org chart while the competence it exists to provide quietly leaves.
- Verification has to happen at machine speed during a crisis, when the human is slowest. In a fast cascade the system acts and recommends faster than a person can independently confirm the state is real and the action is right — and this is precisely when situational awareness is worst and pressure is highest. "The human verifies the AI" is the standard answer, but at contingency speed there may be no time to verify before committing, which turns the accountable human into a rubber stamp exactly when their judgment was supposed to be the safeguard.
Where it breaks
Control rooms are restaffed and shift patterns thinned because routine balancing and optimization got cheap and continuous (invalid axioms 1 and 2), while the reason a human is retained at all is the rare cascading emergency (still holds 2) — and the readiness for that emergency is precisely what erodes when the automation handles everything else well (new problem 1). The org keeps a human on shift for the once-a-decade event and, by removing the daily practice that kept them sharp, guarantees they're least prepared the day it arrives.
A second collision: the accountable human is kept in the loop to satisfy the requirement that someone owns the call (still holds 1 and 3), but in a fast cascade the system commits or recommends faster than that human can verify the state (new problem 4). The loop is designed so a person is answerable for a decision they had no real capacity to evaluate — accountability preserved in name, removed in substance, exactly when it was supposed to bite.
Related axioms
Other axioms
Research
What's the point of training PhD students on tasks an AI agent already does end to end?
Education
What's the point of a take-home essay now that neither writing nor detecting AI writing is reliable?
Finance
Is the branch banking model dead when AI can handle account service, loan applications, and advice remotely?
Engineering
What's the point of "10x engineer" craft identity when AI closes the output gap between junior and senior?
Research
Is the paper still the right unit of scientific output when AI can generate them faster than humans can read them?
Marketing
What gets measured as marketing success when AI can hit any proxy metric but brand trust is still unmeasured?