No. 226 / 339
Who's accountable when an AI denies an insurance claim faster than any human could review it?
The shift
Adjudicating a claim — reading the file, applying policy terms, deciding pay-or-deny, and writing the rationale — goes from scarce adjuster time (minutes to days per file) to abundant, instant, and near-free, and with agentic tool use the model can now execute the denial, not just recommend it. What stays scarce is the accountable party who answers for a denial that harms someone: the licensed, capitalized, regulated entity that can be sued, fined, or ordered to pay, and the human judgment that a novel or contested claim still requires.
The axioms
- Adjudicating a claim requires scarce adjuster time to read the file, apply the policy, and decide what's owed — per-claim manual review is the adjuster's core value.
- A denial is defensible because a competent human examined this specific file and can explain why — the review is the accountability.
- "A human reviews the outcome" is a meaningful control: it catches errors before they reach the claimant.
- Someone licensed and accountable must own a denial, because denying a legitimate claim causes real financial and physical harm and is subject to legal and regulatory challenge.
- Ambiguous, novel, or disputed claims require human judgment because there's no clean rule or pattern to apply.
- The insured has recourse — a person to appeal to, a regulator to complain to, a court to sue — and that recourse is what makes the whole promise credible.
- Regulators can hold an insurer to a duty of good-faith, meaningful review of each claim before denial.
- Processing speed is bounded by review capacity, so the rate of denials is self-limiting — an insurer can only deny as fast as it can staff review.
Invalid axioms
-
Adjudicating a claim requires scarce adjuster time; per-claim manual review is the adjuster's value. Reading documentation, applying policy language, calculating what's owed, and drafting a pay-or-deny rationale are now abundant and near-instant, and an agentic system can issue the decision itself. The habit-trap: carriers still describe the adjuster as the per-file decision-maker and staff to that story, while the real bottleneck has moved to the contested and novel files and to whether anyone can meaningfully check the automated ones.
-
"A human reviews the outcome" is a meaningful control. This was true when review capacity and decision volume were the same order of magnitude — a person could actually read what they signed off on. Once denials are generated faster than any human can read them, "the adjuster reviews the outcome" becomes a rubber stamp: a signature on a volume of decisions no one examined. The habit-trap: insurers keep a human in the loop as a compliance artifact and point to it as due diligence, when the ratio of decisions to reviewer-seconds has made real review impossible. Speed didn't just make review faster — it broke the arithmetic the control depended on.
-
Processing speed is bounded by review capacity, so the denial rate is self-limiting. The natural governor — you can only deny as fast as you can staff — is gone. A systematic misread of a policy exclusion now denies thousands of claims before anyone notices, where it used to surface one file at a time. The habit-trap: error-catching, audit, and regulatory-reporting cadences are still designed around a human-paced denial rate that no longer describes how fast harm can accumulate.
Unchanged axioms
-
Someone licensed, capitalized, and accountable must own a denial. A model can produce a denial and a fluent rationale, but it can't be sued for bad faith, fined by a regulator, or ordered to pay — and it holds no capital. Liability for a wrongful denial stays with the insurer and its officers by construction, not because the model isn't good enough yet. Automating the decision does not automate away the answerability for it; if anything it concentrates the exposure, because one flawed policy now sits behind thousands of denials.
-
Ambiguous, novel, or disputed claims need human judgment. A borderline exclusion applied to an unusual fact pattern, a claimant-credibility question, a coverage dispute two reasonable people would decide differently — these have no ground truth to pattern-match against. Confidently-wrong is the model's default failure mode, and it is most dangerous exactly here, on the files where the claimant has the most at stake and the least clear rule to protect them.
-
The insured's recourse — a person to appeal to, a regulator, a court — is what makes the promise credible. Faster denial doesn't substitute for a meaningful appeal path; it raises the stakes on one. If the first decision is automated and instant, the insured's confidence rests entirely on whether the recourse behind it is real and reachable, or whether appeal routes into the same automated pipeline that denied them.
-
Regulators can hold an insurer to a duty of meaningful, good-faith review before denial. The legal duty of good faith didn't dissolve because the review got cheap. An insurer that denies without a human meaningfully examining the claim is exposed to bad-faith and unfair-claims-practice liability regardless of how fast or cheap the automated path is — the duty is defined by the standard of review owed, not by the technology used to fall short of it. (This is the contested, fast-moving edge: several jurisdictions are actively writing rules on automated claim decisions and required human involvement as of mid-2026, and where the line lands is not settled.)
-
Trust that a legitimate claim gets paid rests on the capitalized promise, not on decision speed. Insurance is bought for the moment of loss. A denial issued in seconds by a system the claimant can't question, on a claim they know is valid, damages the core promise faster than any slow-but-fair process could — speed of denial and credibility of the insurer are not the same axis.
New axioms
-
When denials are issued faster than anyone can read them, human oversight becomes theater — so what is the real control? "An adjuster reviews the outcome" no longer means what it says once one reviewer nominally owns thousands of automated decisions a day. The open problem: designing accountability that doesn't depend on a human having actually read each decision — sampling, hard stops on high-harm denials, provable audit trails — because the sign-off ritual now certifies nothing.
-
Who is liable for a wrongful AI denial, and how is that established after the fact? The insurer is liable — but the mechanism assumed a human whose reasoning could be examined, deposed, and judged against a standard of care. When the decision was generated and executed by a model on inputs that may be manipulated or hallucinated, the field has to solve for what "the reasoning" even is, who is on the hook (carrier, officer, vendor), and how a claimant proves the denial was unreasonable when no human ever formed a reason.
-
What is a regulator's — and an insurer's — duty when no human meaningfully reviewed a denial that harmed someone? If the duty of good-faith review survives (STILL HOLDS #4) but the volume makes per-file human review impossible (INVALID #2), the two collide directly. The open problem: defining what discharges the duty in an automated pipeline — which denials must have a human in the loop, what documentation proves meaningful review, and what counts as reckless deployment of a system known to be confidently wrong on the hardest files.
-
When the model can execute the denial, not just recommend it, where does the accountable human actually sit? Agentic adjudication is the live trajectory: the system acts, closes the file, and notifies the claimant without a person in the path. The governance model for "AI decides and executes a harm-bearing decision in a regulated business" isn't settled — and the honest version has to say when a human must be upstream of the action, not merely available downstream to hear the appeal.
Where it breaks
Carriers are automating adjudication because per-file review is now free (INVALID #1) and keeping a nominal human reviewer to satisfy the oversight expectation — but the denial volume has already outrun any human's capacity to actually read the files (INVALID #2), so the sign-off certifies nothing while still being presented as the accountability. That collides with the surviving regulatory duty of meaningful, good-faith review before denial (STILL HOLDS #4) and the unanswered question of who is liable, and how, for a wrongful automated denial (NEW #2): the industry has shipped denial-at-machine-speed while pointing to a human control that the same speed already hollowed out, and the accountability the law still demands now rests on a review that isn't happening.
A second collision: the natural governor on denial volume is gone (INVALID #3) exactly when the recourse path (STILL HOLDS #3) is most needed — so a systematic error can deny thousands of valid claims before detection, and if appeals route back into the same automated pipeline, the insured's recourse fails at precisely the scale where it matters most.
Related axioms
Finance
What changes for finance and banking with AI?
Finance
What changes for insurance with AI?
Finance
Is the branch banking model dead when AI can handle account service, loan applications, and advice remotely?
Finance
What's a financial advisor for once portfolio construction and tax-loss harvesting are commoditized?
Finance
Does an audit still mean anything when AI drafted the work papers it's supposed to check?
Finance
Is manual bookkeeping just dead now that reconciliation is free?
Other axioms
Research
Is synthesis (turning transcripts into themes) still a research skill worth having when AI does it in seconds?
Legal
What changes for the judiciary with AI?
Education
What's the point of a take-home essay now that neither writing nor detecting AI writing is reliable?
Government
Who is accountable for a lethal decision made by an autonomous weapon system?
Industries
What changes for logistics with AI?
Society
Does AI intake and documentation give social workers back time for care, or just raise the caseload expectation?