No. 45 / 339
What's left of the "QA engineer" role when developers own their own AI-generated tests?
The shift
Writing the tests themselves — the mechanical output of a QA engineer's day — goes from a specialized, scarce skill to something any developer can generate inline, in seconds, without leaving their editor. The scarce thing left behind isn't test-writing; it's deciding what deserves to be tested, whether the AI-generated suite actually proves anything, and who's accountable when it doesn't.
The axioms
- A dedicated QA role exists because writing thorough test coverage is a distinct skill from writing the feature, and specialization pays off when both are labor-intensive. Rests on authoring time being scarce and separable.
- Developers under deadline pressure will under-test their own code, so a separate function exists as a check against that bias. Rests on independent verification being structurally necessary, not just nice to have.
- QA engineers accumulate system-level knowledge — which integrations are fragile, which customers hit which edge cases — that developers writing a single feature don't have. Rests on cross-cutting product knowledge being scarce and concentrated in one team.
- Someone outside the author has to sign off that a change is safe to ship. Rests on accountability for release quality being a distinct, assignable role.
- Exploratory testing — poking at a product the way a confused or adversarial user would — is a specific mindset that differs from a developer's build-it mindset. Rests on that adversarial curiosity being a scarce disposition, cultivated by specializing in it.
- Test automation infrastructure (frameworks, CI wiring, flaky-test triage, environment management) requires dedicated ownership or it rots. Rests on infrastructure upkeep being unglamorous, time-consuming work nobody does as a side effect of their main job.
Invalid axioms
- A dedicated role exists because writing thorough test coverage is a distinct, specialized skill. Generating unit tests, integration tests, and a broad first pass of edge cases from a diff or spec is now something any developer's AI assistant does inline, well, and fast — the authoring skill that justified a separate headcount is now bundled into the tool the developer already uses. Habit-trap: orgs still hire and title "QA engineer" against a job description that's mostly "writes tests," when that specific task no longer requires a separate person.
- Developers under deadline pressure will under-test their own code, so a separate function exists as a check. The friction that made testing feel like a tax — the tedium of hand-writing cases — is gone; asking an AI to generate a broad test pass costs a developer a prompt, not an afternoon, which removes much of the incentive to skip it. Habit-trap: process still assumes testing has to be handed off to someone else to happen at all, when the cost that drove the handoff has collapsed.
- Test automation infrastructure requires dedicated ownership or it rots. Framework scaffolding, CI config, and flaky-test triage are pattern-matched, well-documented problems that AI tooling now handles largely unattended — writing a Playwright config, diagnosing why a test flakes, or updating selectors after a UI change no longer needs a specialist babysitting it full-time. Habit-trap: teams still budget a dedicated "test infra" seat sized for manual upkeep that's now substantially self-healing.
Unchanged axioms
- Someone outside the author has to sign off that a change is safe to ship. A developer reviewing their own AI-generated tests is grading their own homework with a tool that has no stake in the outcome — it will confidently certify a suite that passes without knowing whether it tests the right thing. Independent judgment on "is this actually done" doesn't transfer to the person who wrote the code, no matter who wrote the tests.
- QA engineers' cross-cutting system knowledge stays scarce. Knowing that this integration broke three times last year, that this customer's data shape is unusual, or that this "simple" change touches a fragile legacy path is knowledge earned by working across the whole system rather than one feature at a time. AI has no memory of your specific production incidents unless someone feeds it that context every time, and deciding what context matters is itself the judgment call.
- Exploratory, adversarial testing depends on a disposition, not a checklist. AI can execute a scripted exploratory session; it can't reliably originate the "this feels wrong, let me poke at it" instinct that comes from having broken things before. That instinct is judgment under novel ambiguity — there's no corpus of "what's suspicious about this specific screen for this specific user" to pattern-match against.
- Accountability for release quality has to sit somewhere specific. When something ships broken, "the developer's AI wrote a passing test" answers nothing about who should have caught it. That answerability doesn't dissolve just because test-writing got cheap — if anything it gets harder to locate once the task that used to mark ownership (writing the tests) no longer maps to a person.
New axioms
- Who verifies that a developer's self-graded, AI-generated suite is trustworthy, at the volume developers can now produce it. When every developer can generate a plausible-looking test suite for their own change in minutes, the review bottleneck moves from "does a QA engineer have time to write tests" to "does anyone have time to check whether hundreds of AI-generated assertions per week actually encode the right behavior." Nobody has settled who owns that check when it's not a dedicated tester's job anymore.
- The QA engineer's job has to be redefined around judgment and risk, and most orgs haven't done that redefinition yet. If the mechanical test-writing that used to define the role is gone, the role either becomes something closer to a risk-and-quality strategist embedded across teams, or it quietly disappears — and right now most job descriptions, career ladders, and hiring pipelines still describe the old job.
- Institutional memory of "what broke before" has no clear owner once the team that held it is downsized. QA teams were often the de facto keepers of "we tried that, it broke prod" — if that team shrinks because test-writing is automated, that memory either gets captured somewhere durable (specs, incident retros, a fed context store) or it's quietly lost, and nobody's built the replacement yet.
- Trust calibration for AI-generated tests scales faster than anyone's ability to audit it. Developers integrating AI-written tests into their own workflow have direct incentive to trust green checkmarks that let them ship faster — the same abundance that removed the excuse for skipping tests now creates a new incentive to rubber-stamp them, and there's no established practice yet for catching that at scale.
Where it breaks
Orgs cut QA headcount because test-writing no longer needs a specialist (INVALID #1) at the same moment nobody has assigned who audits developer-owned, AI-generated suites for trustworthiness at volume (NEW #1) — the review step that used to be QA's whole job disappears along with the team, instead of moving to whoever's left.
Separately, teams treat "developers now write their own tests" as removing the need for independent sign-off (INVALID #2), while accountability for shipped defects still has to land on someone specific (STILL HOLDS #4) — if the QA role that used to be the answerable party for release quality shrinks without a replacement, a defect in production has a test that passed, a developer who wrote it, and no clear owner of the call to ship.
Related axioms
Engineering
What changes for data engineering with AI?
Engineering
What changes for DevOps with AI?
Engineering
What changes for hardware engineering with AI?
Engineering
What changes for ML engineering with AI?
Engineering
What changes for QA and testing with AI?
Engineering
What changes for software engineering with AI?
Other axioms
Healthcare
Should liability for an AI-influenced misdiagnosis sit with the clinician, the hospital, or the model vendor?
Industries
Does the farmer's judgment still matter when AI can decide planting, irrigation, and harvest timing from sensor data?
Education
What changes for K-12 education with AI?
Society
AI writes progressive programming as well as most trainers — is the personal trainer's job the plan, or the in-person accountability that makes people show up?
Society
What changes when AI agents transact, contract, and pay each other (the machine-to-machine economy)?
Society
Is a shared team wiki still worth maintaining by hand when AI can synthesize institutional knowledge from raw docs and chat history on demand?