No. 39 / 339

Is the ML engineer role converging with software engineer now that AI handles most model-building grunt work?

The shift

Writing the mechanical layer of ML work — training loop boilerplate, data-pipeline glue code, standard architecture selection, hyperparameter sweep scaffolding, eval-harness setup — goes from scarce specialist labor to an abundant, near-instant first draft any competent engineer can generate and iterate on with an AI coding assistant. What stays scarce is knowing whether the resulting model is correct, safe to ship, and worth the compute — none of which the flip touches.

The axioms

  • ML engineering is a distinct discipline because building a working model requires specialized, hard-won craft. Rests on training-loop and pipeline code being scarce, expensive-to-acquire skill.
  • The ML engineer's value is in hand-tuning what generalist software engineers can't. Rests on hyperparameter search, architecture choice, and data wrangling being slow, expertise-gated work.
  • Software engineers can't do ML work because the tooling and math are a separate skill tree. Rests on ML frameworks being unfamiliar and math-heavy relative to typical SWE background — a knowledge-access scarcity, not a judgment scarcity.
  • Model quality is validated by the person who built the model. Rests on the builder being the only one with enough context to know if it's good — an accountability/verification axiom, not a labor axiom.
  • Production reliability, cost, and safety of a shipped model are engineering-org problems, not ML-team problems. Rests on physical/operational accountability (uptime, cost, incident response) being a distinct scarce skill from model-building.
  • Deciding what model to build, for what business outcome, at what risk tolerance, is a judgment call independent of who codes it. Rests on taste and goal-setting being scarce regardless of who writes the code.

Invalid axioms

  1. ML engineering is a distinct discipline because building a working model requires specialized, hard-won craft. AI coding assistants make competent first-draft training loops, data pipelines, and standard architectures abundant — a generalist software engineer can now produce what used to require someone who'd spent years learning the ML stack. The habit-trap: orgs still carve out separate "ML engineer" reqs and comp bands for work that's now largely prompt-and-review, and still route routine model-building through a specialist queue instead of letting any engineer generate a candidate model in an afternoon.
  2. Software engineers can't do ML work because the tooling and math are a separate skill tree. The tooling gap AI closes directly — an LLM will scaffold a PyTorch training loop, explain a loss function, or translate a paper's method into runnable code on demand. The habit-trap: teams still assume "ML" needs a translator between the math and the codebase, when the model now does the translating.
  3. The ML engineer's value is in hand-tuning what generalist software engineers can't. Standard hyperparameter sweeps, common architecture selection, and boilerplate feature pipelines are now templated, AI-assisted, or automated (AutoML-adjacent tooling plus agentic iteration). The habit-trap: performance reviews and leveling still credit engineers for grinding through tuning work that's now a commodity loop, rather than for judgment about when tuning even matters.

Unchanged axioms

  1. Model quality is validated by someone who understands what "correct" means for this specific system. An AI can generate a model and report a metric, but knowing whether that metric is the right one, whether the eval set leaks, whether the model will silently degrade on a distribution shift the team hasn't seen yet — that's ground-truth verification, and it's exactly where LLMs are weakest: confidently plausible, not reliably correct. This doesn't collapse just because drafting got cheap.
  2. Production reliability, cost, and safety of a shipped model are accountability problems, not code-writing problems. Someone has to be answerable when a model degrades traffic, leaks data, or produces a harmful output in production. That's liability and operational ownership — a model can't hold it, and neither can "the AI wrote it." This is arguably the part of ML engineering that most resembles the SRE/platform side of software engineering already, and it doesn't get easier with better code-generation.
  3. Deciding what model to build, for what business outcome, at what risk tolerance, is a judgment call independent of who codes it. Whether to build a model at all, versus a rule, versus doing nothing, and how much error the business can tolerate — that's taste and goal-setting under real stakes. AI abundance in drafting doesn't touch this; if anything it raises the number of technically-plausible options someone has to say no to.
  4. Deep specialization still exists at the frontier — novel architectures, training at unprecedented scale, research-level debugging of systems no one has built before. Where there's no pattern to match — genuinely new model classes, distributed training failure modes at extreme scale, research contributions — judgment under novel ambiguity stays scarce and human. This is a shrinking sliver of "ML engineer" job postings, but it's real and it's the part that doesn't converge with generalist SWE work.

New axioms

  1. When any engineer can generate a plausible model in an afternoon, who verifies it before it ships, and against what standard? The bottleneck moves from "can we build this" to "can we trust what got built," and most orgs don't yet have a role or process that owns that check — it used to be implicitly the ML engineer's job because they were the only one who touched the code.
  2. If ML-specific hiring pipelines and titles collapse into generalist SWE roles, who keeps the accountability for model-specific failure modes (drift, bias, silent degradation) that generalist SWE training never covered? Merging the roles risks losing the person whose job was to watch for the failure modes unique to statistical systems, not just software systems.
  3. As model-building compresses into a fast, AI-assisted loop, the number of models an org can plausibly try to build explodes — who decides which of the many now-cheap options are worth building at all? Cheap drafting doesn't create good taste; it creates more unfiltered proposals competing for the same scarce judgment.

Where it breaks

Orgs are already merging "ML engineer" into generalist SWE job ladders and hiring pools (INVALID: the craft-scarcity that justified a separate title is gone) — but nobody has assigned a role that owns statistical-failure verification and model-specific accountability once that title disappears (NEW: who verifies and who's answerable). The convergence is real at the "who can write the code" layer and false at the "who's answerable when the model is wrong in a way only ML people are trained to catch" layer — and the field is collapsing both layers into one hiring decision.

Related axioms

Other axioms