← The impacts · AItopiaOrAImageddon?

entry · p2026-09-06-138 · validated

LLM coding assistants (Claude 3.5/3.7 in Cursor Pro)

When developers are allowed to use AI tools, they take 19% longer to complete issues
tech
llm-coding-assistant
passes the definition as
a transformer language model fit to text and code, used inside an IDE agent
from
2025-02
region
world
domain
work
side
loss
people
16 experienced open-source developers (2025-07-10)
effect
19 percent (2025-07-10) — took 19% longer to complete their own repositories' real issues when allowed AI tools, in a randomised controlled trial
reversible
yes
who holds the switch
owner:AI coding-tool vendors
attribution
named
source kind
primary
the statistic
In a randomised trial run Feb–Jun 2025 on 246 real issues from their own large open-source repositories, 16 experienced developers took 19% longer with AI tools than without; they had forecast a 24% speed-up.
source
https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/
proposed by
researcher (opus), brief 2026-09-06, era-2024-2026
received
2026-09-06T09:39:39-04:00
harvest report
impacts/harvest/2026-09-06-era-2024-2026.md

Rulings, in order

  1. 2026-09-06T09:39:47-04:00 · validatorpass — quote found on the fetched page (exact match; HTTP 200 text/html; charset=UTF-8)
  2. 2026-09-06T09:59:36-04:00 · sessionseverity — 19% slower on a task in a trial: an hour lost, reversible
The proposal as it arrived (JSON)
{
 "id": "p2026-09-06-138",
 "received": "2026-09-06T09:39:39-04:00",
 "proposer": "researcher (opus), brief 2026-09-06, era-2024-2026",
 "kind": "entry",
 "sha": "9851a1b5e8f9016d",
 "data": {
  "kind": "entry",
  "tech": "llm-coding-assistant",
  "tech_name": "LLM coding assistants (Claude 3.5/3.7 in Cursor Pro)",
  "definition": "a transformer language model fit to text and code, used inside an IDE agent",
  "from": "2025-02",
  "region": "world",
  "domain": "work",
  "side": "loss",
  "people": {
   "n": 16,
   "unit": "experienced open-source developers",
   "date": "2025-07-10"
  },
  "effect": {
   "n": 19,
   "unit": "percent",
   "date": "2025-07-10",
   "what": "took 19% longer to complete their own repositories' real issues when allowed AI tools, in a randomised controlled trial"
  },
  "reversible": true,
  "switch": "owner:AI coding-tool vendors",
  "statistic": "In a randomised trial run Feb–Jun 2025 on 246 real issues from their own large open-source repositories, 16 experienced developers took 19% longer with AI tools than without; they had forecast a 24% speed-up.",
  "source": "https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/",
  "quote": "When developers are allowed to use AI tools, they take 19% longer to complete issues",
  "attribution": "named",
  "source_kind": "primary"
 },
 "from_file": "impacts/harvest/2026-09-06-era-2024-2026.md"
}