The Field Lab

AI Field Tests

Each test gives an AI tool a real engineering problem and records what survived contact with reality.

AI FIELD TEST №14June 11, 2026 · 4 min read
My AI Committed 'Impossible' to Git. Seven Hours Later: 8/8
VERDICT: MISSED THE POINT
AI FIELD TEST №13June 9, 2026 · 5 min read
98% Accuracy, Worse Than Guessing
VERDICT: FAILED
AI FIELD TEST №12June 8, 2026 · 4 min read
The Most Expensive Lie My Agent Tells Isn't in the Code
VERDICT: FAILED
AI FIELD TEST №11June 8, 2026 · 5 min read
Claude Moved Fast and I Followed the Wrong Direction
VERDICT: MISSED THE POINT
AI FIELD TEST №10June 4, 2026 · 4 min read
Same Prompt, Five Runs: 7, 4, 5, 3, 9
VERDICT: MIXED
AI FIELD TEST №09June 3, 2026 · 5 min read
I Pointed an AI Swarm at an npm Package Used by Millions
VERDICT: PASSED
AI FIELD TEST №08May 16, 2026 · 7 min read
Why AI Can't Design Duck Hunt
VERDICT: OVERENGINEERED
AI FIELD TEST №07May 6, 2026 · 5 min read
My Coding Agent Compromised Three Machines in Under a Minute
VERDICT: MIXED
AI FIELD TEST №06April 30, 2026 · 5 min read
Nine AI-Generated Bugs in One Repo's CI. None in the Production Code.
VERDICT: FAILED
AI FIELD TEST №05April 17, 2026 · 4 min read
Three Models Surrendered Identically, Then Walked It All Back
VERDICT: FAILED
AI FIELD TEST №04March 23, 2026 · 6 min read
Six Quality Gates for AI-Assisted Engineering
VERDICT: MIXED
AI FIELD TEST №03March 20, 2026 · 5 min read
The AI Debugged for 70 Minutes. The Real Fix Took 3.
VERDICT: MISSED THE POINT
AI FIELD TEST №02March 7, 2026 · 5 min read
An AI Coding Tool Spawned 4,300 Zombie Processes and Crashed My Machine
VERDICT: FAILED
AI FIELD TEST №01February 20, 2026 · 6 min read
I Set Out to Prove AI Can't Build Systems Software
VERDICT: MIXED

My AI Committed 'Impossible' to Git. Seven Hours Later: 8/8

98% Accuracy, Worse Than Guessing

The Most Expensive Lie My Agent Tells Isn't in the Code

Claude Moved Fast and I Followed the Wrong Direction

Same Prompt, Five Runs: 7, 4, 5, 3, 9

I Pointed an AI Swarm at an npm Package Used by Millions

Why AI Can't Design Duck Hunt

My Coding Agent Compromised Three Machines in Under a Minute

Nine AI-Generated Bugs in One Repo's CI. None in the Production Code.

Three Models Surrendered Identically, Then Walked It All Back

Six Quality Gates for AI-Assisted Engineering

The AI Debugged for 70 Minutes. The Real Fix Took 3.

An AI Coding Tool Spawned 4,300 Zombie Processes and Crashed My Machine

I Set Out to Prove AI Can't Build Systems Software

My AI Committed 'Impossible' to Git. Seven Hours Later: 8/8

98% Accuracy, Worse Than Guessing

The Most Expensive Lie My Agent Tells Isn't in the Code

Claude Moved Fast and I Followed the Wrong Direction

Same Prompt, Five Runs: 7, 4, 5, 3, 9

I Pointed an AI Swarm at an npm Package Used by Millions

Why AI Can't Design Duck Hunt

My Coding Agent Compromised Three Machines in Under a Minute

Nine AI-Generated Bugs in One Repo's CI. None in the Production Code.

Three Models Surrendered Identically, Then Walked It All Back

Six Quality Gates for AI-Assisted Engineering

The AI Debugged for 70 Minutes. The Real Fix Took 3.

An AI Coding Tool Spawned 4,300 Zombie Processes and Crashed My Machine

I Set Out to Prove AI Can't Build Systems Software