AI coding agents exhibit distinct qualitative failure patterns

There was significant variation in the types of failures agents produced compared to humans. One agent was one and a half times more likely to produce a SQL injection error than humans, while another was about half as likely to produce an auth bypass issue.

Daksh Gupta·Published Sep 27, 2026

Behind the viewpoint

Translations are for reading; original excerpts remain the evidence.

AI-Generated Code Is Already Competing With Human Code — Daksh Gupta, Greptile

Original excerpt

Claude is one and a half times more likely to produce a SQL injection error than humans. Devon is about half as likely as humans to produce a off bypass issue. I found it very interesting that there was this much variation in how these agents were performing and how different their failure modes were from humans.

Additional context is not included in this excerpt. Read the original conversation.

Open original · 9:16 View source page

Start time comes from the supplied transcript. Playback alignment is awaiting review.