AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace

A new real-world test puts AI coding agents in a simulated developer job with colleagues, project boards, and incomplete handoffs, where they have to keep developing software on their own and reliably close open tickets in a messy daily workflow. Even Opus 5.5 and Astra fall far short, solving fewer than one in ten tasks completely. The models finish clear, standalone assignments

[…]
Content was trimmed to protect the source. Please visit the original article for the full text.

This article has been indexed from The Decoder

Read today’s AI news roundups »