It is very difficult to accurately assess whether new AI models have improved their performance over their predecessors or not – or even to define what a productivity improvement necessarily constitutes, since new releases may demonstrate improvements in one area, but degraded performance in another, in much the same way that conventional software and frameworks can. Sometimes these are voluntary, human-chosen tradeoffs, sometimes 'collateral damage'. That's assuming 'fair play'. There are…
Read the original article:
Downgrading From Claude Fable Barely Affected Dev Productivity During Ban
