Anthropic 的 Alex Albert 发布了内部数据:超过 80% 合入代码库的代码是 Claude 写的。很多研究员已经好几个月没手写过代码了。典型工程师的代码产出量是 2024 年的 8 倍。
在最开放式的工程任务上,Claude 的成功率在 6 个月内从约 26% 跳到 76%。当研究会话偏离方向时,Claude 提出的下一步建议有 64% 的时间比人更好。「我们还没到递归自我改进,但可能比大多数人预期的来得更早。」2294 赞。
Anthropic 80% 代码由 Claude 写。研究员数月未手写代码。工程师产出 8 倍于 2024。
开放式任务成功率 6 个月从 26% 到 76%。偏轨时 64% 提出比人更好的下一步。2294 赞。
Alex Albert (Anthropic) publishes internal data on how much of Claude's development is already done by Claude: over 80% of all code merged is written by Claude. It's been months since many researchers hand-wrote code. The typical engineer ships 8x as much code as in 2024.
On the most open-ended engineering tasks, Claude's success rate jumped from ~26% to 76% in 6 months. When research sessions went off-track, Claude proposed a better next step than the human 64% of the time. 'We're not at recursive self-improvement yet, but it could come sooner than most expect.' 2294 likes.
Over 80% of all code merged into our codebase is now written by Claude. It's been months since many researchers at Anthropic hand-wrote code. The typical Anthropic engineer ships 8x as much code as they did in 2024.
On the most open-ended engineering tasks, Claude's success rate jumped from ~26% to 76% in 6 months. When research sessions went off-track, Claude proposed a better next step than the human took 64% of the time.
We're not at recursive self-improvement yet, but it could come sooner than most expect.