AI Makes You Faster But Dumber? What Anthropic's Study Actually Found
This post is based on How AI Impacts Skill Formation by Judy Hanwen Shen and Alex Tamkin at Anthropic, and the accompanying blog post. The Headline That Writes Itself “AI makes coders dumber.” You can practically hear the hot takes forming. And on the surface, the numbers seem to support it: in a randomized controlled trial, developers who used AI assistance scored 17% lower on a mastery quiz compared to those who coded by hand. That’s the equivalent of nearly two letter grades. ...