When I first started working with LLMs in 2019 AI was in no was synonymous with LLMs. I personally realized pretty quickly that they’d eventually be able to write software that compiles. Not necessarily good software, but software that passes a minimum threshold.

Then again there were all sorts of hallucination-adjacent issues which are still present but rarer as models get bigger. Wondering about the consequences for software engineering as an industry was a little bit of an “overpopulation on Mars” problem since GPT2 could barely string a paragraph together.

Another factor is the industry’s continued insistence on evaluating the ability to write software using leetcode. Well, Claude is probably the best leetcoder in the world now, but since our industry never figured out better evaluation criteria for candidates of course we are backed into a corner.