logoalt Hacker News

nazgul17today at 12:56 AM1 replyview on HN

The announcement of GPT 3, hands down. That's the day that my mind was blown.

Everything after that has been (genuinely significant) incremental improvements. But that announcement was a qualitative step up: we got ""real"" AI that day, something that could pass a Turing test (as common sense envisioned it, without all the caveats added once we learnt of the genuine limitations of LLMs).


Replies

JimDabelltoday at 1:53 AM

That was it for me as well. For it to be able to produce coherent, useful results for arbitrary text and code, even as mere autocomplete, was when practical software intelligence crossed the line from a vague “might happen at some arbitrary point in the future” to “this is achievable using today’s knowledge”. GPT-2 was interesting but was miles away from being reliably coherent enough to cross that threshold.

There have been big steps forward since then (chat, tool calling, etc.) but they have all felt like pretty inevitable evolutions of GPT-3 rather than things we weren’t sure were possible. Straightforward applications of engineering rather than scientific breakthroughs.