logoalt Hacker News

an0malouslast Sunday at 12:43 PM1 replyview on HN

> We're 3 to 4 years into the LLM revolution and the rate of progress is still impressive.

The “Attention Is All You Need” paper came out in 2017 and OpenAI released GPT-1 in 2018. ChatGPT was released in late 2022 but that was not the beginning of LLMs. Transformers and generative AI go back even further.


Replies

pohllast Sunday at 3:06 PM

Can you pinpoint the revolution by pinpointing moments of invention and release? Revolution takes time because it’s more about uptake, downstream effects, and feedback.

show 1 reply