logoalt Hacker News

JoshTriplett • today at 1:18 AM • 3 replies • view on HN

> A lot of AI stuff is like that, actually.

Chain of thought was that way. DeepSeek came out, and not long thereafter everyone had adopted chain of thought.


Replies

ethanj8011 • today at 5:31 AM

Unless I am misunderstanding you then I don't think this is correct. Chain of thought was first proposed in 2022. Assuming you mean reasoning models then the correct comparison is GPT-o1, which came out in September 2024, 2 months prior to R1 lite preview. In the next 2 months, prior to the release of the full R1 model, both qwen and gemini released reasoning models. Dario explicitly notes in early 2025 that most major labs had been working on reasoning models in 2024, and explicitly credits OAI for pulling things forward with their release.

https://darioamodei.com/post/on-deepseek-and-export-controls

> In 2024, the idea of using reinforcement learning (RL) to train models to generate chains of thought has become a new focus of scaling. Anthropic, DeepSeek, and many other companies (perhaps most notably OpenAI who released their o1-preview model in September) have found that this training greatly increases performance on certain select, objectively measurable tasks like math, coding competitions, and on reasoning that resembles these tasks.

LASR • today at 6:10 AM

CoT is far older than DeepSeek.

I remember adding it to GPT-3.0 and getting a big boost in accuracy. It was like magic.

And then we would handcraft thoughts and inject that into the prompt so the model thinks its owns thoughts and would follow instructions much more precisely.

This was well before reasoning models, even before chat models.

➕ show 1 reply
Ohentis • today at 5:41 AM

Is this true? I don't remember this and looking back it appears that Google came up with it and openai was the first to release a commercial model.