alt Hacker NewsThe researchers who published Attention Is All You Need didn’t have the benefit of the LLMs they birthed. Take a look at the prompt that solved the Cycle Double Cover conjecture, and which has been adapted to achieve breakthroughs in cybersecurity. The field is entering a feedback loop that is leading to exponential innovation. We’re at the beginning of the curve. And right now the big iron data center approach is brute forcing the problem.
Replies
I dont think its exponential innovation. Rapid incremental innovation is happening very fast with some occasional bigger bumps.
Where can I find more information on the cybersecurity breakthroughs adapted prompt?
Intelligence per unit of compute will almost certainly keep increasing. That doesn't mean having more compute isn't still way, way better.
Because I wasn't familiar with it and others might be curious too: that prompt is available at https://cdn.openai.com/pdf/04d1d1e4-bc75-476a-97cf-49055cd98... and is just below 5 KiB of text.