alt Hacker NewsI don't even try anymore. The people who still parrot the stochastic parrot bit this late in the game will simply never understand it.
I don't even try anymore. The people who still parrot the stochastic parrot bit this late in the game will simply never understand it.
LLMs predict next token one at a time. (Stochastically.) Literally. It's what they do. That's how they literally work.
If you don't believe me, download llama.cpp and see for yourself.
P.S. I write inference backends in C++ every day. The gall of people like you who figured out how to prompt Claude and think they're hot shit now is simply unbelievable.