logoalt Hacker News

Levitzyesterday at 11:36 PM1 replyview on HN

It's not that the "Why it works" doesn't make sense to me, that's all logical, but how can anyone actually tell why it works? Isn't finding out why specifically an LLM does something pretty hard?

Surely this has to be conjecture no?


Replies

akoboldfryingtoday at 4:55 AM

Science works the same way. We poke something a few different ways, observe what happens, come up with hypotheses, test them. We never get a clear "Yes, that's right!" The only answers we can hope to get are "Nope" and "Could be". A "law" is just something that we have tested many times, and gotten back "Could be" each time -- enough times that we subjectively feel satisfied.