It's not that the "Why it works" doesn't make sense to me, that's all logical, but how can anyone actually tell why it works? Isn't finding out why specifically an LLM does something pretty hard?
Science works the same way. We poke something a few different ways, observe what happens, come up with hypotheses, test them. We never get a clear "Yes, that's right!" The only answers we can hope to get are "Nope" and "Could be". A "law" is just something that we have tested many times, and gotten back "Could be" each time -- enough times that we subjectively feel satisfied.
Science works the same way. We poke something a few different ways, observe what happens, come up with hypotheses, test them. We never get a clear "Yes, that's right!" The only answers we can hope to get are "Nope" and "Could be". A "law" is just something that we have tested many times, and gotten back "Could be" each time -- enough times that we subjectively feel satisfied.