logoalt Hacker News

emteltoday at 1:03 AM2 repliesview on HN

I would say that it is not even wrong. You say it’s a next token predictor. I say it isn’t. What observable behavior of the system can settle our dispute?

I fail to see how any possible output could cause either of us to change our mind.


Replies

tetrisgmtoday at 1:15 AM

That's perfectly put. The value of words and what we assign to them, let alone how we assign meaning, or the interpretation of what the other person says, is completely arbitrary. (in practice).

randyrandtoday at 2:06 AM

What comes after “the dog”?

Does it complete the sentence?

If not then it’s not a next token predictor. Or at least not a good one.