logoalt Hacker News

xedracyesterday at 12:34 PM2 repliesview on HN

One could argue that human learning is not all that different from machines training on data. We are all regurgitation our own experiences and knowledge to some degree. We certainly have things that machines don't, but LLMs can definitely come up with novel things that were not in the training data.


Replies

duplessitousyesterday at 12:56 PM

There are a number of bad arguments people can make by removing as much information as possible until the two things resemble each other. The ability to make a bad argument shouldn't be used as an inspiration for your own

> We are all regurgitation our own experiences and knowledge to some degree

Feel free to debase yourself but leave the rest of us out of it. This flagellation done by non-experts has to be the saddest part of the llm craze these past few years. The eager willingness to paint yourself as no more than a machine pointed at a problem is a sign of the times.

LLMs don't have experiences, they have training data + test time compute. The only similarities to be found require stripping away all nuance and meaning from a conversation. Refusing to seed purely biological concepts to machines, such as experiences or emotions, does not make LLMs less impressive or less useful. If anything, it makes them more interesting

show 2 replies
mlcryptoyesterday at 2:16 PM

Yeah when someone asks "how was your day?" I say "good" because thats the next token in the sequence

How we interact with society is based on our "training"

show 2 replies