logoalt Hacker News

win311fwgtoday at 7:48 PM2 repliesview on HN

> Who the FUCK speaks like that?

If we assume that it is LLM generated, as suggested, apparently a lot of people, as the LLMs were trained to mimic how people speak (write).

You might find it to be unusual because you probably have never read anything written by most people. Only peculiar characters tend to get noticed.


Replies

red75primetoday at 9:09 PM

> the LLMs were trained to mimic how people speak (write)

It's a foundational model (fresh from autoregressive pretraining) that approximates the probability distribution of human texts. And, no, it's not the statistical average of how people speak. It approximates how a person who could have written a text in its context would have written the next words.

Fine-tuning, RLHF, reinforcement learning change this probability distribution. I guess, it's mostly RLHF that shapes the way LLMs write. The similarity of style is due to common providers of RLHF data.

rogerrogerrtoday at 7:53 PM

But no _individual_ speaks like this. It is not common that a guy representative of the Average Of All People Plus Some RL writes a blog post.

show 2 replies