logoalt Hacker News

vunderbayesterday at 7:50 PM2 repliesview on HN

The more generic your prompt, the more generic the response. It's a regression to the "mean" of the training data aka GIGO for AI.

It's like when you ask your average person off the street to draw a house - it'll almost always be square with a triangle roof, one door, and two windows.

In the pelican/bike example, it's probably a bit of a self-perpetuating snowball too. If the earliest examples were bike left-to-right, flat ground, etc. then they are also being scraped up in future LLMs.


Replies

werdnapkyesterday at 11:38 PM

Well, all the LLMs are being trained on previous pelicans, so they look the same.

show 1 reply
polyterativeyesterday at 8:17 PM

as a kid I did them like this. nobody told me to do that. are we all so similar?

show 3 replies