logoalt Hacker News

Kranartoday at 2:20 AM2 repliesview on HN

What is this supposed to mean exactly? Do you think there are developers at OpenAI or Anthropic whose job is to train these state of the art models to draw pelicans riding bicycles? Like how exactly do you expect them to be doing that anyways? Hiring graphic artists to create SVGs of bike riding pelicans and feeding thousands of them into the model's training set?


Replies

mudkipdevtoday at 2:41 AM

Generate two images, get a vision model to judge, then RL reward the better one. And yes, OpenAI employees on twitter bragged about the model's SVG capabilities. So there are clearly people working there who care about it.

awakeasleeptoday at 2:40 AM

You gotta look up how RLHF works before you ask a demanding question like this.