logoalt Hacker News

glitchctoday at 3:57 PM1 replyview on HN

Of course, because it's not the LLM that's special but the training data. Nowadays, your favourite AI service to generate code for an LLM whenever you ask for it.


Replies

oerstedtoday at 4:04 PM

I don’t think that’s correct, the data is not that special either, and getting a similar dataset is significantly easier than getting the compute capacity to use it, even if they are both relatively hard.

Probably this also is too cynical and simplistic, but: really what’s special is the ability to get this kind of capital, with the freedom to burn it on mad moonshots, with long enough leeway to actually get to see a few of the moonshots come true.

No wonder that the head of YC made this happen, this is exactly what they are world-leading at.