logoalt Hacker News

adrianN • yesterday at 4:50 PM • 3 replies • view on HN

All possible books live somewhere in L-space (ook). Exploring that space efficiently is equivalent to creativity. The claim is that the space that LLMs learn is somehow sufficiently limited that it doesn’t contain novel ideas? I never saw a convincing argument why LLMs output can not be considered creative.


Replies

combobyte • yesterday at 6:43 PM

But LLMs don't "explore" L-space, the training process just maps all of the available conceptual landmarks inside that space. There are still enormous (infinite?) tracts of unmapped territory that LLMs never reach, and that's exactly the space where novel ideas live.

moritzwarhier • yesterday at 5:11 PM

OK, I still an confused about what point the extension of the analogy was trying to make, because I didn't consider the parent comment to be arguing for or against LLMs being able to be creative.

hexasquid • yesterday at 7:14 PM

I'm suddenly connecting unseen plots with Unseen University