logoalt Hacker News

volotatyesterday at 1:15 PM1 replyview on HN

It is a goalpost that is easy to move. By "works" I mean learning from a continuous single (meaning batch-1) stream of data. The fact that it produces full words and full coherent phrases instead of a random stream of characters that would any typical LM produce if trained under the same training regime.


Replies

ilakshyesterday at 1:33 PM

I would be okay if you shared it as a potential idea and possibly interesting early result, but the language you are actually using to characterize it is misleading or delusional.

Please get a model to the point where it seems like it has some natural language understanding and then share again with reasonable characterization.

show 3 replies