alt Hacker NewsSo in theory you could feed it incomplete text, and then ask it for the probabilities of what the next character could be?
Replies
iforgotmypasswo • yesterday at 2:47 AM
Or a partially completed song, asking for the next note. I’m not sure if you’re joking, but using it for space constrained next token generation within a grammar sounds like a really neat use case.
➕ show 1 reply
CompleteSkeptic • last Tuesday at 8:25 PM
you could, but it the model is not optimized for text
this is complex, but generating text is highly complicated and requires mode dropping to make long cohesive text
vatsachak • last Tuesday at 8:19 PM
If you provide it an AST of the english language, yes.
aghilmort • yesterday at 12:47 AM
was wondering same
I think the joke here is getting missed