Or a partially completed song, asking for the next note. I’m not sure if you’re joking, but using it for space constrained next token generation within a grammar sounds like a really neat use case.
Feed the generated note back into the input for the next query and you have ... autoregression?
Feed the generated note back into the input for the next query and you have ... autoregression?