alt Hacker NewsI would guess a tiny stripped down text diffusion model. It only has 32k context, and for choice mode it can only select from 10 choices.
I would guess a tiny stripped down text diffusion model. It only has 32k context, and for choice mode it can only select from 10 choices.
> and for choice mode it can only select from 10 choices.
Rip there goes my excitement. I have a task that something like this would be great for but the list of options is a zero or two larger than that xd