logoalt Hacker News

apitoday at 12:35 AM1 replyview on HN

Extremely small or very heavily quantized LLMs can generate hilarious results. You can also get wild shit if you dial temperature really high.


Replies

jaggederesttoday at 12:44 AM

1 or 2 bit quants are nice and quick too, added bonus to the absurdity and surrealism. Weaponized dadaism at light speed.