logoalt Hacker News

shawnztoday at 12:16 PM1 replyview on HN

There is already some intentional randomness in token selection, because it actually improves the quality of responses if you intentionally don't always pick the most likely next token.

You can hide data in that randomness without impacting the quality of the response by using a sufficiently "random looking" pseudorandom bit stream instead of real random numbers.

I previously worked on a project to do that here: https://github.com/shawnz/textcoder


Replies

KoolKat23today at 2:28 PM

Good point, very interesting. Thanks!