logoalt Hacker News

wyager • yesterday at 11:41 PM • 1 reply • view on HN

> It could be encoding anything in its adjective choices etc.

This is very hard for models to learn

https://www.lesswrong.com/posts/MAww2kXP4cGWz4M5p/steganogra...


Replies

octoberfranklin • today at 1:32 AM

This is very hard for models to learn

That is not an accurate summary of the link you provided. The link demonstrates that it doesn't happen in open-weights models as of ~2025.

Reinforcement Learning is very likely to train this behavior if the RL reward is based on the thinking tokens. That's something people weren't doing two years ago.