Is watermarking part of a model architecture or is it something added by the inference engine?
Added during sampling by adding a bias to token probabilities in places where several tokens are equally likely.
alt Hacker News
Added during sampling by adding a bias to token probabilities in places where several tokens are equally likely.