So my code that Claude makes, which previously was using the best (most probable) tokens for the job, will now be getting worse in random positions, to appease a voluntary EU suggestion. Love that.
They aren't using greedy decoding, there's enough randomness in sampling to swap some with independent signal.
[dead]
They aren't using greedy decoding, there's enough randomness in sampling to swap some with independent signal.