alt Hacker NewsIf the post training is done with specific sampling parameters it would make sense to only use the parameters it was trained with.
If the post training is done with specific sampling parameters it would make sense to only use the parameters it was trained with.
Yes, but post training cannot possibly account for all possible use cases. Sane defaults are fine, you can't really do much about sampling parameters in chatbots and coding harnesses anyway. And when making an API call, you have to actively change the parameter in your payload. I don't believe there's any real risk.