alt Hacker NewsNot true. Try to increase the context window and you will be greeted with an error when you reach the real limit enforced server-side.
Replies
quotemstr • last Sunday at 4:49 PM
Perhaps not this for this parameter, but for others? Client side.
Not true. Try to increase the context window and you will be greeted with an error when you reach the real limit enforced server-side.
Perhaps not this for this parameter, but for others? Client side.
The models themselves support up to 1M. You are just charged more for all context over 400k. The 272k limit is just a client limitation to ensure you can never go over 400k since the maximum output size of the model is 128k.