alt Hacker NewsTo me context means everything. Tokens per second is a great metric but in the real world context window is the deal breaker when a real use case is on the table.
To me context means everything. Tokens per second is a great metric but in the real world context window is the deal breaker when a real use case is on the table.
Gemma 4 26B is capable up to 256k or 262k, can't remember which.
Whether the writer's setup affects that choice I don't know.