Thinking generates a ton of tokens. These baked in chips tend to not have a lot of memory for context. I am not sure taalas supports Thinking at all.
The more problem like these they solve the more they will look like GPU.
couldn't one just add some hundreds of GB of HBM?
couldn't one just add some hundreds of GB of HBM?