I don't think age of the puzzle even matters, all models have search capacities these days
> all models have search capacities these days
one would hope that they disable websearch and internet access (maybe all tools?) when doing generalization testing?
Model weights (what is being tested here) don't inherently "access the web" when inference is running. If the model has access to a web search tool, that's a different story.