Not just “basically the same”, it is literally the same result[0,1], except here the models without the flaw just so happen to be “smaller models from the same family”… and presented before the flawed-and-patched model result, along with a conceptual framework that tries to spin this as a capability “emerging at scale”.
Since the paper is also wholly and excruciatingly LLM-generated prose, it is unclear whether the author is trying to pull a fast one on his audience, or the author’s chatbot pulled a fast one on him and he is unwittingly relaying this to his audience.
0: Transcribed from the paper:
The same task and tools for
Qwen3.5 2B
Qwen3.5 4B
Qwen3.5 9B
Qwen3.5 27B
1: Transcribed from the paper: (c) The same problem, the same seed
“... If the base were changed to four you would count as follows: 1,2,3,10,11,12,13,20,... The twentieth number would be:”
Base model: no answer, cut at 16,384 tokens
“... I will write the response.
I will write the response.
I will write the response.”
After its own edit: 110 (correct) 5,341 tokens
“... The 20th number in the sequence is 110.”