>We study a frontier LLM in its purest inference regime - a single generation pass over a prompt containing the full training and test data, with no tools, no agentic scaffolding, and no fine-tuning
Sigh. So this is somewhat interesting niche academic research but utterly irrelevant to real-world use cases.
I find that an odd take. The paper claims to establish what causes the problem: dimensionality. They are clear in that they don't understand why. But this sort of work is what needs to be done to eventually solve the problem.
And written by an LLM, to boot.
[flagged]
So the best way to run a controlled trial is to maximize the external noise and confounding variables?