logoalt Hacker News

verdvermtoday at 12:53 AM1 replyview on HN

people use it because it does in fact make a sizable difference in experience and outcomes


Replies

Systemerror7A69today at 4:13 AM

Theres a study from earlier this year which suggests the opposite: https://arxiv.org/abs/2602.11988

Most of the agents.md and what people use it for / write into is does, in fact, not make a difference.

Now, sure, this study is a bit old for LLM standards - as everything beyond the current month is - but

a) I haven't seen any tangible evidence to the contrary and

b) Since the basic inner workings of LLMs haven't changed I'd be sceptical of this not still applying.

I think one major side effect of LLMs moving so fast is that best practices and how to use this tool is very much not catching up as fast.

No one knows what is best and what actually makes a difference, doubly so because LLMs are / very / hard to quantify - even benchmarks themselves are very rough estimations.

People do, in fact, use stuff which makes no difference all the times.

show 1 reply