This guy has been at it for a while. Was first person I thought of while reading this article.
I was wondering how he has adapted to using LLMs. If they might have significantly advanced his work.
He made a few videos about it last year and the consensus was basically that none of them have a good enough understanding of the hardware to actually be useful for optimizing anything. They end up making a lot of assumptions about how the caching behavior and memory architecture works and kind of insist that it must work the way modern PCs do. And it led to a number of cache misses and RAM bus contention that basically didn't work as well as he can do by hand.
Wouldn’t be a hacker news post without shoehorning chatbots