If you have access to SOTA implementations, LLMs can often find, understand and copy their best optimisation ideas.