It's quite amazing. I've found if you simply give the LLM a slight hint that things should be optimized for all devices, you can get tenfold performance of the original one-shot. But I think this is still a secret tactic because none of these have been optimized in the slightest.
Originally I felt eh maybe you have to have an old coder's mind to tell the LLM how to keep things optimized... But yeah nah not anymore, you just tell it to optimize.
alt Hacker News
It's quite amazing. I've found if you simply give the LLM a slight hint that things should be optimized for all devices, you can get tenfold performance of the original one-shot. But I think this is still a secret tactic because none of these have been optimized in the slightest.
Originally I felt eh maybe you have to have an old coder's mind to tell the LLM how to keep things optimized... But yeah nah not anymore, you just tell it to optimize.