logoalt Hacker News

doginasuityesterday at 10:40 PM1 replyview on HN

Pure speculation, but I've noticed drawbacks to the models on high effort. I interact mostly through prompts rather than agents so I sometimes see where their reasoning falls short. A model on high effort has longer output and can get hyperfocused on irrelevant details, maybe increasing the surface area for mistakes. I haven't used other effort levels extensively yet but I've supposed that medium may have more balance.


Replies

tacktatoday at 10:43 AM

Very interesting. I mostly interact through prompts too but haven't changed the effort that much. I just assumed higher was better at the trade off of tokens so I have largely left it at the default.