This is what it seems to be. I've had to review the LLM output from coworkers who have insisted that the "old" models are terrible but the new ones are very good. They are always discussing the latest models and their tweaks and things.
Their output is just.... not very good. For example, it may not fail tests, but it does so for wrong reasons and will fail under different conditions. Or it checks or guards for things in trivially redundant ways, like doing something like `if (x > 5 && x > 3)` that betray its lack of "knowing" what it's doing. And I can't even get answers from them anymore because they just feed anything I say into the LLM and copy/paste the response.
I'm basically being forced to code with LLMs via review through a person proxy. Or maybe they just have it hooked up to read it directly. It's maddening. It's like having a realistic enough chatbot just shuts people's brains off.
alt Hacker News
This is what it seems to be. I've had to review the LLM output from coworkers who have insisted that the "old" models are terrible but the new ones are very good. They are always discussing the latest models and their tweaks and things.
Their output is just.... not very good. For example, it may not fail tests, but it does so for wrong reasons and will fail under different conditions. Or it checks or guards for things in trivially redundant ways, like doing something like `if (x > 5 && x > 3)` that betray its lack of "knowing" what it's doing. And I can't even get answers from them anymore because they just feed anything I say into the LLM and copy/paste the response.
I'm basically being forced to code with LLMs via review through a person proxy. Or maybe they just have it hooked up to read it directly. It's maddening. It's like having a realistic enough chatbot just shuts people's brains off.