my experience with LLMs is that when you get answers to questions you didn't ask that it's repeating something that already exists. In other words, it probably regenerated a tool from which it was trained on.
Sounds like your experience from LLMs dates back to 2022.
How do you know this? How would you falsify this hypothesis?
[dead]
Sounds like your experience from LLMs dates back to 2022.