> An LLM is not a calculator and if you're trying to use it for that, that is a you problem.
I’m talking about another tool. An actual calculator. I would never accept a calculator that is correct “most of the time.” I don’t want an LLM that only meets that bar as well.
It's correct, by some definition of "correct", essentially all the time. It always produces text that matches the probable token distributions that it was trained on. You seem to want it to be an oracle. Your job as an engineer that works with them is to figure out how to make what it _actually_ does useful.