> Yes it kind of does or it’s not what we were promised/sold.
No one ever promised this, and in fact, quite the opposite.
> A tool has to work reliably
They work reliably for what they do. You make a request and it returns text. What you _do_ with that text is a question of engineering and process. That are plenty of unreliable steps in business and industrial processes that people _engineer around_. A huge amount of computer chips are just _thrown away_ because of reliability problems in the factories that make them, for example.
> I don’t want a calculator that’s correct most of the time.
An LLM is not a calculator and if you're trying to use it for that, that is a you problem.
> An LLM is not a calculator and if you're trying to use it for that, that is a you problem.
I’m talking about another tool. An actual calculator. I would never accept a calculator that is correct “most of the time.” I don’t want an LLM that only meets that bar as well.