When I use a calculator, I atleast try to get with in a few digits of what I think the anwser is in my head. Mostly since when I was younger I had a very passionate teacher about how much slower everyone is now because of calculators on simple math. I just apply the same thing with LLMs, just try and think of how and what I would have said and see how close I was. Only thing I change is I don't trust the anwsers and accept some nuance in the given context. It's a double edge sword because then I crash out over it more than if I don't. When it over and under explaining the wrong sections or when it gets to an objectively terrible solution that technically anwsers the question. It feels like a student trying to get brownie points and/or give fluffed anwsers for the sake of not leaving anything blank on a test.
Yeah, I've always tried to train myself to do calculations in my head as much as reasonably possible when learning about mathematical objects, etc. Like when I was learning linear algebra I made myself invert 4x4 matrices in my head. (Pen and paper is also cheating!) Calculators and computers have been better than me at this sort of thing for my entire life, so in some sense this isn't a change?
We had Mental Math sessions in class. The goal was to teach you how to do math without pen/paper, calculators were not even an option. I try to teach some of this to my 6 y o.
The calculator comparisons are truly meaningless imo, a calculator does nothing if you don’t know how to use it and what to input, an LLM circumvents all that, but a lot of people seem to think it’s the same.
OT, but if we made kids learning math use log tables and slide rules for all their calculations I expect that they would engage their brains more and actually think about what they were doing, ie: form a strategy to solve a problem before they started calculating. Also I think that they would get a better "feel" for working numbers in general. I have no evidence, but I suspect that by abstracting away a lot of the "gruntwork" of calculating, we've really hampered people's development in math.
Unfortunately this adds quite a bit of overhead and would make everything take a lot more time. It might be worth it though.