Relevant to your comment is this link from today's HN front page, about adapting LLMs to perform deterministic calculations.

https://www.percepta.ai/blog/can-llms-be-computers