Sure, people die from regular programming. Mistakes happen. That’s not good or ok, but it seems unavoidable given today’s technologies and tools.

However, I think that’s in a different category than giving life advice. How is an LLM to know that God forgives Joe for stealing a loaf of bread to feed his children, but doesn’t forgive Tom for doing the same thing because Tom had money but was saving up to buy cooler shoes and didn’t want to spend it? A priest’s advice might be “Joe, don’t make a habit of it, but you didn’t hurt anyone and you children were hungry. Tom, would you freaking knock it off already?” An LLM might reply “that’s a wonderful idea!” to both.

Again, I’m firmly not anti-AI. I use it every day. I absolutely to not want to hear its advice on how to navigate the complexities of life as a human being.