The thing about the "AI can make mistakes, so double-check responses" thing is the essence of our future hellhole — deterministic software replaced with AI and legal disclaimers.

The reason the firms do not want to invest in making fact-checking a first-class feature is that the appearance of being right is what people want from AI.