> I'm not sure why this is a surprise. Google most likely uses an efficient yet limited language model to give us search answers.

The surprise is that Google decided such an "efficient yet limited language model" is suitable to be shown before actual search results on every search, even though it gets things so wrong, so often. It's not about the technical limitation or design. You really don't understand why that business decision is surprising to users?