LLMs have no sense of geography. They measure distances between parts of words, not distances between parts of world.
“Canada is north of the United States” has a higher probability of correctness than “Canada is east of Greenland.”
“Canada is north of the United States” has a higher probability of correctness than “Canada is east of Greenland.”