Because a "world model" for relative positions in space is just a partial ordering of points.

That's not really a world model.