It sounds like the tool call is probably not grounded with your precise position.