How would an LLM know not to take that road then?

If your answer is you tell it, then the obvious solution to improve the app is to provide a way of specifying a road exclusion list, and that is extremely feasible.