>where am I? How can I move? how do I fit within the environment?

These does not require any general intelligence or understanding and can be expressed as a bunch of fixed rules.

>I think it's surprisingly hard to do in a way that rules out LLMs,

May be. But we sure can say that LLMs are not "reasoning". Which is what I have done in the linked comment.