It is impressive, but it is also a display that LLMs are simply not suited for this, there's way too much latency. Obviously, a more specialized neural network would be much better, but would you believe this:
In 2017, OpenAI presented the first version of their program that plays Dota 2, a very complex, fast MOBA with endless mechanics and defeated one of the world champions in a one-on-one match. Next year, they showed the world OpenAI Five, a version of the program, that runs a full five player team of those bots and they managed to defeat a full team of world champions in 2019. They ran an event where the bots would play for 4 days straight and they won 99.4% of 42,729 matches.
And CNN for image recognition? It’s (similar to) what the human brain uses.
What some people do on the rs-sdk runescape server is Jev + deterministic scripts + orchestrating with Astra