Might be worth digging through MicroRTS too, https://github.com/Farama-Foundation/MicroRTS (it's been abandoned), Python RL interface @ https://github.com/Farama-Foundation/MicroRTS-Py ... I think there was some strategy work there.