Was fun exploring this months ago. Back then even the smallest amount of game knowledge you could provide a model would drastically improve their performance. Most of it is in their training data but they hallucinate a ton of incorrect information.