I used prompts and photo sharing to get Gemini to command forces in a video game

I do not know python, though LLMs tell me that's the fastest way I could somehow actually code integrate it. So what I simply did was used a simple game called 'War of Dots' that is realtime but can be paused, and I got Gemini to take on the traditional AI. As the title says, I would share info with the AI in various ways to then get it's next orders. The biggest lesson was that it could be relatively logical in the language model with broad visions often expressed, but if you tried to get it to generate images then it would get distortions and make up units or put arrows of orders where it doesn't make sense to even comprehend. LLMs seem good at reading images too, generally. Though I've seen distortions before too, which sometimes can be made better in a long contextual chat already but never fully avoided. In the end the LLM used hammer and anvil tactics and was super anal about avoiding rough terrain for tanks lol. I guess it's basic but it works so why fix it? Oh it won by the way.