Built a driving game where the LLM semantically parses your driving instructions into structured actions for the driver to follow
The LLM never has to do any spatial reasoning. It only maps your phrasing to a small fixed vocabulary. You type something like "follow the road to the next intersection, wait for the green, then take a left and cruise to the destination," and the LLM parses your sentence into a list of typed actions (move_until, take_turn, follow_road, wait_for_green, etc.). A deterministic engine runs those actions on the map.
The engine handles what direction "left" is for the driver, traffic light timing, and whether the corridor between two intersections bends or not. That separation made it way more reliable than asking the model to output directions.
You get three attempts per map. There's a Dispatch Supervisor whose solution shows the target prompt length to beat, and if you blow all three you can watch the supervisor's solution play out.
Posted Jun 7, 2026, 4:33 AM UTC