"Sorry, I don't understand" on everything while driving

Has anyone noticed that Android Auto's assistant is not working for pretty much anything? I have Gemini enabled on my phone so according to AA, I am using that, but things like asking it what time a store is open all come back with "sorry I don't understand" and it's super frustrating (asking the phone when not in AA work fine, however). A couple weeks ago it worked fine so it must be something was updated or changed and now it's broken. Just wondering if anyone else is experiencing the same thing.