Gemini Doesnt Activate with "Hey Google" on my S24+

I didnt have this issue with my S21. I have set it as the default assistant. I have to reset my phone frequently to get Gemini to respond from "hey Google".

I am googling this issue but not finding solutions.