One of the airpods pro 3 wont connect

Sometimes when i take them out, only one airpod will connect to the phone the other one shows its still charging in the case even when its taken out. I would have to put them back on the case, wait for a few minutes and then try again to fix it. Has anyone come across this issue and found a fix?