Switching between devices

Hi Apple, I’m curious as to why I can’t switch between my HomePod to my earbuds. I don’t know why you can’t just click the little icon there and it moves? No, click this might click that. I’m in the middle of a shuffled playlist. I don’t want to have to start over again by cutting it all off. I just wanna switch it to my earbuds from my HomePod never works the first time there’s always a touch touch touch this? Why can’t it be more seamless come on guys?