Will I ever be able to resume my audio book after being paused for 3-11 seconds without Apple Music playing a random song?

iPhone 15 pro. It’s happened since I’ve had the phone and even with my last one. No other app is open besides audible. It doesn’t happen every time but in any given work day, I listen to audiobooks for 6-8 hours a day, I’ll pause and resume via my earbud and a song will start up.