M1 Air always very laggy for 1-2 minutes after waking up

Every time my MacBook sleeps, when I wake it up there's these 1 to 2 minutes of very slow performance. Even bringing the browser to focus takes like 10-15 seconds, every click takes long to register. My messaging apps (Discord, WhatsApp, Teams) all start sounding their past notifications at the same time (even if I had already read everything on other devices). After those first couple of minutes it's all back to normal.
Is this normal for any of you? I don't remember it being that way when I bought it. I don't use anything out of the ordinary. Those messaging apps I've mentioned, plus Firefox, one or two terminal sessions, iCal and Spotify.