iPhone 13 Pro lock screen delay when tap to wake is off?

My iPhone 13 Pro has been having this issue where when I press the side button to unlock the phone, there is a slight delay before the lock screen properly turns on to full brightness and this transition is not smooth. This isn't an issue I've noticed on my old iPhone 12 Pro or my iPad Pro. On a whim, I decided to enable tap to wake to see if it fixed it, and it did. I've already tried resetting Face ID which didn't fix this.

​

I've uploaded a video of this in action here: https://i.imgur.com/qURs71h.gifv

The first two unlocks display this issue - you'll see that the lock screen is dim and has a delay before going normal brightness. The next two unlocks I enable tap to wake but still use the side button, and the unlock brightness ramp up is super smooth as expected. I then do two more unlocks with it off once again.

​

Does anyone else have this issue and have a solution? I'm on 15.0.1.