Wrist pain after shoulder press

I've recently begun using the shoulder press (I think that's what it is, pushing a barbell vertically over my head from a start position similar to that of a squat). When I'm doing it everything feels fine, but later in the day and most noticeably the day after, my wrists/forearms seem to hurt at the base of my hand on the little finger side.

Is this normal? Will it go away once my body gets used to doing this excercise? I'm doing 5 sets of 8 for reference.

Thanks!