Here to There sizing

I just got a pair of the olive here to there’s, and while I love them, I sized up following reviews to a 6 and the waist is a little looser than I’d like. I want to get the crosshatch and the buffalo print, should I get a 4 or are they tight enough to get the 6? For reference - Im 5’3”, 129 lbs, 25” waist 37” hips. I really love these pants but the sizing is throwing me off.