Not liking new post

For about 4 months, I was working 4 days a week permanently, and if I wanted more than this, I needed to pick up shifts to get a full 40 hours. While I got 40+ hours most weeks, I was still annoyed that I had to pick up shifts, and I really wanted a post where I could get a consistent 40 hours. So I signed up for a job at a different site so I could do just that.

Fast-forward a couple months, and I am simply not a fan of this post. On paper it is easy, but the clients I have to deal with are much more rude than the ones I deal with at my usual sites, and the supervisor micro manages like crazy. I get a call every shift, sometimes multiple, telling me either how to do my job, or that I am doing my job inadequately (but never specifically WHAT I am doing wrong, no matter how I ask). This leads me to be very stressed out and to dread the one day I do work there.

I would consider leaving this post if there were no consequences, but I am concerned both by the fact that I don't want less pay, and I don't know if there's any major repercussions if I leave as well. For added context, this second post is under a different ops manager than the site I work at 4 days a week, if that means anything. Part of me is saying to stick it out in case things smooth out, but I definitely feel like I'm getting a little fed up with the added stress it brings, especially considering I need to be using my spare time on off days to further my career (trying to break into IT again). I'm curious what others would do in my situation.