Reality check: Am I hating the job or hating the work?

Without going too much into detail, I can't tell if I'm just having a bad start to a new job or if it's the job itself. It's my first time having a job that has great benefits, a salary I can live off of, and I can leave the work at work instead of answering questions and emails during random hours.

While I'm actually at work, I'm stressed with a lot of major challenges happening including my predecessors not leaving much documentation, a lot of sudden turnovers (a combination of new job opportunities, retirements, and quitting), major projects that all need immediate attention, and having to deal with more financial paperwork that initially thought. What I think the department needs is more people; I've brought it up with my (now new) supervisor but it doesn't seem very likely if at all. Plus, if one of my counterparts goes on vacation, I'm expected to cover (most of) his work in addition to mine.

But I can't tell if this is just what life is like at this place under 1) this current supervisor, 2) sudden turnovers, or 3) if I'm not adjusted to the way things are done here. I also feel a lot of guilt at the thought of leaving since this job got me out of a really toxic place (they don't know that).