AIO for being mad at my partner for wanting to work on holidays?

My partners job allows them to work on holidays and basically use that day as another day off anytime during the year. He casually brought up that he will probably work on Thanksgiving and Christmas since “we’re not doing anything anyways.” Now, we have not made plans for either holiday yet but are always spending time at my family’s house since his family is out of state and his kid switches holidays off and on with him and his mom. He’s not huge on celebrating holidays overall but still does and will help cook, and enjoys spending time with my family. I got extremely annoyed and hurt that he even thought that was okay. His kid won’t be with us for either holiday but that has not changed anything previously. He asked me why that was a big deal because he gets off early anyways. (Meaning 3pm with almost an hour drive back home). In my opinion, it feels like he’s using it as an out and just doesn’t want to spend holidays with me. Maybe there’s a bigger problem relationship wise and this is a “small” gesture to say he’s checking out? I don’t know….maybe I’m overreacting but I’d love some insight especially for those who may share similar views on either end. Also, there’s not extra pay for the holiday. It’s just a day he can swap for another day of if/when needed but he doesn’t tend to take many days off unless it involves some sort of traveling which we mainly do for sports. We don’t usually take vacations.