AITA for being mad my husband invited his daughter on fathers day weekend.

Me (40f) and my husband (51m) have two children a piece,each from previous relationships. Im very family oriented always want our kids with us. My husband in the past, would rather not have the kids, he gripes and complainins about them being with us and how he wants it to be just us, and how expensive it is to do anything. Yet if his kids are with us we can do anything no big deal. Heck he took me to an expensive restaurant on my birthday and told my kids they couldn’t come to celebrate. Knowing I told him I wanted a big celebration for my 40th with friends and family and I wanted to feel special knowing he put some effort into it.. he didnt. Well back to the story our kids are older, young adults, and his younger daughter always wants to be with us when we do things ( we go on fun weekend trips alot) and Im certain its cuz she knows she can go and pay minimum if anything but I dont mind. My kids go back and forth, you never know if they will want to go or not. Over the past 15 or so years he always complained about certain stuff when taking trips with the kids. So now when I make plans,I can hear him in my head saying the things he always complains about. I feel the anxiety and my hair stands up on the back of my neck before I tell him I am inviting my kids. I have learned that if I tell him invited his youngest (shes the only one who is outgoing and does things with us) I can get by with adding my kids to the invite without much bitching. I can almost quote him in my head before he starts bitching outloud otherwise. We have had a rocky couple of months and honestly I haven’t really been “into him.” I see my husband as a very attractive man and I have never loved anyone like I do him but with us fighting and bickering there just hasnt been much there. Im not saying divorce but I had a conversation about knowing we will fail if we dont start working on this NOW! He agreed and its a slow process but Rome wasn’t built in a day. Last week we went and did what he likes to do which is work on our property. He likes me to be there with him and I guess his love language is me working there with him even if we cant see each other. We actually had fun! I was actually feeling attracted to him and enjoying his company. Well all of our kids and us were supposed to meet up in my hometown this weekend . They made plans and we made plans we didnt know either group was going until weeks after we planned it but it was going to be a good time. Well my friend invited us on a trip this weekend and I changed our plans .. I didnt tell the kids that we werent going until 2 days before. Well my kids said they needed to work alittle more before their trip (kids) they planned together then the following week were going on a week long vacation (whole family) so moneys going to be low for them. This worked out GREAT For me. I have 2 dogs I dont have to take with me, now my kids can watch them. Well his youngest decided she wasnt going to go if the other sisters and me and her dad werent going. No big deal. Well were here and enjoying the trip and my husband gets text from his daughter about fathers day weekend and how she wanted to spend it with him.. In my head not a big deal we will be back Sunday we can go eat, cook.. do whatever. Well Saturday afternoon I hear him on the phone telling his youngest to come on up.. In my head this isnt fair i paid for this trip to enjoy my husband and be “girlfriend and boyfriend “ not mom and dad. my kids didnt even get an option to switch shifts either to enjoy this cool little getaway and still work..And the place we rented isnt big enough to hold all of our kids and the dogs. he said he wants to spend time with his daughter and my kids need to go see their “f#%^*ng dad” and leave him alone. We dont share finances and if we go on trips it’s because I find a way to pay for it because he would rather stay home. I paid for this trip.. we were spending time enjoying each other and I was enjoying his attention and our time.. and then I got bitter and shut down when his daughter arrived. I wanted MY TIME. He keeps saying its fathers day weekend and he wants to enjoy it with at least one of his kids and im looking at it as father’s day is Sunday and out of 15 years he hasn’t celebrated a whole mothers day weekend for me, planned any trips, made me feel special for any holiday or special day.. So why should I celebrate him for a whole weekend? Why cant I just enjoy a weekend improving my relationship with my husband now and then have his kids come over later and have some burgers or. AITA