Husband not attracted to me

To what point should your spouse try to remain sexually attracted to you if you've gained weight? I'm 20 pounds overweight after 2 high risk pregnancies that required hormone shots and bed rest and 1 miscarriage at 16 weeks 2 years ago that ended up with me developing post-partum thyroiditis (so hypothyroidism). I'm juggling a full time job, a child with special needs, and a masters thesis (which I'm doing so we can afford to move to an area with better services for our special needs son). My husband told me he's not attracted to me because of my weight gains, but damn. It's kind of a slap in the face given everything I have going on. I would like some unbiased opinions (so not my friends) on what I should do. Is it reasonable to be mad at him?