How Did You Make the Decision it was Time to Sell Your House?

I don't know if this is the right community, but I figure we're all here buying or selling or thinking about it. I want to sell my house, but I'm not in the position where I have to (ie, job change, major life change). Financially it probably makes the most sense to stay where I am with my 3.2% interest.

I like my house but there are things I don't love about it that can't be changed. To sum up, I live in a townhome and I'm tired of living in a townhome and all its ensuing issues (crazy high HOAs, super hot upstairs, two flights to do laundry, tiny yard, etc.) I've been wanting to move for a few years but health problems and a layoff put those plans aside. I'm now healthier and have a more secure job going on two+ years but in healthcare so who knows on future security.

But I'm terrified to sell. I keep wondering about all the what-ifs. This economy has me worried (I have one-year expenses set aside but still). All these issues on the macro level can effect us. I don't have another house picked out yet as what I want rarely comes for sell but goes fast when it does. I'll have to couch surf with family or rent if it takes too long to find something.

I swing from yes, it's time, to no, I'm crazy for considering it within a single hour. I've done pro/con lists, crunched the numbers, and met with three realtors. I have to make a decision.

How did you make that final decision? Any regrets?