Men’s fashion in smaller sizes?

I’m 5’1” with a 28 inch waist and I can almost never find any items of quality at vintage stores, especially in the men’s section. Typically, the only clothes that actually fit me are women’s jeans from the 2000’s, which aren’t quite my thing. I just want to dress like a man, no offense to those who don’t. It really shouldn’t be this hard. Basic denim and button ups are everywhere yet never small enough for me. This is a nightmare. I know how to tailor but not well enough to fix clothes that are 3-4 sizes too big. (which they ALWAYS are) I’m tired of coming home empty handed and insulted every time I try to shop. Can anyone help?