I heard that cardigans only look good on skinny people with flat-ish chests. Is it true?

I'm not fat so I don't have to worry about the skinny part so much, but my chest just out pretty far. It's not moobs, it's a combination of my pectorals just jutting out and having an disproportionately large rib cage after losing a bunch of weight.

Would a cardigan look decent on a guy that has his chest jut out about an inch or a little more from his stomach? It seems to work with my polo's and most people just think im really buff wearing them and walking with posture.