Why do we have colored flags but subdued unit patches?

The colored patches almost always look better than subdued ones, and it actually matches the flag, so what's up with that?? May as well only wear subdued flags