Exercise vs. Being sick

I just started into a good routine at the gym, and was really feeling amazing. Unfortunately, I caught the ick that has been going around, and have a cold. I am thinking it is best to take time off to get fully recovered, and go back. However, I feel like I am being such a wimp, and feel like I should push through, and get the workout in.

How to handle exercise when you are not feeling well? Am I right, listening to body and just get the rest I need to get healthy again?