I'm planning to quit swimming at the community pool.

I attend a community pool because I live in an apartment. I'm just so ashamed of my body as a man. I feel like I have to lose weight to be comfortable swimming in public. What do I do?