How do you feel spending time in the company of other men who you are close to like family or friends in Silence?

I enjoy the experience of being in silence around people i know. But to my other guy friends they told me they find it uncomfortable. How do you feel about spending time in silence? What has it done for you if you do it?