Does removing and attaching a silencer affect zero

Hi Guys I'm new to to the silencer game I wanted to know if I store my firearm in my safe, I use it like once very couple weeks or even a couple months should I store it with silencer off and thread protector on or can I leave silencer on and if I have to remove and add the same silencer on will it loose zero