Saddlebag/Phonemount

Do you have saddlebag or a phonemount and if you do, do you take it off everytime you leave your bike unattended somewhere for a bit longer?