Picking up a rifle by its barrel

Will my rifle have any accuracy issues if I pick it up by its barrel when i take it out of my gun safe ? I pick it up like this usually but I’ve been told it’s not good to, curious to hear other people’s thoughts or experiences.