how far does the smell actually follow you

i smoke pretty regularly during work or before going to see the parents and such.. i feel like the 50 foot walk or so back into work is enough to blow the smell off you but i hear people say 'so and so smells like pot.' how long do you really feel like you need to worry about smelling?