Reduced anxiety when i DONT take it?

Ive been taking 20mg oxazepam daily for around 3 years (the dose have ranged from 10-30mg everyday but usually 20mg) If i for example only take 5 or 10 mg early in the day, then i feel alot less anxiety the day after and i get alot more energy and i feel clarity, is this normal? Would i feel that way all the time if i quit?