Those who wear retainers, do you wear it for life?

If I stop wearing it for 2 consecutive days, I feel like my teeth are shifting and find it difficult to articulate properly. Or could it be psychological effect?