How to stop feeling guilty for needing ‘me time’ in a relationship?

Sometimes I just want to be alone, but I worry it makes my partner feel rejected. Is wanting personal space selfish? How can I balance self-care and togetherness?