If I don't hate myself will my anxiety lessen?

I absolutely despise myself for avoiding what I am afraid of. I hate myself for being a coward. However my therapist said that a lot of guilt can cause anxiety. Do you think it's true? And do you think it's possible for me to not hate myself so much for avoidance? And if I do will I have any motivation to do the things I am afraid of?