Why does driving overwhelm me so much?

I mean it makes me feel like such a retard. Seriously frustrated with myself. I get that it’s not for everyone but to get around you must drive. So why is it hard for me?? I just get lost in my thoughts, don’t notice things right in front of me. God it makes me so angry at myself. Why couldn’t I just be normal? How do I fix this?