AITAH for knocking down my wall in the front garden and creating even less parking on our street?

I live on a pretty tight narrow little street, not much road parking, if any tbh! Folk are very lucky if they can find a parking space on the road I live on. My next-door neighbour has an open driveway. Then there's a wall at the front (owned by me, not him, it isnt a shared wall), then our smaller entrance driveway. His girlfriend comes over every day and parks in front of that wall, which, I mean, she can. She's not over our drive.

Anyway, I passed my drivers test recently, and want to get my own car, I'm using my partners at the moment, but want my own, and i want to be able to put it on the drive. And figured if we knock that wall down, ill be able to, as it'll make our driveway bigger. So that's what we've done. Today, me and my dad were out front, knocking down the wall, and my neighbour comes outside looking all confused and asks what I'm doing. So I tell him my plans and he says his girlfriend now has nowhere to park. I asked why she can't park over his drive, he said when they go out they use his car, so it would be a pain in the ass.

I told him I was sorry, but this was my wall and this is what i want to do. He then basically reprimanded me and kicked off at me for "removing one of the very few parking spaces on our road, like our road wasn't shit enough for parking." I again told him that I was sorry, but that wasn't my problem.

AITAH?