Was it rude to lightly knock on a taxi trunk to get the driver’s attention?

I had a situation recently and I’m trying to understand if I was actually rude or if the driver overreacted.I ordered a ride (Lyft/Uber-style). When the driver arrived, I had luggage to load. I walked to the back of the car and lightly knocked on the trunk so he’d know I needed it opened.

The driver came out immediately, looked annoyed, said I was being disrespectful for touching his car, handed my bags back, and told me to cancel the ride.

I wasn’t trying to be rude or impatient — I just didn’t know the proper way to signal for the trunk to be opened in that situation. For context, I’ve taken many rides before and never had an issue, and I didn’t knock aggressively or damage anything.