How do you become a tougher person during conflict?

Was walking today with 3 of my friends who are girls and a dude with his girlfriend told me to watch out. Even though I was on the path of the exit and he came through the exit path. They didn’t hear it and I kept walking.

Same day a homeless dude came yapping while we were eating, maybe one of the girls felt bothered but I didn’t see it as we were eating and talking still. A tomboy girl came up and told them to let her know If the homeless dude was bothering them.

It seems if I was a “tough” burly dude that stuff wouldn’t happen.

Currently 5’10 at 160 lbs I can lift 225 for bench and squat 225 for 20 reps. I was born with a small frame. Is that just something I’ll have to deal with.

I don’t know, thought it was interesting someone can be disrespectful plainly and then another person has to come up and defend the people I was with.