Traveling as a "sketchy" guy

Hi solo travelers, I usually travel with my girlfriend. On my next trip, I will be going alone as she wants a break from traveling. The thing is that I am worried about traveling as a solo male. People are usually pretty nice to me when I'm traveling with my girlfriend, but I notice an attitude shift when I'm alone.

I feel as if people are cautious around me and I've even been called sketchy on a trip to Portland. My girlfriend was grabbing some stuff from our hotel room while I waited downstairs. I overheard a family checking in and the clerk asked the family if I was with them to which he replied "no he's sketchy". This hurt my feelings because I feel like I'm a soft spoken goofy guy. I don't know if it's my ethnicity (hispanic) or my bigger stature, but I am now hyper aware of how I come off when I'm alone.

In another instance, on our last trip to Budapest, I took a walk while my girlfriend slept. I felt a shift in energy with people walking further away from me. I was even offered drugs and club invitations which I did not receive when I was with her.

I want to travel to another European country this year, but, especially with anti-immigrant sentiment, I don't want to feel like people are threatened or hostile towards me.

Has anyone felt this way?