I've never understood if someone who works in a different department at a company can get you fired. Can they?

Basically, there's one guy where I work who I feel like hates me. I really don't get it either. I really don't feel like I'm doing anything. I feel like I help him. I wluld prefer for us to help each other and work together well.

I mean, maybe an incredibly dumb thing to say but he's a manager and see's me talking to his direct reports who are women sometimes. Maybe he thinks I'm acting flirty with them and gets jealous. He's sort of an odd guy to me.