I struggle differentiating male actors faces

So, I was watching the Prestige and I swear the only way I could differentiate Borden and Angier was by their haircut. I also had a really hard time differentiating Merrit and John Cutter. And in Dead Poets Society I struggled a lot to tell apart each character because I felt like some of them looked the same. This only happens with male characters not female ones. I can differentiate them if they have like really unique characteristics or different haircuts but if not, it’s really hard. Do u have any tips?

Pd: excuse any grammatical mistake since English isn’t my first language