RLS many-to-many?

I have two tables.

Table1 is a fact table and contains the column Department.

Table2 is a dimension and contains the e-mailadress and Department.

Everyone should be able to see their own department, but multiple people can have the same department.
Can someone explain what I should do for setting up RLS?
I tried to use a bridge table but I still see everything when I view it as a user