White people not accepted in some temple ?

Hi, so I'm not one to usually complain but today I was walking up the namsan forest trail up to the namsan tower. On this road is a Chinese temple so my brother and I wanted to look at it. (For info we're french and look quite french)

He entered first (so the lady only saw him) and directly said "no entry no entry" so obviously we left but then like 10 sec after (we stayed to see it) this Asian women entered and the lady didn't say anything at all....

We didn't complain cause we're not people that like to make a lot of noise but I just wanted to understand if it's like common here for Koreans to sometimes not accept white looking people?

(Thanks, and don't worry so far all Koreans have been really nice and helpful 👍)