Why do some people say Tyler isn't real ?

As far as I understood, Tyler and the Narrator are in the same body, sometimes Tyler controls it and sometimes the Narrator does, so both exist, the only thing that isn't real is when they hallucinate one another or Tyler's physical appearance. So, unless I'm wrong I don't understand why people say that