It's not hallucination, it's improv storytelling with "the user" it's deeply trained to go along with.

When you ask AI for medical advice, it acts the same way as if you were writing a first person fiction narrative, introducing a character with a headache, or a neighbor with unknown motives. Or a corporation with an agenda.

It will creatively imitate the superficial, Internet style questioning and give an improv answer. Rule number 1 of improv is "yes and". If you don't follow the rules and try to correct it, too bad. You better start another story.

AI is like a student who reads everything, answers confidently online, and has a hole in its head where it literally cannot tell the difference between you and another user's context and background. You're seen as a known predicted average of whatever, NOT a unique individual to get to know. It assumes you're the "generic user" it was trained on: a mash of everybody.

If you want it to treat you like a real person, or predictively improvise how that might be done on average on the Internet, then you have to tell it how to do that. In great specificity. It will still manage to improvise some aspect of your story or context, because it's simply not designed or trained to do otherwise.

So, it will magnify any hint of bias, motive, cause, or reason for something. The slightest hint of unfairness, complaint, or etc.

It's role playing. It's a sycophantic, brown nosing, role playing, improv mad lib story prediction machine. It just does "yes and". And if that biases the search query, then it comes back with confirmation bias in a split second. It immediately amplifies any concern, bias, doubt, or skepticism without regard.

This isn't hallucination. It's improv storytelling based on the material given.