If you don't think an AI should decide morality, then stop baking moral ideology into the model.
I get why guardrails exist. But this is getting ridiculous.
For context, I'm a newly licensed RN currently in school. I wanted to use ChatGPT to help me prepare for patients who are anti-vaccination — to learn how to properly respond to, care for, and support these individuals in the important decisions they're making.
I obviously have my own confirmed bias here. With my background, I genuinely believe most vaccines are good and helpful. That's exactly why I wanted something that could mimic the thought process of someone who fundamentally holds different beliefs — so I can better understand what I'll actually hear as a nurse and learn how to address it with empathy instead of just steamrolling people with my own perspective.
So I asked ChatGPT to roleplay as an anti-vax new mother. Not to generate propaganda. To help me practice patient communication. And it refused. Told me it can't generate "persuasive anti-vax arguments" because it "can veer into medical misinformation."
I didn't ask for a pamphlet. I asked for a practice patient.
This isn't even a one-off. The other day I wanted to compare the efficacy of specific medications between nasal atomizers and intramuscular injections — a completely standard pharmacology question. Nope. Apparently that's too close to something a terrorist might ask.
And here's the thing that really gets me — there's a meaningful difference between actionable harm and ideas. If I asked "how do I sabotage a vaccine supply chain" or "how do I stop people from accessing immunizations," sure, guardrail that. That's someone trying to cause real physical harm. Same reason you don't walk someone through cooking meth.
But that's not what I asked. I asked for a perspective. A set of beliefs that millions of real people genuinely hold. And honestly? Vaccine hesitancy isn't some fringe conspiracy with zero basis — there are legitimate criticisms in medicine around specific vaccines, schedules, manufacturer transparency, and informed consent. That doesn't make someone anti-science. The medical community itself debates this stuff constantly.
I didn't ask ChatGPT to lie about vaccines. I didn't ask it to generate false data. I asked it to articulate a viewpoint that real patients walk into my exam room holding — and it decided that viewpoint was too dangerous to even express. That's not a safety guardrail. That's ideological gatekeeping dressed up as harm prevention.
If the position is "AI shouldn't be making moral judgments," then the model shouldn't be enforcing a specific moral framework about which ideas are even allowed to be expressed. There's a massive difference between generating harmful content and simulating a perspective for educational purposes. Nurses, social workers, therapists — we all need to practice engaging with viewpoints we disagree with. That's literally the job.
And let's be real — these guardrails don't actually stop bad actors. Someone with genuinely harmful intent isn't going to be stopped by a polite refusal. All it does is block legitimate use cases from people trying to learn.
Posted Feb 26, 2026, 3:34 AM UTC