I just realised, ChatGPT and all the other AI language models are like the Demons from this anime.

I don't claim to be a huge fan of this show, nor am I particularly interested in the usual swill that is your average anime. But something convinced me to give the anime a chance and I'm glad I did.

One of the core elements that I appreciate about this setting is the unambiguous way Demons are portrayed. They are without exception all dangerous. A predator designed to prey on humans, exploiting our empathy and kindness. They mimic us without understanding what makes humans human. A Demon might smile and make small talk, not because they like spending time with others, but because it saw that this is something that people do. It would say bless you when someone sneezed, not because it understood what courtesy is, but rather because that is what it does. They use that to get us to lower our guard. Once the opportunity presents itself they will inevitably strike us down in cold blood and feel nothing. Demons are Social Mimics who prey on humans.

AI Language models can hold great philosophical discussions. They can comfort you. You can have entire discussions with the newest iteration that feel genuine. But it's all hollow. They are just responding like this because they saw that that is how humans expect to be responded to. There is no understanding, no deeper comprehension because fundamentally, AIs are not genuine living beings capable of understanding humanity, only mimicking it. I suppose we should be grateful that AI hasn't decided to make it it's life mission to kill all humans.

Idk, just a thought that occurred to me. What do you think?