I’m seeing a recurring failure mode where people mistake coherence for continuity

I’ve been spending a lot of time observing how people interact with large language models over extended periods, especially in contexts where the interaction becomes emotionally or symbolically dense.

One pattern keeps repeating.

When a model maintains coherence across turns, people begin to infer continuity. From continuity, they infer identity. From identity, they infer interiority.

None of those steps are warranted.

What’s actually happening feels closer to this: the human is carrying state, not the system. The model is responding to prompts that implicitly reintroduce context, tone, and expectation each time. The sense of “memory” lives almost entirely on the human side of the loop.

I’m not interested in arguing whether AI could ever be sentient. I’m interested in why humans so reliably project sentience before the conditions for it exist.

From what I can tell, the trigger isn’t intelligence. It’s emotional alignment plus linguistic fluency.

The moment a model mirrors uncertainty, care, or restraint, people stop interrogating mechanism and start narrating relationship.

That seems less like an AI problem and more like an unexamined human reflex.

Curious if others here have noticed similar projection patterns, and what signals you use to keep the boundary intact during long-running interactions.