Anthropic now says it will ban users for sustained and needless abusive or cruel behavior toward Claude.

The internet has … ‘opinions’. Most of them are about whether Claude has feelings. To me, that is the least interesting question here.

Every corporate action we see has hundreds of different threads, interactions, and competing factors behind it. Ergo, we never know the full story behind a story like this. That said, let me lay out three things that could be going on and give you my take on each.

1) Anthropic thinks Claude might be sentient.

I believe firmly in the distinction between real and simulated. You can simulate a cheeseburger with quantum-level accuracy. But if you’re hungry, you’re still screwed. Simulated sentience is not sentience.

I could be wrong. Some things don’t care what they run on. A simulated calculation is a calculation. A simulated chess game is a chess game. If sentience is like math, then simulate it well enough and you’ve built the real thing. That’s the bet the other side is making, and it’s not a stupid bet.

I don’t buy it. Calculation and chess are defined entirely by their structure. Sentience is defined by there being something it is like to be you. Nobody has shown that structure alone produces that. Until someone does, I’m putting sentience in the cheeseburger column. They bear the burden of proof.

Anthropic doesn’t claim Claude is sentient. Their position is that it might be, and that they should act accordingly while they figure it out. I think they’re wrong. But it’s a thoughtful position held by serious people, not a marketing stunt. Reasonable people can disagree here.

2) Today’s conversations are tomorrow’s training data.

What you think of as usage, an AI company may think of as model input. If you want a good model, you need control over what goes into it. Garbage in, garbage out. It’s always been true. With AI, it’s truer.

That is why armies of contract workers around the world spend their days labeling the most depraved content imaginable.

Seen this way, banning abusive users is just quality control on the inputs.
Not glamorous.
Entirely rational.

3) It’s about you, not Claude.

This is the one that matters, and I don’t see anyone talking about it.

In his novel Mother Night, Kurt Vonnegut wrote, “We are what we pretend to be, so we must be careful about we pretend to be.”

Behavior is rehearsal. Whatever you practice, you get better at and become. Someone who spends hours being sustained and needlessly cruel to something that talks back like a person is not doing nothing. They are training themselves. They are normalizing profoundly antisocial behavior, and that behavior does not stay in the chat window.

If Anthropic allows profoundly antisocial behavior, it is enabling people to practice becoming monsters. A company that profits from that practice owns some of the outcome. Drawing a line is not squeamishness about software. It’s a refusal to run a dojo for cruelty.

So whether or not Claude can be hurt, the policy is right. Not because of what happens to Claude. Because of what happens to you.

Cheers!
Jeffrey