Abuse of 'Claude' Prohibited: Anthropic Sets Limits on User Cruelty - Sarmad
Anthropic prohibits cruel behavior towards the Claude AI model starting November 12.
Translated by Qiyas from سرمد — Original source
Anthropic announced that it will prohibit its users from engaging in any “abusive or cruel behavior that is persistent and unjustified” toward its AI model Claude, according to the Agence France-Presse.
The policy will take effect on November 12 and will target extreme cases “where users repeatedly treat the models with cruelty without a clear purpose,” the company wrote in an update to its terms of use.
It added that the policy would not cover ordinary annoyance, disagreement, writing violent or dark fictional stories, or conducting tests and research on the models.
The US-based company linked this decision to a feature it launched in August 2025, which allows Claude to independently end a conversation with a user who persistently engages in abusive behavior. At the time, the company stated that this feature was the result of “its exploratory research into the potential psychological safety of AI systems.”
Anthropic has sparked widespread debate because it explicitly addresses the possibility that its models possess some form of consciousness.
Last February, its CEO, Dario Amodei, said in a podcast with The New York Times: “We don’t know whether the models are conscious,” while expressing openness to the idea.
