Anthropic Bans 'Abusive or Cruel Behavior' Toward AI Claude

AI firm Anthropic has updated its usage policy for the first time in over a year, addressing new high-risk misuse cases. These include applications related to election interference, weapons development, surveillance, and health and financial sectors.

A significant addition to the policy prohibits "sustained and needless abusive or cruel behavior" directed toward its AI model, Claude. This expands on a policy introduced last August, which allowed Claude to terminate conversations with "persistently harmful or abusive" users as part of research into "model welfare."

Anthropic stated that terminating conversations remains the primary enforcement mechanism. The company did not provide further comment on how the new rules will be monitored or the specific consequences for violations.

The policy updates aim to address the rapidly evolving landscape of AI capabilities and ensure responsible deployment. Preventing misuse is a critical challenge as AI technology becomes more integrated into various industries globally.