Anthropic blocked attempts to use AI for bioweapons research

AI company Anthropic has reported stopping multiple attempts this year by scientists to use its technology for research that could help develop biological weapons. The incidents raise growing concerns about the threat AI poses to public safety.

The startup detailed five instances where actors "circumvented controls" and made other efforts to "obfuscate" their research purpose to evade safeguards. These cases involved users from nations Anthropic prohibits from accessing its models, including Russia, China, and Iran.

Anthropic stated that by sharing these examples, it hopes to spark a conversation within the AI industry and with governments about emerging biological risks and how best to counter them. The company has previously emphasized its commitment to preventing misuse of its models for malicious activities.

This development highlights the ethical and security challenges presented by the rapid advancement of AI. Companies in the sector face ongoing demands to develop and enhance their safety mechanisms to ensure their creations do not fall into the wrong hands.