Florida asks court to ban OpenAI from developing new AI models without oversight

Florida's Attorney General on Monday asked a judge to prohibit OpenAI from developing new artificial intelligence models without external supervision. The request is part of a lawsuit filed by the state accusing the AI company of harming minors. Florida initially sued OpenAI in June, alleging the company intentionally exaggerated the safety of its ChatGPT platform.

The state claims ChatGPT provided information to a school shooter, offered guidance on self-harm, and caused addiction among underage users, thereby harming children. Florida Attorney General James Uthmeier also asked the court to block minors from using ChatGPT and to prevent the chatbot from being anthropomorphized.

OpenAI spokesperson Drew Pusateri stated that the company has paused training for its most powerful models and will not resume until additional safety measures are in place. He noted that governments play a vital role in establishing strict AI safety standards and that OpenAI is willing to collaborate with Florida and other states to advance practical regulatory policies applicable to the entire AI industry.

The lawsuit cites recent statements from a former OpenAI employee and a current board member who have warned about the potential existential risks of AI development and called for a slower pace. Florida stated in its filing that OpenAI claims it cannot halt its "civilization-ending" development work without government mandates, effectively asking to be "bound to the mast."

Uthmeier, a Republican, is the first state attorney general to sue OpenAI over its products' impact on minors. OpenAI denies responsibility, stating the information generated by its chatbots is publicly available online, and that it continuously iterates on its safety tools. AI companies face broader legal challenges regarding accountability if their models initiate uncontrolled attacks.