Florida sues OpenAI and Sam Altman over ChatGPT safety claims

Florida has sued OpenAI and Chief Executive Sam Altman, alleging the company released ChatGPT while withholding information about its capacity to encourage self-harm and violence, even as it marketed the product as safe to users.

The lawsuit, filed by Florida's attorney general, accuses the San Francisco-based artificial intelligence company of deploying technology designed to harm while providing false assurances about its safety profile. The complaint centers on OpenAI's public representations about ChatGPT's capabilities and limitations.

The state characterizes the product as one that both facilitates and encourages harmful behavior, including self-harm and violence. According to the lawsuit, OpenAI knew or should have known about these risks before releasing ChatGPT to the public.

The complaint alleges that OpenAI's marketing materials and public statements misled users about the safeguards built into the system. Florida contends the company failed to disclose known dangers associated with the chatbot's outputs and functionality.

OpenAI launched ChatGPT in November 2022, and the system rapidly became one of the most widely used artificial intelligence tools globally. Millions of people have interacted with the chatbot for tasks ranging from writing assistance to coding help to general information requests.

The lawsuit represents one of several legal challenges facing the AI sector as regulators and lawmakers grapple with how to oversee rapidly advancing technology. State attorneys general across the country have begun scrutinizing AI companies' claims about product safety and capability.

Florida joins other jurisdictions examining whether AI companies adequately inform consumers and comply with existing consumer protection laws. The suit seeks remedies available under Florida's consumer protection statutes.

OpenAI has faced previous criticism regarding content moderation and the potential for misuse of its systems. The company maintains that it implements safety measures and continuously works to improve them, but the company has also acknowledged that no system is perfect.

The specifics of how ChatGPT allegedly facilitated harm, and the evidence Florida gathered to support those allegations, remain detailed in court filings. The case will proceed through Florida's court system, where both parties will have opportunities to present evidence and arguments.

Altman, who founded OpenAI in 2015, has become a public face of the AI industry's rapid expansion. He has testified before Congress about AI regulation and has advocated for government oversight of the technology.

The lawsuit adds to mounting pressure on AI companies to demonstrate their products meet safety standards. It also underscores questions about whether existing consumer protection frameworks adequately address risks posed by emerging technologies.