California Proposes Ban on AI Chatbots Acting as Mental Health Therapists

California is considering new legislation that would strictly regulate or block the use of artificial intelligence chatbots in mental health treatment. The proposed measure aims to ensure that critical psychological care remains the domain of licensed human professionals rather than autonomous software systems.

Senate Bill 903, authored by Sen. Steve Padilla, would specifically ban companies from advertising AI chatbots as a form of therapy. Under the proposed law, AI systems would be prohibited from making therapeutic decisions unless those decisions are reviewed by a licensed professional. The legislation is a direct response to growing concerns regarding the safety and efficacy of AI-driven tools, particularly their inability to reliably identify or manage crisis situations such as suicidal ideation.

Legal and Safety Context

The push for this legislation follows a series of high-profile wrongful death lawsuits filed in California federal courts. These legal actions allege that AI chatbots contributed to user suicides, raising urgent questions about the risks of deploying autonomous agents in clinical settings. These cases have fueled a broader debate over the "therapeutic alliance"—the unique bond between patient and clinician—and whether AI can safely replicate the empathy and crisis-intervention capabilities required for mental health care.

Industry Implications

If passed, SB 903 could set a significant legal precedent across the United States, potentially limiting how AI-driven mental health tools are deployed and marketed. By reinforcing the requirement for human oversight in clinical psychology, the bill highlights the intensifying tension between the scalability of AI healthcare and the necessity of professional accountability. For the tech industry, this represents a shift toward a more restrictive regulatory environment where the efficiency of automation is secondary to patient safety.

What's Next

Legislators and health advocates will now monitor the progress of SB 903 as it moves through the California state government. The outcome will likely determine whether AI continues to be positioned as a replacement for therapy or is relegated to a supportive, non-diagnostic tool. Observers are watching to see if other states follow California's lead in establishing strict boundaries between algorithmic assistance and licensed medical practice.