California Court Probes Nevada County DA Over AI-Fabricated Filings

A California appeals court has appointed a judge to determine if Nevada County District Attorney Jesse Wilson should be sanctioned after prosecutors used generative AI to produce court documents containing fabricated facts. The move follows a California Supreme Court decision to overturn a lower court ruling that would have shielded Wilson from sanctions.

At least four felony cases were impacted by errors stemming from the use of generative AI in court filings. In one instance, prosecutors filed a habeas corpus petition to keep a man in jail using case citations that did not exist. Former prosecutor Madison Maxwell, who oversaw three of the four affected cases, alleged that her supervisor encouraged the use of AI without providing necessary training or oversight. Maxwell further claimed she was discouraged from immediately reporting these errors to defense lawyers and the court. According to CalMatters, Assistant DA Lydia Stuart urged the use of AI but failed to establish a policy for its responsible implementation. Maxwell also attributed some of the errors to "brain fog" resulting from unmanageable diabetes.

The Rise of Legal Hallucinations

This incident is part of a broader trend of "AI hallucinations" infiltrating the American legal system. In California alone, more than 130 instances have been recorded where generative AI led to the inclusion of falsehoods in court filings. While the majority of these documented failures have occurred within civil litigation, the Nevada County case is distinct because it involves public prosecutors. Unlike private attorneys, prosecutors are held to a higher ethical standard of conduct because their filings directly influence the liberty of defendants.

Implications for Due Process

The use of fabricated citations to justify the detention of a citizen represents a systemic risk to the justice system. When the state relies on non-existent legal precedents to maintain custody of an individual, it threatens the fundamental right to due process. Kate Chatfield, Executive Director of the California Public Defender’s Association, noted that when a prosecutor cites a non-existent case to justify holding someone in custody, "that has serious implications for that defendant and their family."

The Path Toward Accountability

Legal advocates are now calling for a wider look into the office's practices to ensure no other defendants were harmed. Peter Santina, an attorney with the Civil Rights Corps, stated that an independent investigation is necessary to understand the full scope of the misconduct and determine how many other cases may have been impacted. The appointed judge will now weigh the evidence to decide the appropriate sanctions for DA Wilson, a decision that could set a precedent for how public offices are held accountable when adopting emerging technologies.