Home / Crime and Justice / AI Hallucinations Land Lawyers in Legal Trouble
AI Hallucinations Land Lawyers in Legal Trouble
11 Jun
Summary
- Lawyers faced discipline for using AI that hallucinated cases.
- A federal judge sanctioned four attorneys for unverified AI filings.
- New York now has rules for AI in legal proceedings.

Legal professionals are increasingly using AI for their work, but doing so carries significant risks. Recently, in a Mississippi federal court case, lawyers on both sides of a dispute over solar project fees faced disciplinary action. The issue stemmed from their use of AI software that produced fabricated legal cases or cited non-existent laws in their filings.
US District Judge Sharion Aycock sanctioned four attorneys involved in the Withers v. City of Aberdeen case. She found that all four had failed to verify the legal authorities cited in their filings, a violation of Rule 11. The judge noted their "blindly relying on technology" led to these errors.
This incident serves as a stark warning for the legal profession. Following this case, New York has adopted new rules concerning generative AI, clarifying that results from tools like ChatGPT are not protected by attorney-client privilege as of June 1. The American Bar Association is also addressing these challenges, offering guidance and resources to its members on navigating AI ethically and effectively.