T
25

AI writing tool generated a fake court case citation in my legal brief

Spent 2 hours fact checking a contract summary ChatGPT made for work last Tuesday and found a quoted Supreme Court case that literally never existed, has anyone else caught hallucinations in their own legal or medical documents?
2 comments

Log in to join the discussion

Log In
2 Comments
lee.lucas
lee.lucas1mo ago
Yeah that's a known issue with these tools, they're not actually trained to know what's real so they just make up citations that sound convincing. The 2nd Circuit actually put out a warning last year about fake cases showing up in filings.
7
lilyo30
lilyo301mo ago
Yeah I just started asking it for the actual URLs after getting burned twice, and it forced me to actually read through the cases myself instead of trusting the bot. Has anyone else found that simple trick actually saves more time in the long run?
8