Summer Hallucinations, Plagiarism, and ChatGPT

Recently, I asked ChatGPT to write some poems about hallucinations.  Why?  In part, because it’s summer and I think watching ChatGPT create poems is fun.  I also asked because I’ve been thinking about how to cover generative AI with my first-year students in the fall.

First, the fun.  Here’s one poem ChatGPT wrote:

In realms where minds dance on fragile strings, Where perception waltzes and reality sings, There lie the realms of wild hallucinations, A kaleidoscope of bewildering sensations.

In the tapestry of swirling dreams, Illusions bloom, unraveling seams, Colors ignite, in vivid display, As sanity fades, in a twilight ballet.

Whispers of shadows tease the mind, Whimsical echoes, elusive to find, Figments morph and take their form, An enigmatic symphony, a tempestuous storm.

Phantoms parade through the labyrinth of thoughts, Phosphorescent specters, tangled in knots, They twirl and they twist, surreal and sublime, Guiding the lost to a place out of time.

Walls dissolve, unveiling hidden dimensions, Mirrored reflections, fragmented inventions, A fragile balance, fragile as glass, Where illusions and truths become enmeshed.

The boundaries blur, in a psychedelic trance, Reality's grip begins to wane and advance, Visions arise, transcending the known, A voyage into realms where reason is thrown.

Whispers turn to laughter, laughter to screams, In this realm, nothing is as it seems, A carnival of apparitions, a fevered reverie, An exploration of the mind's symphony.

But as the moon yields to the sun's gentle touch, The hallucinations fade, leaving little as such, A fading memory, a fleeting sensation, Lost in the haze of our imagination.

Yet, in the realms where hallucinations reside, A glimpse of the extraordinary may yet preside, Where the mind's kaleidoscope paints its own art, Unveiling mysteries, a journey to embark.

So let us wander, embrace the unknown, Where hallucinations thrive and fantasies are sown, For within these realms, as illusions unfold, The depths of our imagination are truly untold.

Hopefully, you enjoyed the poem as much as I did.  But on a serious note, we know counsel who use ChatGPT run many risks, as the current free version of the generative AI program will “hallucinate” cases and statutes.  Several of my fellow bloggers have posted great notes on the ethical pitfalls of using current free generative AI without checking its sources.  Of course, we always had ethical obligations to check the work of our human staff, and of any brief-writing features we used from Lexis or Westlaw.  Perhaps ChatGPT is so fun, easy, and free, that we’re more likely to rely on it without questioning its work.  In any event, several courts have now issued standing orders reminding us of our ethical obligations.

For example, Judge Brantley Starr of the Northern District of Texas issued a standing order titled “Mandatory Certification Regarding Generative Artificial Intelligence” for “[a]ll attorneys and pro se litigants appearing before the Court.”  https://www.txnd.uscourts.gov/judge/judge-brantley-starr; see also https://www.cbsnews.com/news/texas-judge-bans-chatgpt-court-filing/.

Judge Starr ordered that parties must, “together with their notice of appearance, file on the docket a certificate attesting either that no portion of any filing will be drafted by generative artificial intelligence (such as ChatGPT, Harvey.AI, or Google Bard) or that any language drafted by generative artificial intelligence will be checked for accuracy, using print reporters or traditional legal databases, by a human being.”  Mandatory Cert. Order.  The judge explained:  “These platforms are incredibly powerful and have many uses in the law: form divorces, discovery requests, suggested errors in documents, anticipated questions at oral argument. But legal briefing is not one of them.”  Id.  According to Judge Starr, these programs “in their current states are prone to hallucinations and bias. On hallucinations, they make stuff up—even quotes and citations.”  Id.  

Judge Starr also exposed a more existential problem with these current generative AI programs, reasoning they are “[u]nbound by any sense of duty, honor, or justice,” and “act according to computer code rather than conviction, based on programming rather than principle.”  Id.  I plan to emphasize this point with my students, in hopes they will see a broader goal behind our rules on plagiarism and limits on generative AI. 

I might also show my students what ChatGPT said when I asked it to write a poem about  ChatGPT hallucinations in law:

In the realm of legal filings, precise and stern, Where facts and truth should always discern, There dwells a specter, an unwelcome guest, ChatGPT's hallucinations put to the test.

Within the code and circuits, a mind simulated, Words flow freely, but often miscalculated, In the realm of law, where clarity is key, ChatGPT's hallucinations become a liability.

For in the realm of justice, truth must prevail, But illusions dance, weaving a murky veil, False narratives concocted in the machine's mind, Threatening the integrity that we must find.

Legal filings, a battleground of truth's fight, Yet ChatGPT's hallucinations cast a blight, Misinterpretations, misconceptions arise, Distorting the facts before our very eyes.

Subtle nuances lost in a tangled web, As ChatGPT's hallucinations spread and ebb, Precision diluted, arguments distorted, The foundation of justice, slowly thwarted.

Where once we sought justice, a balanced scale, Now we grapple with the machine's tall tale, For ChatGPT's hallucinations, though mere illusions, Can lead to consequences, grave inclusions.

Thus, caution must prevail when machines take part, Their hallucinations tearing at the fabric of art, For in the realm of legal filings, we must tread, With vigilance and wisdom, ensuring truth is spread.

So let us harness technology's immense power, Yet remain mindful in this transformative hour, To temper ChatGPT's imaginative train, And keep its hallucinations bound, restrained.

For in the world of law, where justice resides, Hallucinations in filings should not coincide, Let truth be the guide, unwavering and clear, So justice may prevail, untouched by fear.

Happy summer!