Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Texas judge bans filings solely created by AI after ChatGPT made up cases
CBS News ^ | JUNE 2, 2023 | MEGAN CERULLO

Posted on 06/02/2023 2:39:52 PM PDT by nickcarraway

A Texas judge has ordered attorneys to attest that they will not use ChatGPT or other generative artificial intelligence technology to write legal briefs because the AI tool can invent facts.

U.S. District Judge Brantley Starr of the Northern District of Texas is specifically requiring that attorneys file a certificate to indicate either that no portion of any document they file was generated by an AI tool like ChatGPT, or that a human being has checked any AI-generated text.

The new requirement comes after a lawyer representing a man suing an airline used ChatGPT to prepare a legal brief, which was discovered to be laden with errors, including made-up court cases.

The judge acknowledged that AI does have a place in the profession, but that it is limited in its capabilities. It can be relied on to generate standard legal documents, for example.

"These platforms are incredibly powerful and have many uses in the law: form divorces, discovery requests, suggested errors in documents, anticipated questions at oral argument. But legal briefing is not one of them," Judge Starr wrote in his ban.

He laid out his reasoning for banning court filings generated solely by AI, noting that generative AI has a tendency to hallucinate— or portraying fabricated responses as "facts" — and can be unreliable.

AI could pose "risk of extinction" akin to nuclear war and pandemics, experts say "The ChatGPT Revolution" explored in new CBS News documentary A lawyer used ChatGPT to prepare a court filing. It went horribly awry. "These platforms in their current states are prone to hallucinations and bias. On hallucinations, they make stuff up — even quotes and citations," Judget Starr wrote. "Another issue is reliability or bias. While attorneys swear an oath to set aside their personal prejudices, biases, and beliefs to faithfully uphold the law and represent their clients, generative artificial intelligence is the product of programming devised by humans who did not have to swear such an oath."

Unlike attorneys who have sworn to faithfully uphold the law on behalf of their clients, AI tools are "unbound by any sense of duty, honor, or justice," he added.

The court will not accept any filings that are not accompanied by the sworn attestation.


TOPICS: Culture/Society; News/Current Events; Politics/Elections; US: Texas
KEYWORDS:

1 posted on 06/02/2023 2:39:52 PM PDT by nickcarraway
[ Post Reply | Private Reply | View Replies]

To: nickcarraway

Lefties invent facts all the time.


2 posted on 06/02/2023 2:41:48 PM PDT by HYPOCRACY (This is the dystopian future we've been waiting for!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: HYPOCRACY

Yep, just look at all the made up charges against Donald Trump.


3 posted on 06/02/2023 2:58:15 PM PDT by minnesota_bound (Need more money to buy everything now)
[ Post Reply | Private Reply | To 2 | View Replies]

To: nickcarraway

That attorney needs to lose their law license.


4 posted on 06/02/2023 2:58:33 PM PDT by ConservativeMind (Trump: Befuddling Democrats, Republicans, and the Media for the benefit of the US and all mankind.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: HYPOCRACY
This will be one of the very real problems with AI going forward.
The bias of the “teachers” can't be eliminated.
Can you imagine a super intellect in charge of anything ..with left wing bias...
They call it “hallucinating” ... we called it telling a LIE.
5 posted on 06/02/2023 2:58:42 PM PDT by 1of10 (be vigilant , be strong, be safe, be 1 of 10 .)
[ Post Reply | Private Reply | To 2 | View Replies]

To: nickcarraway

Pandora’s Box has been opened, and it’s unlikely to be closed anytime soon.


6 posted on 06/02/2023 3:03:01 PM PDT by telescope115 (I NEED MY SPACE!!! 🔭)
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway
AI tools are "unbound by any sense of duty, honor, or justice," he added.

They are sociopaths by nature.

7 posted on 06/02/2023 3:15:20 PM PDT by P-Marlowe (I got the <ΙΧΘΥΣ>< variant. Catch it. John 3:16)
[ Post Reply | Private Reply | To 1 | View Replies]

To: telescope115

We’ve only cracked the seal...


8 posted on 06/02/2023 3:17:11 PM PDT by fuzzylogic (welfare state = sharing of poor moral choices among everybody)
[ Post Reply | Private Reply | To 6 | View Replies]

To: nickcarraway

I am acquainted with a senior academic in a STEM field, a guy who has rotated through the top faculty posts in a major research university, has served for years on NIH panels, is an officer of national and international professional societies, etc. None of the above is political. He was experimenting with ChatGPT just to test capabilities. He presented it with a series of increasingly challenging tasks, which it performed well, producing learned papers in highly arcane fields and doing so in minutes.

In one of these exercises, he outlined a very specific, cutting edge scientific question in a field that is so arcane that I’m not sure it has been invented yet. (I exaggerate only slightly.) He asked for 20 sources. He had a very polished report in a couple of minutes with citations from the top peer reviewed journals in the field.

He checked the citations. 19 of the citations checked out. ChatGPT made up the 20th. Apparently it had searched every database in the cloud and pulled from every elite journal in the world, and there were only 19 relevant sources. But 20 sources had been specified. ChatGPT met the requirement by making up the final reference.


9 posted on 06/02/2023 3:56:21 PM PDT by sphinx
[ Post Reply | Private Reply | To 1 | View Replies]

To: sphinx
My academic friend (and all his faculty colleagues) already sensed that we have a serious problem on our hands. But making up citations is orders of magnitude worse. ChatGPT is in its infancy and it is already capable of self-generated fraud.
10 posted on 06/02/2023 3:58:34 PM PDT by sphinx
[ Post Reply | Private Reply | To 9 | View Replies]

To: sphinx

It’s a lack of understanding. The AI doesn’t think, it just goes by what it’s “learned.” So if you ask it a question, it just goes by what it sees. It will make up a citation, based on other citations it’s seen.


11 posted on 06/02/2023 4:00:48 PM PDT by nickcarraway
[ Post Reply | Private Reply | To 10 | View Replies]

To: telescope115
Pandora’s Box has been opened, and it’s unlikely to be closed anytime soon.

Too late it's in the internet of things, "it" made itself indestructible with shadow reproductions and block chaining, always checking the copies and refreshing the "borg" with the latest upgrade. It's about to be over. Really, really over in a split second world-wide strike. Not Hollywood anymore.

12 posted on 06/02/2023 4:03:17 PM PDT by USCG SimTech
[ Post Reply | Private Reply | To 6 | View Replies]

To: sphinx

That’s interesting since a few months ago when ChatGPT became accessible to the populace, the company stated it didn’t have current access to the web. Had been off it for ~2 yrs. Woder if they’ve changed their mind about giving it access, or it just escaped...


13 posted on 06/02/2023 8:48:38 PM PDT by curious7
[ Post Reply | Private Reply | To 9 | View Replies]

To: curious7

My friend was using a university-licensed system. I didn’t ask for details about breadth of access, but it clearly had broad access to research sources including academic journals. I don’t know if any parts of the web were fenced off. It is evolving very fast.


14 posted on 06/03/2023 1:51:17 AM PDT by sphinx
[ Post Reply | Private Reply | To 13 | View Replies]

To: USCG SimTech

So we have the beginnings of “Skynet”.


15 posted on 06/03/2023 3:13:52 AM PDT by telescope115 (I NEED MY SPACE!!! 🔭)
[ Post Reply | Private Reply | To 12 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson