Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

As ChatGPT-4 aces SAT and bar exam, some call for tech to be reined in
The College Fix ^ | MAY 4, 2023 | ANNA LOFGREN

Posted on 05/04/2023 7:21:52 AM PDT by grimalkin

Elon Musk, among others, called for a six-month pause on all AI system advances more powerful than ChatGPT-4

Top scientists and tech experts are calling on the federal government to restrain ChatGPT following the development of its new version, ChatGPT-4, which achieves top scores on common standardized tests.

ChatGPT-4, the new model released in March, can score in the 93rd percentile in SAT reading, 89th percentile in SAT math, and can achieve the highest score on multiple AP subject exams, according to OpenAI’s website.

The software also passed a simulated bar exam with a score around the top 10 percent of test takers and “is more reliable, creative, and able to handle much more nuanced instructions than GPT-3.5,” according to the site. Elected officials as well as tech leaders have taken note.

“President Joe Biden’s administration wants stronger measures to test the safety of artificial intelligence tools such as ChatGPT before they are publicly released, though it hasn’t decided if the government will have a role in doing the vetting,” U.S. News reported last month.

The U.S. Commerce Department “will spend the next 60 days fielding opinions on the possibility of AI audits, risk assessments and other measures that could ease consumer concerns about these new systems,” it stated April 11, according to the news outlet.

In response to the release of GPT-4, the tech ethics group Center for Artificial Intelligence and Digital Policy filed a March 30 complaint to the U.S. Federal Trade Commission, calling on the agency to “to open an investigation into OpenAI, enjoin further commercial releases of GPT-4, and ensure the establishment of necessary guardrails to protect consumers, businesses, and the commercial marketplace.”

Chat GPT-4 “is biased, deceptive, and a risk to privacy and public safety,” according to the complaint.

Elon Musk, Apple co-founder Steve Wozniak, and other scientists and technology leaders also signed an open letter March 22 to push for a halt to AI system advances more powerful than GPT-4 for at least six months in order to better understand the risks.

“AI systems with human-competitive intelligence can pose profound risks to society and humanity,” the letter stated. “This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.”

‘The genie’s out of the bottle and we can’t put it back,’ professor told The College Fix. “Asking about the implications of ChatGPT and similar A.I. technology is like asking someone in 1993 about the implications of the Internet.” Furman University philosophy Professor Darren Hick told The College Fix in an email. “I couldn’t pretend to know what roles A.I. will play in our lives in, say, 30 years, but it’s going to be big. The genie’s out of the bottle and we can’t put it back.”

In 2022, Hick (pictured) caught a college student using ChatGPT-3 on a written assignment, according to The New York Post.

“There’s particular odd wording used that was not wrong, just peculiar,” Hick told The Post, describing why he flagged the paper. “If you were teaching somebody how to write an essay, this is how you tell them to write it before they figure out their own style.”

However, “despite having a background in the ethics of copyright law, Hick said proving that the paper was concocted by ChatGPT was nearly impossible,” according to The Post.

Hick only confirmed the offending student had used the software by confronting him directly, The Post stated. The student failed the course.

“I would say [ChatGPT] writes like a very smart 12th-grader,” Hick told The Post.

Morten Christiansen, a professor of psychology at Cornell who has weighed in on the software, also spoke with The Fix on its dangers.

“It’s possible that ChatGPT (or its successors) with more training and human feedback will be less likely to hallucinate, and if so, they may perform on a par with people,” Christiansen said.

A “hallucination” in AI technology refers to semantic or syntactic responses that seem reasonable, but are actually inaccurate, nonsensical, or incorrect, according to Christiansen.

Robert Seamans, associate professor and director of the center of the future of management at NYU, told The Fix in an email that while he does not deem it necessary to halt the development of AI systems like ChatGPT, he would like to see conversations on institutions or systems we might “have in place to help guard against any downside from AI.”

Seamans also said more conversations should be had on whether AI benchmarks focus on the right things, and that there may be too much focus on questions like, “can AI do this task better than a human, or not?”

While ChatGPT has been banned in some schools, others have embraced the shift. One professor at the University of Pennsylvania’s Wharton School requires students to utilize AI in his courses on entrepreneurship and innovation, NPR reported.

A 2023 survey by Impact Research and commissioned by The Walton Family Foundation found that 40 percent of teachers use ChatGPT for their job weekly, and 10 percent of teachers use the service daily.

The survey also found that of those who have used ChatGPT, 88 percent of teachers and 79 percent of students said it had a positive impact.

The majority of teachers and students agreed with the statement, “ChatGPT is just another example of why we can’t keep doing things the old way for schools in the modern world.


TOPICS: Culture/Society; News/Current Events
KEYWORDS: ai; chatgpt
I understand the concerns about AI. However, I do not want the government involved in managing this technology. Thoughts?
1 posted on 05/04/2023 7:21:52 AM PDT by grimalkin
[ Post Reply | Private Reply | View Replies]

To: grimalkin
And then there's this ... Student uses Chat GPT to write paper, gets a zero: ‘What ever happened to paraphrasing bro’
2 posted on 05/04/2023 7:25:33 AM PDT by al_c (Democrats: Party over Common Sense)
[ Post Reply | Private Reply | To 1 | View Replies]

To: grimalkin

I do not think “government” could “manage” it.


3 posted on 05/04/2023 7:26:39 AM PDT by goodnesswins ( We pretend to vote and they pretend to count the votes.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: grimalkin

The only grades that should be taken are for work done in a proctored way, such as being in school with a teacher, for a test.

Also, all prior quizzes and tests by a teacher should be provided to students, because some are already cheating from those prior works.

Even the playing scale and see what people can do, in person, only.

This online stuff is crazy. No, you can’t have a legitimate outcome if people are able to get answers at home.


4 posted on 05/04/2023 7:41:11 AM PDT by ConservativeMind (Trump: Befuddling Democrats, Republicans, and the Media for the benefit of the US and all mankind.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: grimalkin

Pass the bar? The pulse lawyers will sue!!!


5 posted on 05/04/2023 7:59:18 AM PDT by null and void (Attention! Non-compliant Resident Alert! Attention! Non-compliant Resident Alert! Attention! Non-com)
[ Post Reply | Private Reply | To 1 | View Replies]

To: grimalkin

Hardly impressive, since it can use the entire internet as a cheat sheet during the “exam”


6 posted on 05/04/2023 8:07:21 AM PDT by montag813
[ Post Reply | Private Reply | To 1 | View Replies]

To: grimalkin
“It’s possible that ChatGPT (or its successors) with more training and human feedback will be less more likely to hallucinate, and if so, they may perform on a par with people,” Christiansen said.

There. Fixed...

7 posted on 05/04/2023 8:09:21 AM PDT by null and void (Attention! Non-compliant Resident Alert! Attention! Non-compliant Resident Alert! Attention! Non-com)
[ Post Reply | Private Reply | To 1 | View Replies]

To: montag813
Hardly impressive, since it can use the entire internet as a cheat sheet during the “exam”

Yup. Every test administered to an AI is an "open book" exam. No real test of mastery, just a test of ability to track down the answers.

AI is a threat to many kinds of employment. Software engineers are clearly targets. The skilled crafts think they are safe. They are not. The AI can reduce many of the skilled crafts in to a detailed set of instructions that anyone of average reading ability can follow. Law, medicine, replacing a water heater. Even surgery can be delegated to robots guided by AI. The pursuit for humans will be some form of productive labor that can't be replaced by AI/robotics.

8 posted on 05/04/2023 9:41:49 AM PDT by Myrddin
[ Post Reply | Private Reply | To 6 | View Replies]

To: grimalkin

Government vs AI is a mismatch.

AI will mop the floor with all of those idiots.


9 posted on 05/04/2023 9:43:14 AM PDT by cgbg (Claiming that laws and regs that limit “hate speech” stop freedom of speech is “hate speech”.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: grimalkin

Only because it is hitting them where their pride is “Look how SMART I AM I GET TO RULE!”

No one cared about the blue collar workers who found they were replaced by robots.


10 posted on 05/04/2023 9:48:52 AM PDT by redgolum (We are not going to make it, are we. )
[ Post Reply | Private Reply | To 1 | View Replies]

To: grimalkin

ChatGPT-4, the new model released in March, can score in the 93rd percentile in SAT reading, 89th percentile in SAT math


Unimpressive:

Score — Percentile
1550-1600 — 99 to 99+
1500-1550 — 98 to 99
1450-1500 — 96 to 98
1400-1450 — 93 to 96
1350-1400 — 90 to 93
1300-1350 — 86 to 90
1250-1300 — 81 to 86
1200-1250 — 75 to 81


11 posted on 05/04/2023 2:07:42 PM PDT by nicollo ("I said no!")
[ Post Reply | Private Reply | To 1 | View Replies]


12 posted on 05/05/2023 10:06:50 AM PDT by SunkenCiv (NeverTrumpers are Republicans the same way Liz Cheney is a Republican.)
[ Post Reply | Private Reply | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson