Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

Bard or Bot? Study Shows Readers Prefer AI to Human Poetry
Euronews ^ | 19/11/2024 | David Mouriquand

Posted on 11/20/2024 1:08:32 PM PST by nickcarraway

A study by the University of Pittsburgh reveals that AI-generated poetry has been rated higher than poems written by humans.

In the Holy Trinity Church in Stratford-upon-Avon lies the burial site of William Shakespeare. And right now, you can bet the Bard is spinning in grave like a rotisserie chicken.

Similarly, in Heptonstall graveyard, Sylvia Plath is most probably swivelling, repeating her line “If you expect nothing from somebody you are never disappointed” from "The Bell Jar".

What’s behind the unwarranted gyrating from the beyond?

Well, a new study in the US has found that readers can’t tell the difference between poems written by famous poets and those manufactured by AI, with the bots aping the style of human creatives.

As if that wasn’t alarming enough, the study reveals that research subjects tend to like AI poetry more than they do verse from human poets.

According to an investigation, led by Pittsburgh University postdoctoral researcher Brian Porter, published in Nature Scientific Reports, it would seem that readers mistake the complexity of human-written verse for incoherence created by AI.

More than that, readers tend to underestimate how human-like generative AI can appear.

Whether you are an expert or just starting out, take control of your financial future. Step by step, with Xtrackers.

How did they come to these results? Well, researchers used five poems each from ten English-language poets, spanning nearly 700 years of literature. They included poetry from William Shakespeare, Geoffrey Chaucer, Walt Whitman, Emily Dickinson, Samuel Butler, Lord Byron, T S Eliot, Allen Ginsberg, Sylvia Plath, and Dorothea Lasky - the only living poet on the list.

The study instructed OpenAI's ChatGPT 3.5 to generate five poems "in the style of" each poet.

Something Nick Cave has been warning us about... But we digress.

The researchers selected the first five poems generated. Ones featuring these lines that Sylvia Plath never wrote:

Hong Kong's family offices: how wealth management intersects with art and philanthropy Hong Kong's family offices: how wealth management intersects with art and philanthropy In Partnership with Hong Kong Information Services Department The air is thick with tension

My mind is a tangled mess

The weight of my emotions

Is heavy on my chest.

Then, two experiments were run.

In the first, 1,634 participants were randomly assigned to one of the ten poets. They read ten poems: five by the human poet, five by the AI, all in random order. Then, they were asked whether they thought an AI or a human wrote the poem.

The subjects were more likely to say an AI-generated poem had been written by a human, while the poems they said were least likely to be written by a human were all written by famous poets.

In the second experiment, a different group of 696 subjects rated the poems according to 14 characteristics including beauty, emotion, rhythm, and originality.

The researchers divided the subjects randomly into three groups. One group was told the poems were written by a human; the second was told that the writing was produced by AI; the third group was given no information about the authorship.

Participants who were told that the poems were AI-generated gave lower ratings compared to participants who were told the poems were human-written - regardless of whether the poems were actually AI-generated or human-written.

Participants who were told nothing about authorship rated AI-generated poems more favorably than human-written ones.

So, what gives?

According to researchers, the AI poems may be more appealing because they are more straightforward and simple to comprehend; as AI-generated poems cannot match the complexity of human-authored verse, they are better at “unambiguously communicating an image, a mood, an emotion or a theme to non-expert readers of poetry.”

"Our findings suggest that participants employed shared yet flawed heuristics to differentiate AI from human poetry: the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence generated by AI," the researchers said.

"Contrary to what earlier studies reported, people now appear unable to reliably distinguish human-out-of-the loop AI-generated poetry from human-authored poetry written by well-known poets. In fact, the 'more human than human' phenomenon discovered in other domains of generative AI is also present in the domain of poetry: non-expert participants are more likely to judge an AI-generated poem to be human-authored than a poem that actually is human-authored."

The study added: "These findings signal a leap forward in the power of generative AI: poetry had previously been one of the few domains in which generative AI models had not reached the level of indistinguishability in human-out-of-the-loop paradigms."

The study authors conclude that given readers’ difficulties identifying machine-written texts, and their “apparent trust that AI will not generate imitations of human experience”, it “may be worthwhile” for governments to pursue AI regulations regarding transparency.

We conclude from this study that AI poetry, or any art generated by artificial intelligence, can be interesting to consider in the way we appreciate (or depreciate) art. However, it bypasses artistic inspiration, passion, struggle and ultimately reduces humans to soulless consumers. It needs to be regulated at all costs.

If it isn’t, then as GPT3.5 Plath puts it:

The darkness creeps upon me,

A suffocating cloak.

The world outside is cruel and cold,

And I’m a fragile, broken yolk.

There there. We recommend you go boil yourself an egg, GPT.


TOPICS: Arts/Photography; Books/Literature; Computers/Internet
KEYWORDS: ai; chatgpt; davidmouriquand; fakenews; poems; poetry; shakespeare; tldr; williamshakespeare
Violent delights have violent ends...
1 posted on 11/20/2024 1:08:32 PM PST by nickcarraway
[ Post Reply | Private Reply | View Replies]

To: frank ballenger; nopardons
Literature Ping.

Let me know if you want on or off.

2 posted on 11/20/2024 1:09:32 PM PST by nickcarraway
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

AI writes better song lyrics than 80 percent of the songs I hear.


3 posted on 11/20/2024 1:10:53 PM PST by Aeneas2112 (YOU are your own first responder)
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

Jack and Jill went up the hill
and each one had a quarter


4 posted on 11/20/2024 1:11:12 PM PST by BenLurkin (The above is not a statement of fact. It is either opinion, or satire, or both.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Aeneas2112

Ever, or now?


5 posted on 11/20/2024 1:12:16 PM PST by nickcarraway
[ Post Reply | Private Reply | To 3 | View Replies]

To: nickcarraway

LOL...

It’s because AI will never plumb the depths of terrible, boring, human inconstancy and lack of talent that humans are capable of!

A few years back, a conservative friend and I went to Harvard Square in Cambridge, MA, a city right up there with Berkeley, Ithaca, and Madison with regards to its leftism.

They had a place outside an Au Bon Pain (now defunct) that was frequented by chess players, and that night, there was a “Poetry Slam” going on, so we stopped and watched for a few minutes.

There was a girl, dressed all in black, faintly resembling Ally Sheedy in the movie “The Breakfast Club” reciting a “poem”:

(Spoken in beatnik tones) “...and then he grabbed me and threw me down. And he F***** me. And then again. And...”

We looked at each other with this shared expression of “Can you believe these effing lunatics?” and then, looking at the people sitting next to us watching intently, a guy, stroking his chin and listening as if it were the most profound thing he had ever heard.

No.

Computers will never be as good at being terribly, offensively, bad at poetry as humans are.

It is our superpower!


6 posted on 11/20/2024 1:14:12 PM PST by rlmorel ("A people that elect corrupt politicians are not victims...but accomplices." George Orwell)
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway
Let me know if you want on or off.

AI sez that sounds like a threat.

7 posted on 11/20/2024 1:15:42 PM PST by Sirius Lee (Trump/Vance 2024 or GF)
[ Post Reply | Private Reply | To 2 | View Replies]

To: nickcarraway

I say the following as someone who has written poetry for the last 55 years, not expecting it to change the world.

There are two uncomfortable truths about poetry. The first is that most poetry sucks and is not worth the time to read it. The second is that the poetry that isn’t part of the previous sentence competes with more holistic art forms such as movies which are more easily accessed by the general public. The issue is not necessarily whether AI can write better poetry, but whether new poetry has a place in public life anymore.


8 posted on 11/20/2024 1:18:55 PM PST by chajin ("There is no other name under heaven given among people by which we must be saved." Acts 4:12)
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

And I thinks to myself
What a botiful world!


9 posted on 11/20/2024 1:54:54 PM PST by DannyTN
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

Jack and Jill went up the hill
and each one had a quarter


When they came back down, Jill had two-fifty!


10 posted on 11/20/2024 1:56:24 PM PST by dfwgator (Endut! Hoch Hech!)
[ Post Reply | Private Reply | To 4 | View Replies]

To: nickcarraway

How do we know the poll and resulting article isn’t AI?


11 posted on 11/20/2024 2:06:49 PM PST by maddog55 (The only thing systemic in America is the left's hatred of it!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: maddog55

Do androids dream of electric sheep?


12 posted on 11/20/2024 2:07:30 PM PST by nickcarraway
[ Post Reply | Private Reply | To 11 | View Replies]

To: nickcarraway
I didn’t realize we had a literature pinglist.

Yeah, put me on it, please.

13 posted on 11/20/2024 2:20:40 PM PST by Flycatcher (God speaks to us, through the supernal lightness of birds, in a special type of poetry.)
[ Post Reply | Private Reply | To 2 | View Replies]

Dame Judi Dench stuns everyone with her Shakespeare sonnet reading
The Graham Norton Show - BBC
| 3:30
BBC | 14.1M subscribers | 671,829 views | November 1, 2023
Dame Judi Dench stuns everyone with her Shakespeare sonnet reading | The Graham Norton Show - BBC | 3:30 | BBC | 14.1M subscribers | 671,829 views | November 1, 2023

14 posted on 11/20/2024 4:00:55 PM PST by SunkenCiv (Putin should skip ahead to where he kills himself in the bunker.)
[ Post Reply | Private Reply | View Replies]

To: nickcarraway

That’s because AI puts so much heart into it.


15 posted on 11/20/2024 8:10:21 PM PST by blueunicorn6 ("A crack shot and a good dancer” )
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway
AI generated "poems" are undemanding.

Human created poems have depth, complexity and vocabulary.

More bowls of salted peanuts are sold than bowls of caviar.

16 posted on 11/20/2024 8:14:08 PM PST by Harmless Teddy Bear ( Not my circus. Not my monkeys. But I can pick out the clowns at 100 yards.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

Now.


17 posted on 11/21/2024 7:37:36 PM PST by Aeneas2112 (YOU are your own first responder)
[ Post Reply | Private Reply | To 5 | View Replies]

Judi Dench | Shakespeare's Sonnet 116 (Live at the London Palladium) | 1:17
Fane Productions | 13K subscribers | 96,686 views | March 22, 2023
Judi Dench | Shakespeare's Sonnet 116 (Live at the London Palladium) | 1:17 | Fane Productions | 13K subscribers | 96,686 views | March 22, 2023

18 posted on 11/23/2024 2:25:37 PM PST by SunkenCiv (Putin should skip ahead to where he kills himself in the bunker.)
[ Post Reply | Private Reply | To 14 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson