Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Users banned from social platforms shown to go elsewhere with increased toxicity
Phys.org ^ | 8/3/2021 | by Binghamton University

Posted on 08/03/2021 12:51:30 PM PDT by LibWhacker

Users banned from social platforms go elsewhere with increased toxicity, according to a new study featuring researchers from Binghamton University, State University of New York.

When people act like jerks on social media, one permanent response is to ban them from posting again. Take away the digital megaphone, the theory goes, and the hurtful or dishonest messages from those troublemakers won't post a problem there anymore.

What happens after that, though? Where do those who have been 'deplatformed' go, and how does it affect their behavior in future?

An international team of researchers—including Assistant Professor Jeremy Blackburn and Ph.D. candidate Esraa Aldreabi from the Thomas J. Watson College of Engineering and Applied Science's Department of Computer Science—explores those questions in a new study called "Understanding the Effect of Deplatforming on Social Networks."

The research performed by iDRAMA Lab collaborators at Binghamton University, Boston University, University College London and the Max Planck Institute for Informatics in Germany was presented in June at the 2021 ACM Web Science conference.

Researchers developed a method to identify accounts belonging to the same person on different platforms and found that being banned on Reddit or Twitter led those users to join alternate platforms such as Gab or Parler where the content moderation is more lax.

Also among the findings is that, although users who move to those smaller platforms have a potentially reduced audience, they exhibit an increased level of activity and toxicity than they did previously.

"You can't just ban these people and say, 'Hey, it worked.' They don't disappear," Blackburn said. "They go off into other places. It does have a positive effect on the original platform, but there's also some degree of amplification or worsening of this type of behavior elsewhere."

The deplatforming study collected 29 million posts from Gab, which launched in 2016 and currently has around 4 million users. Gab is known for its far-right base of neo-Nazis, white nationalists, anti-Semites and QAnon conspiracy theorists.

Using a combination of machine learning and human labeling, researchers cross-referenced profile names and content with users that had been active on Twitter and Reddit but were suspended. Many who are deplatformed reuse the same profile name or user info on a different platform for continuity and recognizability with their followers.

"Just because two people have the same name or username, that's not a guarantee," Blackburn said. "There was a pretty big process of going through creating a 'ground truth' data set, where we had a human say, 'These have to be the same people because of this reason and that reason.' That allows us to scale things up by throwing it into a machine learning classifier [program] that will learn the characteristics to watch for."

The process was not unlike how scholars determine the identity of authors for unattributed or pseudonymous works, checking for style, syntax and subject matter, he added.

In the dataset analyzed for this study, about 59% of Twitter users (1,152 out of 1,961) created Gab accounts after their last active time on Twitter, presumably after their account was suspended. For Reddit, about 76% (3,958 out of 5,216) of suspended users created Gab accounts after their last post on Reddit.

Comparing content from the same users on Twitter and Reddit versus Gab, users tend to become more toxic when they are suspended from a platform and are forced to move to another platform. They also become more active, increasing the frequency of posts.

At the same time, the audience for Gab users' content is curtailed by the reduced size of the platform compared to the millions of users on Twitter and Reddit. This might be seen as a good thing, but Blackburn cautioned that much of the planning for the Jan. 6 attack on the U.S. Capitol happened on Parler, a platform similar to Gab with a smaller user base that skews to the alt-right and far-right.

"Reducing reach probably is a good thing, but reach can be easily misinterpreted. Just because someone has 100,000 followers doesn't mean they're all followers in the real world," he said.

"The hardcore group, maybe the group that we're most concerned about, are the ones that probably stick with someone if they move elsewhere online. If by reducing that reach, you increase the intensity that the people who stay around are exposed to, it's like a quality versus quantity type of question. Is it worse to have more people seeing this stuff? Or is it worse to have more extreme stuff being produced for fewer people?"

A separate study, "A Large Open Dataset from the Parler Social Network," also included Blackburn among researchers from New York University, the University of Illinois, University College London, Boston University and the Max Planck Institute.

Presented at the AAAI Conference on Web and Social Media last month, it analyzed 183 million Parler posts made by 4 million users between August 2018 and January 2021, as well as metadata from 13.25 million user profiles. The data confirm that users on Parler—which briefly shut down and was taken off of Apple and Google app stores in response to the Capitol riot—overwhelmingly supported President Donald Trump and his "Make America Great Again" agenda.

"Regardless of what Parler might have said, publicly or not, it was very clearly white, right-wing, Christian Trump supporters," Blackburn said. "Again, unsurprisingly, it got its largest boost right at the 2020 election—up to a million users joining. Then around the attack at the Capitol, there was another big bump in users. What we can see is that it was very clearly being used as an organization tool for the insurrection."

So if banning users is not the right answer, what is? Reddit admins, for example, have a "shadow-banning" capability that allows troublesome users to think they're still posting on the site, except no one else can see them. During the 2020 election and the COVID-19 pandemic, Twitter added content moderation labels to tweets that deliberately spread disinformation.

Blackburn is unsure about all the moderation tools that social media platforms have available, but he thinks there need to be more "socio-technical solutions to socio-technical problems" rather than just outright banning.

"Society is now fairly firmly saying that we cannot ignore this stuff—we can't just use the easy outs anymore," he said. "We need to come up with some more creative ideas to not get rid of people, but hopefully push them in a positive direction or at least make sure that everybody is aware of who that person is. Somewhere in between just unfettered access and banning everybody is probably the right solution."


TOPICS: News/Current Events
KEYWORDS: banned; enough; not; users
Navigation: use the links below to view more comments.
first previous 1-2021-35 last
To: mewzilla

SUNY B...
U.S. intel concerns ‘do not apply’ to our Confucius Institute, university claims Binghamton University told a concerned student that the U.S. intelligence community’s concerns about its Confucius Institutes “do not apply.” The statement was made to a student who cited a Campus Reform article.

/\
\/

Aka

Running dog of the CCP.

( probably got a slave organ rain check from CCP for his service , or maybe 3 bang bangs from fang fang & Co.)

Jmho

.


21 posted on 08/03/2021 1:37:07 PM PDT by cuz1961 (USCGR Veteran )
[ Post Reply | Private Reply | To 15 | View Replies]

To: LibWhacker
and found that being banned on Reddiaperit or Twittsewer

fixed it

22 posted on 08/03/2021 1:39:27 PM PDT by kiryandil (China Joe and Paycheck Hunter - the Chink in America's defenses)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker
Gab is known for its far-right base of neo-Nazis, white nationalists, anti-Semites and QAnon conspiracy theorists.

Neo-Nazis are all undercover FBI agents, white supremacists consist of EVERYONE who voted for Trump, anti-Semites are defined as anyone criticizing George Soros, and with each passing day, more and more of 2020's "conspiracy theories" are turning out true.

23 posted on 08/03/2021 1:44:01 PM PDT by Drew68
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker
I remember this poster from the 1960s. Ben Shahn, 1968. The left has obviously forgotten the lesson it taught.


24 posted on 08/03/2021 1:45:00 PM PDT by yefragetuwrabrumuy (Do kids in Iceland still play "The Floor Is Lava?")
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

Typical PHD research ... come up with a desired result and forge enough data to support it. Have fellows applaud your greatness.


25 posted on 08/03/2021 1:50:03 PM PDT by RetiredTexasVet (Corrupt Slow Joe Biden is the Bolshevik sock puppet.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

I can tell you with 100% conviction, the Uber-left has already left mainstream social media and have their own private one setup.

They don’t use FB, Instigram or anything close to it.


26 posted on 08/03/2021 1:50:37 PM PDT by Zathras
[ Post Reply | Private Reply | To 1 | View Replies]

To: All

How do you measure one’s toxicity?


27 posted on 08/03/2021 2:00:33 PM PDT by escapefromboston (Free Chauvin)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker
"When people act like jerks on social media, ..."

That's the alarm bell that clearly indicated that this just another vile screed from a member of the Thought Police Brigade...

Not a single word further is worth reading...

28 posted on 08/03/2021 2:04:49 PM PDT by SuperLuminal (Where is another Sam Adams now that we desperately need him?)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

I just got another 30 days in FB jail for posting the Monty Python “skit” when Stan wanted to become Loretta and have babies” in THE LIFE OF BRIAN.

I posted the links, Zuck blocked them.
So I copied the actual script with a link to You Tube and got 30 days.

What got me 30 days....again.

http://montypython.50webs.com/scripts/Life_of_Brian/8.htm

https://www.youtube.com/watch?v=Dgp9MPLEAqA


29 posted on 08/03/2021 2:08:03 PM PDT by Ruy Dias de Bivar (30 days! FB jail for mentioning a Monty Python script about tranneys, and the 1936 Olympics.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

islam is a totalitarian death cult founded by a child rapist.


30 posted on 08/03/2021 2:13:58 PM PDT by Uncle Miltie (Critical Race Theory: black behavior is so bad it must be whitey's fault.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

very telling when you look at the concerns of the researcher that they are in a bubble of there own creation. they hate the fact that most kicked off keep there opinions. they hate that fans of the person if popular migrate to new platforms with the person baned. they also refer to the other platforms as being a lot more toxic then twitter.


31 posted on 08/03/2021 2:20:55 PM PDT by PCPOET7 (`)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

A “science” site! This shows that “science” is now being used to promote the agenda of the left. It’s not science any more.

“socio-technical solutions to socio-technical problems” means they plan to use technology to get rid of Trump supporters and Whitey.


32 posted on 08/03/2021 2:27:04 PM PDT by I want the USA back (To find out who really rules you, find out who you're not allowed to criticize. Voltaire. )
[ Post Reply | Private Reply | To 1 | View Replies]

To: Luke21
Gab appears to be up at this point.

The religious cult enamored with collectivist totalitarianism are terrified of people like Andrew Torba. Hence childishly idiotic hit pieces from 'phys.org'.

Phys.org lackeys should stay in their own lane.
33 posted on 08/03/2021 2:37:25 PM PDT by farming pharmer (fork you :(){ :|:& };:)
[ Post Reply | Private Reply | To 6 | View Replies]

To: LibWhacker

.


34 posted on 08/03/2021 3:16:40 PM PDT by redinIllinois (Pro-life, accountant, gun-totin' Grandma - multi issue voter)
[ Post Reply | Private Reply | To 1 | View Replies]

To: LibWhacker

Evidently I’m majorly toxic.

I’ve been banned (almost) permanently from NextDoor, and then within a week from a particular Reddit forum I just joined.

They have squealers and just plain dopey mods, so I’ve been booted for “COVID misinfo” and just being “uncivil”. Never mind how the tattle-tales who cry about me have behaved.


35 posted on 04/09/2022 8:55:18 PM PDT by the OlLine Rebel (Common sense is an uncommon virtue./Federal-run medical care is as good as state-run DMVd)
[ Post Reply | Private Reply | To 1 | View Replies]


Navigation: use the links below to view more comments.
first previous 1-2021-35 last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson