Saudi Press

Saudi Arabia and the world
Friday, Apr 26, 2024

Investigation into online platforms finds 'foul trove of racial hatred'

Investigation into online platforms finds 'foul trove of racial hatred'

The Centre for Analysis of the Radical Right, which carried out the research, said: "It makes you wonder what the point of moderation is when some of these obvious, overt and in some cases violence-inciting accounts can go literally years with no consequences, and certainly no moderation."

An investigation has exposed hundreds of thousands of online hate profiles, leading to a call for tougher regulation of online platforms.

A "foul trove of racial hatred" was uncovered on Twitter and Facebook as well as amongst the gaming community through research conducted by the UK-based Centre for Analysis of the Radical Right (CARR).

It comes six months after a public outcry at the abuse of England footballers Marcus Rashford, Jadon Sancho and Bukayo Saka, who were targeted online after missing penalties in the Euro 2020 final at Wembley.

Researchers found around 300 users or profile names on Twitter derived from a racist phrase


What was found on Twitter?


During their two-day analysis carried out in January, CARR researchers looked for profiles using simple words and phrases as indicators of "systemic failure".

On Twitter, they found around 300 users or profile names derived from a racist phrase, including the N-word, dating as far back as 2009.

Dr Edward Gillbard, who carried out the research, said the majority of accounts had fewer than two followers and were following less than two accounts.

He added that it would "appear there is no automatic moderation being performed by Twitter" in terms of analysing accounts for offensive usernames.

Twitter said the accounts had been "permanently suspended" for "violating our hateful conduct policy".

A spokesman said: "We acknowledge and want to reiterate our commitment to ensuring that Twitter doesn't become a forum that facilitates abuse and we continue to examine our own policy approaches and ways we can enforce our rules at speed and scale."

What was discovered on Facebook?


On Facebook, dozens of offensive profiles, including 83 variants of "hate (N-word)" and 91 on the Holocaust were identified.

Other profiles included the name Adolf Hitler and other high profile Nazis, as well as the names of mass killers such as the Christchurch mosque attacker in New Zealand.

By changing the spelling or inserting spaces and special characters, profiles seemed to be able to fool moderation systems, Dr Bethan Johnson, who found the accounts, said.

"It may be that when users set up profiles with names that clearly mock and flout community standards - from 'Jewkilla' to 'Nate Higgers' - they are telling Facebook what kind of user they will be, what kind of ideas they bring to the platform, and the reality is that is far from community-orientated," she said.

A spokesman for Meta, the parent company of Facebook, Instagram and WhatsApp, said hate speech was not allowed on its platforms and the "violating" accounts were removed after being flagged.

He added: "If we find content that violates our policies, including the use of symbols, emojis or misspellings attempting to beat our systems, we will remove it."

Offensive profiles were also found on Facebook.


What about gaming platforms?


An analysis of the digital gaming service Steam revealed more than 300,000 offensive profile names.

Of those, 241,729 were anti-black, 44,368 white supremacist, more than 28,000 neo-Nazi, 8,021 anti-Semitic, 5,607 homophobic, and 168 anti-Muslim.

On the game Fortnite, more than 100 racist and far-right extremist profile names were found and 34 were identified on Rainbow Six Siege, 18 of which were active.

A spokeswoman for Fortnite developer Epic Games said many of the offensive usernames are no longer in their systems and action has been taken against additional accounts provided.

"Usernames that include vulgarity, hate speech, offensive or derogatory language of any kind are in violation of our community rules," she added.

It is understood that the Rainbow Six Siege profiles have been reset with randomised names and any offending pictures have been removed.

A spokesman for the game's creator Ubisoft said the company "does not tolerate any form of bullying or harassment".

The firm takes "concrete actions" to tackle "toxic" behaviour, and violations of its code of conduct could lead to sanctions, including bans, he said.

While automated processes were not "foolproof", teams are constantly working on improving them, he added.

What has the reaction been?

"Finding a foul trove of racial hatred on social media is still shockingly easy," said director of CARR, Professor Matthew Feldman.

"It makes you wonder what the point of moderation is when some of these obvious, overt and in some cases violence-inciting accounts can go literally years with no consequences, and certainly no moderation.

"This material is disgusting and makes it seem that platforms just don't care enough to address this running sore."

He added that platforms had a "duty of care" to users but only government regulations and the threat of tens of millions in fines would bring change.

"Otherwise, these platforms will stay reactive - badly - rather than proactive in taking down hateful extremism," Prof Feldman added.

Danny Stone MBE, chief executive of the Antisemitism Policy Trust which jointly published the report, said: "Six months from the Euro finals, a year from the insurrection at the US capitol, but the story remains the same - social media companies profiting from the sale of our data but failing to properly protect people from harm."

He added: "I hope the forthcoming Online Safety Bill, and legislation across the world, will force social media companies to better look after their users because they appear to be in no hurry to help."

Newsletter

Related Articles

Saudi Press
0:00
0:00
Close
Reports in Gaza: 5 dead from the impact of aid packages dropped by the USA
Apple warns against drying iPhones with rice
China Criticizes US for Vetoing UN Ceasefire Resolution in Gaza
In a recent High Court hearing, the U.S. argued that Julian Assange endangered lives by releasing classified information.
The U.S. vetoed a U.N. Security Council resolution calling for a temporary ceasefire in Gaza, instead proposing its own six-week ceasefire plan contingent upon the release of all hostages held by Hamas
Prince William Urges End to Gaza Conflict
Saudi Arabia ranks first in UN index for e-government services in MENA
Israel has gone ‘beyond self-defence’ in Gaza, says Labour’s Streeting
EU Calls for Immediate Ceasefire in Gaza Conflict
Israel Records 20% Drop In GDP, War In Gaza Is The Reason
Saudi Arabia's FDI Inflows Grow with New International Standards
Venture Capitals Power Up Across MENA Region
Saudi Arabia Introduces Terms for 30-Year Income Tax Exemption for Multinational Companies
Saudi FM: Establishing Palestinian state is only pathway for Mideast stability
Russian opposition leader Alexey Navalny has died at the Arctic prison colony
Elon Musk's Starlink Gets License For Israel, Parts Of Gaza
Influencers Exploit X Platform for Profit Amidst Israel-Gaza Conflict
PM Modi Announces Opening Of New CBSE Office In Dubai
International Criminal Court's Chief "Deeply Concerned" By Rafah Bombing
January Funding for MENA Startups Totals $86.5 Million
Saudi Arabia accelerates digital economy growth through Nvidia partnership
Indian female military officers commend Saudi Arabia's progress and women's empowerment
Israel unveils tunnels underneath Gaza City headquarters of UN agency for Palestinian refugees
Israel deploys new military AI in Gaza war
Egypt threatens to suspend key peace treaty if Israel pushes into Gaza border town, officials say
Israel Utilizes AI Military Technology in Gaza Conflict
Saudi Arabia Warns Of A "Humanitarian Catastrophe" If Israel Moves On Rafah
China Warns Iran to Halt Houthi Attacks or Damage Trade Ties
US University To Shut Qatar Campus Due To "Heightened Mideast Instability"
Iran-backed hackers interrupt UAE TV streaming services with deepfake news
Facebook and Instagram Ban Iran's Supreme Leader
Finnish Airline, Finnair, is voluntarily weighing passengers to better estimate flight cargo weight
U.S. Secretary of State Blinken: The Israelis underwent dehumanization on 7.10, this does not give them the right to do this to others.
Defense Technology Showcase Held in Riyadh
Saudi Arabia’s non-oil exports rise 2.5% to $6bn in November 2023: GASTAT
UK Bans Misleading "Zero Emissions" Claims for Electric Cars
Gaza's Teen Inventor Sparks Light in Displacement
Netanyahu Rejects Ceasefire Proposal, Insists On Total Victory Over Hamas
Guterres appoints independent UNRWA review panel
Private Sector Employment Hits Record High with Over 11 Million Employees in January
Rolls-Royce Executive Encourages Saudi Women to Tap into Their Inner 'Superhero' for Success in Defense Industry
Saudi Arabia launches National Academy of Vehicles and Cars
Saudi Tourism Minister Reveals Plan for 250,000 New Hotel Rooms by 2030
SAR to more than double eastern network passenger capacity with new trains deal
Saudi Arabia Enhances National Defense with New Partnerships
Saudi Aramco Maintains Arab Light Crude Pricing to Asia for March
NEOM Establishes New York Office to Support Investors
Saudi Wealth Fund Draws in Over $25 Billion Worth of Investments in Three Years, Al-Rumayyan Reveals
ZATCA Cautions Against Scammer Schemes
INTRA Defense Technologies inaugurates drone factory in Riyadh
×