Tech
What happened when humans stopped managing social media content
This article is part of a special report, The Essential Tech Worker.
Nobody appreciated the content..
This article is part of a special report, The Essential Tech Worker.
Nobody appreciated the content moderators until they were gone.
As the coronavirus pandemic swept the world, social media giants like Facebook, Google and Twitter did what other companies did. They sent workers home — including the tens of thousands of people tasked with sifting through mountains of online material and weeding out hateful, illegal and sexually explicit content.
In their place, the companies turned to algorithms to do the job. It did not go well.
The COVID-driven experiment represented a real-world baptism of fire for something social media companies have long dreamed of: using machine-learning tools and artificial intelligence — not humans — to police posts on their platforms.
When the social media giants announced the changes, they acknowledged the algorithms might struggle to discriminate between legitimate and illegitimate content. And indeed, the effects were almost immediate.
While far more content was flagged and removed for allegedly breaking the companies’ rules on what could be posted online, in some areas dangerous and possibly illegal material was more likely to slip past the machines.
Facebook and Google roughly doubled the amount of potentially harmful material they removed in the second quarter of this year compared with the three months through March, according to the companies’ most recent transparency reports. Twitter has yet to provide figures for 2020.
In Syria, where campaigners and journalists rely on social media to document potential war crimes, scores of activists’ accounts were closed down overnight — often with no right to appeal those decisions. Other content, including news articles and health information linked to the coronavirus, was similarly scrubbed from the internet as the machines got to work.
And yet, a lot of questionable posts remained untouched. In France, campaigners fighting against racism and anti-Semitism noticed a more than 40 percent increase in hate speech on Twitter. Less than 12 percent of those posts were removed, the groups said.
In other high-profile areas, like child exploitation and self-harm, the number of removals fell by at least 40 percent in the second quarter of 2020 because of a lack of humans to make the tough calls about what broke the platforms’ rules, according to Facebook’s transparency report.
“Everything changed with COVID,” said Jeff Deutch, a researcher at the Syrian Archive, an organization that helps document atrocities in war-torn countries worldwide, often on social media. “It was concerning. We thought we were going back to the problems we had seen before in 2017, when the platforms removed content, out of an abundance of caution, that they believed was glorifying terrorism.”
The results of this impromptu experiment — taken on a massive scale, without notifying users — raise far-reaching questions about what happens to free speech when human arbiters are taken out of the equation, and algorithms become the final judges of what is and is not appropriate to post.
It also reinforces a very non-digital truth: Even the most sophisticated algorithms and machine-learning tools still can’t replicate the computing power of an army of human content moderators.
“It’s very hard to automate certain things,” said Joris von Hoboken, a law professor at Vrije Universiteit Brussels who co-authored a recent study into the use of artificial intelligence to police online material. “A lot of what we see online is based on context. There are serious problems of transparency and accountability when you rely on machines over humans to make these decisions.”
The impact of COVID-19
Before the global pandemic forced tech giants to send home their content moderators, more than 30,000 people — often low-paid workers in places like Berlin and Austin, Texas — spent hours looking at some of the worst material to be found on the world’s largest social networks.
Facebook, Google and Twitter, almost in unison, announced their switch to automation in the middle of March.
There was a bittersweet reaction among many of those who found themselves temporarily out of a job, according to three current and former content moderators who spoke to POLITICO on the condition of anonymity because they did not want to jeopardize their current positions or had signed agreements not to speak publicly about their previous work.
Social media content moderators review thousands of explicit posts each day and are given little mental support to handle the graphic imagery they have to police. Their decisions are then pumped into the companies’ machine-learning tools, which require large datasets of removal decisions to learn from, according to Tarleton Gillespie, who works at Microsoft Research, an independent research unit of the tech company.
One content moderator told POLITICO that the monthslong break was a welcome relief to what he considered “back-breaking work.”
The tech giants initially said content moderators could not work from home because of concerns about how people’s data may be handled — though Facebook now allows some moderators to review material remotely, with the exception of the most explicit material. Google said it would follow suit, but has not given details about how.
The moderator said the unplanned experiment also confirmed something many contractors already suspected — that the human content reviewers weren’t just making calls on questionable content; they were training the machines that were planned to eventually replace them.
“It just fast-tracked something that many of us saw coming,” the moderator said. “We are only here until the AI tools can catch up.”
For now, those tools remain anything but perfect.
Google’s YouTube, for instance, removed 11.4 million videos in the second quarter compared with 6 million videos in the three months through March, based on the company’s latest records. The number of successful appeals — when content creators believed their videos had been deleted incorrectly — also grew fourfold, to 160,000 videos, over the same period.
“Human review is critical for us,” said Marco Pancini, YouTube’s director of public policy for Europe, the Middle East and Africa, told POLITICO.
It’s “not only necessary to train our machine learning systems, but it also serves as a check providing feedback that improves the accuracy of our systems over time,” Pancini added.
Facebook reported similar figures, with the number of removals flagged as hate speech on its main platform more than doubling to 22.5 million in the second quarter of 2020, according to the social network’s data. The rise was in part because the company expanded its content moderation tools to non-English language posts. Meanwhile, the number of successful content appeals was just 12,600, a significant drop from the 2.3 million figure for the first three months of the year.
Appeals to overturn incorrect decisions also took longer or, in some cases, were not handled at all because of an absence of people to handle them, according to the company’s latest transparency report.
That represents a “backslide” in the rights of people posting content online, said Jillian York, director for international freedom of expression at Electronic Frontier Foundation, a nonprofit group.
“Before the pandemic, people were getting some notice about bans and violations,” she added. “We were making more progress. I’m worried we’re back to 10 years ago.”
Stephen Turner, European director for public policy at Twitter, said in a statement that the company had widened its definition of what constitutes harmful content in response to the COVID-19 crisis. The company will publish figures on how much content its machines have so far taken down later this year.
There’s a growing awareness within the social media giants — which have been grappling with how to deal with hateful and false content from high-profile figures like U.S. President Donald Trump — that it may never be possible to fully automate decisions on questionable content, especially when it comes to difficult calls that require local knowledge or cultural cues.
“Content enforcement is not an either-or approach, where we use either human reviewers or artificial intelligence,” Guy RosenRead More – Source
-
Australia4 years agoButton and Diane Powellpark the school bus after three decades
-
Australia4 years ago
Button and Diane Powellpark the school bus after three decades
-
Europe2 years agoCovid: Flights shut down as EU discusses UK virus threat
-
Europe2 years agoPost-Brexit trade: Is red tape chaos just ‘teething trouble’ as the UK government argues?
-
Tech3 years agoSearch engine startup asks users to be the customer, not the product
-
Tech1 year agoSign up to The Independent’s free cryptocurrency expert panel event
-
Health2 years ago
Spain ‘to register’ those who refuse to have Covid-19 vaccine
-
Arts5 years agoHow a chain-link mosque at the Vancouver Biennale became a community hub