Skip to main content

TikTok will start automating video removals for nudity and more in the US

TikTok will start automating video removals for nudity and more in the US


Some videos will no longer be flagged for human review

Share this story

Illustration by Alex Castro / The Verge

TikTok is trying to speed up its moderation process by removing human reviewers where its automated systems can do the job about as well.

In the US and Canada, the company is going to start using automated reviewing systems to weed out videos with nudity, sex, violence, graphic content, illegal activities, and violations of its minor safety policy. If the system catches a video in those categories, it’ll be pulled right away, and the creator will be given the opportunity to appeal to a human moderator.

Until now, TikTok has run all videos by human moderators in the US before pulling them, a spokesperson tells The Verge. The change is meant in part to limit the “volume of distressing videos” moderators are required to watch and give them more time to spend on trickier clips, like misinformation, that require context to properly review. Moderators for other companies, like Facebook, have developed PTSD-like symptoms from the videos they were required to watch. The announcement is also part of an effort to provide more transparency around moderation, according to Axios, which first reported the news.

Most videos TikTok removes fall under these categories

The problem TikTok will face is that automated systems are never perfect, and some communities may be hit hardest by errors in automated takedowns. The app has a history of discriminatory moderation and was recently criticized for pulling the intersex hashtag twice. TikTok says it’s starting to use automation only where it’s most reliable; it’s been testing the tech in other countries, including Brazil and Pakistan, and says only 5 percent of the videos its systems removed actually should have been allowed up.

That’s a low number, but when put in context of how many videos TikTok removes — 8,540,088 videos in the US during the first three months of 2021 — there could end up being tens or hundreds of thousands of videos pulled by mistake. The vast majority of the videos removed fall under the categories TikTok is implementing automated moderation. That said, not all of those videos are going to be routed around human reviewers. A spokesperson says human moderators will still be checking community reports, appeals, and other videos flagged by its automated systems.

TikTok says it’ll be rolling out the automated review system “over the next few weeks.”

Today’s Storystream

Feed refreshed 26 minutes ago Not just you

Emma Roth26 minutes ago
Starlink is growing.

The Elon Musk-owned satellite internet service, which covers all seven continents including Antarctica, has now made over 1 million user terminals. Musk has big plans for the service, which he hopes to expand to cruise ships, planes, and even school buses.

Musk recently said he’ll sidestep sanctions to activate the service in Iran, where the government put restrictions on communications due to mass protests. He followed through on his promise to bring Starlink to Ukraine at the start of Russia’s invasion, so we’ll have to wait and see if he manages to bring the service to Iran as well.

External Link
Emma RothTwo hours ago
We might not get another Apple event this year.

While Apple was initially expected to hold an event to launch its rumored M2-equipped Macs and iPads in October, Bloomberg’s Mark Gurman predicts Apple will announce its new devices in a series of press releases, website updates, and media briefings instead.

I know that it probably takes a lot of work to put these polished events together, but if Apple does pass on it this year, I will kind of miss vibing to the livestream’s music and seeing all the new products get presented.

External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.

Welcome to the new Verge

Revolutionizing the media with blog posts

Nilay PatelSep 13
Andrew WebsterSep 24
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.

The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.

Jay PetersSep 23
Twitch’s creators SVP is leaving the company.

Constance Knight, Twitch’s senior vice president of global creators, is leaving for a new opportunity, according to Bloomberg’s Cecilia D’Anastasio. Knight shared her departure with staff on the same day Twitch announced impending cuts to how much its biggest streamers will earn from subscriptions.

Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.

External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.