Skip to main content

Why didn’t Google realize that an anti-hate live stream would get overrun by hate speech?

Why didn’t Google realize that an anti-hate live stream would get overrun by hate speech?

Share this story

Illustration by Alex Castro / The Verge

Earlier today, Google counsel Alexandria Walden testified before Congress in a hearing titled “Hate Crimes and the Rise of White Nationalism.” The House Judiciary Committee streamed the video live on Google’s own YouTube platform, complete with a live chat feed. Anybody who’s even passingly familiar with YouTube might have flagged this as a bad decision. Hateful, racist comments are notoriously common on the site, and, unsurprisingly, some of YouTube’s worst users immediately descended on the chat with slurs and other attacks.

Commenters insulted Jewish committee chair Jerry Nadler, calling him a “goblin,” and some mocked Walden’s fellow witness, Mohammad Abu-Salha, whose two daughters were killed in an alleged hate crime. They espoused the same racist conspiracy theories that the Judiciary Committee was trying to address. Within an hour, the chat was disabled — but not before the incident was covered by several media outlets, including The Washington Post, from which Nadler read in the middle of the hearing.

Nobody needed more evidence that YouTube comments can be racist. But beyond the simple irony of a hearing about white supremacy being overrun by white supremacists, it raises a baffling question: why didn’t Google anticipate that this would happen?

Today’s hearing chat isn’t simply an example of moderators missing some bad comments on the hundreds of hours of video uploaded every minute. The stream was a preplanned event on an official government-run YouTube channel, featuring a prominent Google employee promising that “hate speech and violent extremism have no place on YouTube.” It was sure to be watched by a large audience, including many journalists who are already heavily critical of YouTube.

A recent Bloomberg report claims that YouTube historically ignored toxic content because it drives controversy and engagement. But even if you’re entirely cynical about Google’s motives, there’s a clear incentive to sidestep easily avoidable bad publicity. It’s hard to see what the company gains by making YouTube’s toxicity a top news result for the hearing. And it would have been simple to preemptively turn off live chat or just warn the Judiciary Committee to watch and moderate the comments.

Google certainly isn’t averse to locking comments. YouTube has disabled live chat on Google’s I/O conference streams in the past, and it temporarily banned most comments on videos featuring children earlier this year. In a statement today, Google was matter-of-fact about locking the hearing’s comments. “Hate speech has no place on YouTube. We’ve invested heavily in teams and technology dedicated to removing hateful comments / videos. Due to the presence of hateful comments, we disabled comments on the livestream of today’s House Judiciary Committee hearing,” a spokesperson tweeted.

So why didn’t it just turn off chat before the stream started? It’s possible that Google was worried about being accused of censorship for shutting down comments without clear hate content. After all, there’s been an agonizing debate over how platforms should moderate speech. Despite being nominally about white supremacy, even today’s hearing was quickly hijacked by complaints about alleged online anti-conservative bias, as Rep. Tom McClintock (R-CA) grilled Google and Facebook about whether they were “neutral” platforms.

It’s also possible that Google doesn’t fully grasp how ubiquitous bigoted comments are on YouTube or how inevitable today’s hearing live stream mess seemed from the outside. Google has certainly missed the mark before; YouTube CEO Susan Wojcicki acknowledged that last year’s Rewind retrospective didn’t reflect many users’ experience with the site, for instance. Companies don’t always have a good sense of how people use their products, and YouTube might be no exception.

But today, Google undercut hours of testimony by not accounting for a very obvious problem on its platform in a rare case where the right solution seemed obvious as well.

Today’s Storystream

Feed refreshed Two hours ago Not just you

T
Youtube
Thomas RickerTwo hours ago
Table breaks before Apple Watch Ultra’s sapphire glass.

”It’s the most rugged and capable Apple Watch yet,” said Apple at the launch of the Apple Watch Ultra (read The Verge review here). YouTuber TechRax put that claim to the test with a series of drop, scratch, and hammer tests. Takeaways: the titanium case will scratch with enough abuse, and that flat sapphire front crystal is tough — tougher than the table which cracks before the Ultra fails — but not indestructible.


E
Twitter
Emma RothSep 25
Rihanna’s headlining the Super Bowl Halftime Show.

Apple Music’s set to sponsor the Halftime Show next February, and it’s starting out strong with a performance from Rihanna. I honestly can’t remember which company sponsored the Halftime Show before Pepsi, so it’ll be nice to see how Apple handles the show for Super Bowl LVII.


E
Twitter
Emma RothSep 25
Starlink is growing.

The Elon Musk-owned satellite internet service, which covers all seven continents including Antarctica, has now made over 1 million user terminals. Musk has big plans for the service, which he hopes to expand to cruise ships, planes, and even school buses.

Musk recently said he’ll sidestep sanctions to activate the service in Iran, where the government put restrictions on communications due to mass protests. He followed through on his promise to bring Starlink to Ukraine at the start of Russia’s invasion, so we’ll have to wait and see if he manages to bring the service to Iran as well.


E
External Link
Emma RothSep 25
We might not get another Apple event this year.

While Apple was initially expected to hold an event to launch its rumored M2-equipped Macs and iPads in October, Bloomberg’s Mark Gurman predicts Apple will announce its new devices in a series of press releases, website updates, and media briefings instead.

I know that it probably takes a lot of work to put these polished events together, but if Apple does pass on it this year, I will kind of miss vibing to the livestream’s music and seeing all the new products get presented.


Welcome to the new Verge

Revolutionizing the media with blog posts

Nilay PatelSep 13
E
External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.


A
Youtube
Andrew WebsterSep 24
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.


A
The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.