Skip to main content

Go read about how Facebook bends its rules for world leaders

Go read about how Facebook bends its rules for world leaders


‘How is Facebook enforcing its rules, and who is set up to benefit?’

Share this story

facebook stock art
Illustration by Alex Castro / The Verge

Facebook is a basically unprecedented piece of technology. Every month, a single platform gives over 2.5 billion people a specially curated selection of advertisements, status updates from friends and family, and automated suggestions for making new connections. Critics often focus — fairly — on that combination of scale and automation, arguing that Facebook’s algorithms promote false news and extremist content.

But a feature story from The New Yorker paints a slightly different picture of Facebook’s problems — one that’s not simply rooted in its design or size. Building on extensive earlier reporting of Facebook’s moderation efforts, author Andrew Marantz talks to former employees about why hate speech and misinformation can spread on the platform. Over and over, a straightforward answer emerges: Facebook has twisted and weakened its rules to give powerful users a pass.

Marantz certainly points to issues with Facebook’s automation and its failure to craft clear standards for content moderators. But the story’s most vivid anecdotes involve Facebook clearly acknowledging that a problem exists, then evading it to avoid provoking political and commercial blowback.

Kicking off powerful users could create political blowback

In 2017, as US President Donald Trump was pushing to ban Muslims from entering the country, Facebook reportedly added a loophole to its rules banning hateful speech against a religious group. When Brazilian President Jair Bolsonaro said indigenous citizens were still “evolving and becoming” human beings, Facebook rejected a plea to remove the content as dehumanizing speech. If moderators flagged threatening posts from the far-right group Britain First, they risked getting their “quality score” docked when an auditor reversed the ban — because the group had a special “shielded” status.

Facebook doesn’t necessarily sympathize with the far right. But figures like Bolsonaro are some of Facebook’s biggest power users and success stories. As one former employee puts it, “it’s awkward for a business to go from a posture of ‘Please, sir, use our product,’ to ‘Actually, sir, you’re now in trouble for using our product.’” In this light, its actions look less like a principled libertarian stance and more like Twitch soft-pedaling a ban on a popular streamer.

Many of the incidents in the article were first reported elsewhere. But Marantz’s story puts them together at a pivotal time, just weeks before the US presidential election. And a couple of new studies have backed up their underlying implications. Researchers at Harvard examined patterns of misinformation around voting, and they concluded that much of the spread was “elite-driven” — not pushed by anonymous trolls or scammers. Similarly, a Cornell University study concluded that Trump himself was a key COVID-19 misinformation source. (Facebook has removed occasional and particularly controversial false statements from Trump.)

“The right question isn’t ‘Should Facebook do more or less?’”

Facebook CEO Mark Zuckerberg has raised real concerns about a powerful corporation policing public discourse. But Color of Change president Rashad Robinson points out that Facebook has willingly written plenty of rules about political speech. “The right question isn’t ‘Should Facebook do more or less?’ but ‘How is Facebook enforcing its rules, and who is set up to benefit from that?’” Robinson says. Over the summer, Color of Change used this message to help lead an advertiser boycott of Facebook — getting companies including Unilever and Coca-Cola to suspend their campaigns on the platform.

Likewise, it’s legitimately doubtful that Facebook could perfectly enforce its rules with any amount of human or AI effort. (Techdirt founder Mike Masnick has referred to this as “Masnick’s Impossibility Theorem.”) Even the most effective system might do something like ban an iconic war photo because it features nudity. But as a chaotic election approaches, talking about banning big, badly behaved accounts is a potentially more productive and massively simpler option — albeit one that might damage Facebook’s bottom line.

Today’s Storystream

Feed refreshed Two hours ago The tablet didn’t call that play by itself

Emma RothTwo hours ago
Missing classic Mario?

One fan, who goes by the name Metroid Mike 64 on Twitter, just built a full-on 2D Mario game inside Super Mario Maker 2 complete with 40 levels and eight worlds.

Looking at the gameplay shared on Twitter is enough to make me want to break out my SNES, or at least buy Super Mario Maker 2 so I can play this epic retro revamp.

External Link
Russell BrandomTwo hours ago
The US might still force TikTok into a data security deal with Oracle.

The New York Times says the White House is still working on TikTok’s Trump-era data security deal, which has been in a weird limbo for nearly two years now. The terms are basically the same: Oracle plays babysitter but the app doesn’t get banned. Maybe it will happen now, though?

Asian America learns how to hit back

The desperate, confused, righteous campaign to stop Asian hate

Esther Wang12:00 PM UTC
Richard LawlerTwo hours ago
Don’t miss this dive into Guillermo del Toro’s stop-motion Pinocchio flick.

Andrew Webster and Charles Pulliam-Moore covered Netflix’s Tudum reveals (yes, it’s going to keep using that brand name) over the weekend as the streamer showed off things that haven’t been canceled yet.

Beyond The Way of the Househusband season two news and timing information about two The Witcher projects, you should make time for this incredible behind-the-scenes video showing the process of making Pinocchio.

External Link
Emma Roth4:13 PM UTC
Netflix’s gaming bet gets even bigger.

Even though fewer than one percent of Netflix subscribers have tried its mobile games, Netflix just opened up another studio in Finland after acquiring the Helsinki-based Next Games earlier this year.

The former vice president of Zynga Games, Marko Lastikka, will serve as the studio director. His track record includes working on SimCity BuildIt for EA and FarmVille 3.

External Link
Andrew J. Hawkins3:37 PM UTC
Vietnam’s EV aspirant is giving big Potemkin village vibes

Idle equipment, absent workers, deserted villages, an empty swimming pool. VinFast is Vietnam’s answer to Tesla, with the goal of making 1 million EVs in the next 5-6 years to sell to customers US, Canada and Europe. With these lofty goals, the company invited a bunch of social media influencers, as well as some auto journalists, on a “a four-day, multicity extravaganza” that seemed more weird than convincing, according to Bloomberg.

James Vincent3:17 PM UTC
Today, 39 years ago, the world didn’t end.

And it’s thanks to one man: Stanislav Petrov, a USSR military officer who, on September 26th, 1983, took the decision not to launch a retaliatory nuclear attack against the US. Petrov correctly guessed that satellite readings showing inbound nukes were faulty, and so likely saved the world from nuclear war. As journalist Tom Chivers put it on Twitter, “Happy Stanislav Petrov Day to those who celebrate!” Read more about Petrov’s life here.

Soviet Colonel who prevented 1983 nuclear response
Photo by Scott Peterson/Getty Images
The Verge
James Vincent3:03 PM UTC
Deepfakes were made for Disney.

You might have seen the news this weekend that the voice of James Earl Jones is being cloned using AI so his performance as Darth Vader in Star Wars can live on forever.

Reading the story, it struck me how perfect deepfakes are for Disney — a company that profits from original characters, fans' nostalgia, and an uncanny ability to twist copyright law to its liking. And now, with deepfakes, Disney’s most iconic performances will live on forever, ensuring the magic never dies.

External Link
Elizabeth Lopatto2:41 PM UTC
Hurricane Fiona ratcheted up tensions about crypto bros in Puerto Rico.

“An official emergency has been declared, which means in the tax program, your physical presence time is suspended,” a crypto investor posted on TikTok. “So I am headed out of the island.” Perhaps predictably, locals are furious.

The Verge
Richard Lawler2:09 PM UTC
Teen hacking suspect linked to GTA 6 leak and Uber security breach charged in London.

City of London police tweeted Saturday that the teenager arrested on suspicion of hacking has been charged with “two counts of breach of bail conditions and two counts of computer misuse.”

They haven’t confirmed any connection with the GTA 6 leak or Uber hack, but the details line up with those incidents, as well as a suspect arrested this spring for the Lapsus$ breaches.

The Verge
Richard Lawler1:00 PM UTC
Green light.

Good morning to everyone, except for the intern or whoever prevented us from seeing how Microsoft’s Surface held up to yet another violent NFL incident.

Today’s big event is the crash of a NASA spaceship this evening — on purpose. Mary Beth Griggs can explain.

David Pierce12:54 PM UTC
Thousands and thousands of reasons people love Android.

“Android fans, what are the primary reasons why you will never ever switch to an iPhone?” That question led to almost 30,000 comments so far, and was for a while the most popular thing on Reddit. It’s a totally fascinating peek into the platform wars, and I’ve spent way too much time reading through it. I also laughed hard at “I can turn my text bubbles to any color I like.”