Skip to main content

The history of online harassment before and after Gamergate with Caroline Sinders

The history of online harassment before and after Gamergate with Caroline Sinders


Interview episode of The Vergecast

Share this story

Illustration by Alex Castro / The Verge

Most discussions about online harassment begin and end with Gamergate, but online harassment campaigns were well underway in the 1990s. They’ve evolved to include life-threatening tactics, including doxxing and swatting. Caroline Sinders, a research fellow at the Digital Harvard Kennedy School and an expert in machine learning, joins Nilay Patel and Casey Newton on The Vergecast to talk about the origins online harassment, how platforms like Twitter and Facebook can be better designed to combat it, and what we as individuals can do to mitigate its effects.

Below is a brief, edited transcript of their conversation about how better designs can help content moderators enforce the rules and protect people from online harassment:

Caroline Sinders: Some of the tools that people are given to content moderate, from what we have seen and different leaked information about content moderators, is awful. What they have to work with is really, really not great. And it’s upsetting when you think about it from a design standpoint, when you think about how the beacons of modern design in the United States will be software design and it will be from major platforms, that what content moderators have to use to moderate platforms is really antagonistic. Outside of the content that they are forced to look at, the tools that they are given and the time frames that they’re given to analyze content is almost... I want to argue like a human rights violation.

Casey Newton: Wow.

They have under 10 seconds to make a decision. Sometimes what they’re looking at is extremely violent content. They have to look at it all day, and they have specific quotas that they often have to meet. So how do you build context out of that? How do you build context out of something like a harassment campaign that’s happening in Steubenville?


How do you build in context to that? What people often have is like a checklist that they have to memorize. It’s based off policy that’s not great policy around defining harassment. And they have to make a split-second decision. And they have tools where there’s not enough shown to them to perhaps understand what they’re looking at. So, what are all the solutions here? The solutions are to perhaps redesign the way in which content moderators are engaging with content on the platforms. Make that experience better.

Today’s Storystream

Feed refreshed Two hours ago Midjourneys

External Link
Emma RothTwo hours ago
Celsius’ CEO is out.

Alex Mashinsky, the head of the bankrupt crypto lending firm Celsius, announced his resignation today, but not after patting himself on the back for working “tirelessly to help the company.”

In Mashinsky’s eyes, I guess that means designing “Unbankrupt yourself” t-shirts on Cafepress and then selling them to a user base that just had their funds vaporized.

At least customers of the embattled Voyager Digital crypto firm are in slightly better shape, as the Sam Bankman-Fried-owned FTX just bought out the company’s assets.

Mary Beth GriggsTwo hours ago
NASA’s SLS rocket is secure as Hurricane Ian barrels towards Florida.

The rocket — and the Orion spacecraft on top — are now back inside the massive Vehicle Assembly Building. Facing menacing forecasts, NASA decided to roll it away from the launchpad yesterday.

External Link
Andrew J. Hawkins1:30 PM UTC
Harley-Davidson’s electric motorcycle brand is about to go public via SPAC

LiveWire has completed its merger with a blank-check company and will make its debut on the New York Stock Exchange today. Harley-Davison CEO Jochen Zeitz called it “a proud and exciting milestone for LiveWire towards its ambition to become the most desirable electric motorcycle brand in the world.” Hopefully it also manages to avoid the cash crunch of other EV SPACs, like Canoo, Arrival, Faraday Future, and Lordstown.

The Verge
Andrew Webster1:06 PM UTC
“There’s an endless array of drama going on surrounding Twitch right now.”

That’s Ryan Morrison, CEO of Evolved Talent Agency, which represents some of the biggest streamers around. And he’s right — as you can read in this investigation from my colleague Ash Parrish, who looked into just what’s going on with Amazon’s livestreaming service.

The Verge
Richard Lawler12:59 PM UTC
Green light.

NASA’s spacecraft crashed, and everyone is very happy about it.

Otherwise, Mitchell Clark is kicking off the day with a deeper look at Dish Network’s definitely-real 5G wireless service , and Walmart’s metaverse vision in Roblox is not looking good at all.

External Link
Jess Weatherbed11:49 AM UTC
Won’t anyone think of the billionaires?

Forbes reports that rising inflation and falling stock prices have collectively cost members of the Forbes 400 US rich list $500 billion in 2022 with tech tycoons suffering the biggest losses.

Jeff Bezos (worth $151 billion) lost $50 billion, Google’s Larry Page and Sergey Brin (worth a collective $182b) lost almost $60b, Mark Zuckerberg (worth $57.7b) lost $76.8b, and Twitter co-founder Jack Dorsey (worth $4.5b) lost $10.4b. Former Microsoft CEO Steve Ballmer (worth $83b) lost $13.5b while his ex-boss Bill Gates (worth $106b) lost $28b, albeit $20b of that via charity donations.

Thomas Ricker6:45 AM UTC
Check out this delightful DART Easter egg.

Just Google for “NASA DART.” You’re welcome.

Richard Lawler12:00 AM UTC
A direct strike at 14,000 mph.

The Double Asteroid Redirection Test (DART) scored a hit on the asteroid Dimorphos, but as Mary Beth Griggs explains, the real science work is just beginning.

Now planetary scientists will wait to see how the impact changed the asteroid’s orbit, and to download pictures from DART’s LICIACube satellite which had a front-row seat to the crash.

The Verge
We’re about an hour away from a space crash.

At 7:14PM ET, a NASA spacecraft is going to smash into an asteroid! Coverage of the collision — called the Double Asteroid Redirection Test — is now live.

Emma RothSep 26
There’s a surprise in the sky tonight.

Jupiter will be about 367 million miles away from Earth this evening. While that may seem like a long way, it’s the closest it’s been to our home planet since 1963.

During this time, Jupiter will be visible to the naked eye (but binoculars can help). You can check where and when you can get a glimpse of the gas giant from this website.