Skip to main content

Can a YouTube ad change your mind about disinformation?

Can a YouTube ad change your mind about disinformation?

/

Maybe — for a little while

Share this story

A screenshot of an angry cartoon man
A screenshot from a video “prebunking” appeals to emotion.
Image: Inoculation Science

“Prebunking” false information with short videos could nudge people to be more critical of it, suggests a new study from researchers at the University of Cambridge and Google’s Jigsaw division. The study is part of ongoing work in the field of mis- and disinformation, and it’s encouraging news for researchers hoping to improve the online information ecosystem — albeit with many caveats.

The Jigsaw and Cambridge study — which also involved researchers from the University of Bristol and the University of Western Australia, Perth — is one of several attempts to “inoculate” or “prebunk” people against disinformation instead of debunking it after the fact. Published in Science Advances, it recounts the impact of a video series about common tactics often used to spread false information, including scapegoating, false dichotomies, and appeals to emotion.

The roughly 90-second videos didn’t discuss specific false narratives or whether a given piece of information was factual. They typically used absurd or funny examples drawn from pop culture, including Family Guy or Star Wars. (Anakin Skywalker’s claim that “if you’re not with me, then you’re my enemy” is a classic false dichotomy.) The goal was to highlight red flags that might short-circuit people’s critical evaluation of a social media post or video, then to see if that translated into wider recognition of those tactics. Avoiding factual claims also meant viewers weren’t judging whether they trusted the source of those facts.

“We wanted to remove any of the possible politicization that has sort of been confounding the question,” says Jigsaw head of research and development Beth Goldberg.

Prebunking has been promoted as an anti-misinformation strategy for years, especially after research suggested that fact-checking and corrections might not change people’s minds and can even backfire. (Some of this research is disputed.) But as with other tactics, researchers are still in the early stages of measuring its effectiveness, particularly on social media.

Here, the study found encouraging results. In five controlled studies involving 5,000 participants recruited online, people watched either one of the prebunking videos or a neutral video of a similar length. Then, they were shown fake social media posts, some of which used the tactic in the video. People who had seen the videos were overall significantly better at judging whether these posts used the manipulation tactic, and they were significantly less likely to say they’d share them.

“The framing around self-defense ... really resonates on both sides of the political aisle”

The team also conducted a larger study (of around 22,000 people) on the Google-owned platform YouTube. They purchased ad space to show prebunking in front of random videos. Within 24 hours, they followed up with questions similar to the ones described above, judging people’s ability to recognize manipulation tactics. As before, the viewers performed better than a control group but, this time, with a longer gap after watching the video — the median was about 18 hours.

Future research is designed to push that timeline further, seeing how long the effects of the “inoculation” last. Jigsaw also wants to test videos that address specific topics, like false narratives about refugees in Europe. And because this research was conducted in the US, future studies will need to test whether other groups respond to the videos. “The framing around self-defense — someone else is trying to manipulate you, you need to equip yourself and defend yourself — really resonates on both sides of the political aisle” in the US, says Goldberg. “You can really see that tapping into this American individualism.” That doesn’t necessarily generalize to a global scope.

“We were paying folks to pay attention”

Interestingly, the study’s results seemed independent of people’s predisposition toward conspiracy theories or political polarization. In the controlled studies, participants took surveys evaluating these and other qualities, but the results didn’t correlate with their performance. “I would have anticipated that a high conspiracy mentality means that you would be bad at discerning things like fear-mongering,” says Goldberg.

One possible explanation is that their study stripped out the signals — like specific sources or political topics — that triggered conspiratorial or polarized thinking. Another is simpler: “I think in part, we were paying folks to pay attention,” says Goldberg.

Cambridge researchers have made earlier findings suggesting that prebunking might work, including a study built on a pandemic-themed game called Go Viral! The recent study demonstrates the potential effects of shorter, simpler interventions. But it also comes with significant limits. Even within the study, some videos were more effective than others: the video on scapegoating and another on incoherence, for instance, didn’t change people’s willingness to share posts using those tactics. Outside this particular experiment, the group is still evaluating how long people might retain the lessons they’d learned.

And the group is still far from testing whether prebunking will make people critically evaluate information they want to believe from sources they like — which is how a lot of false information spreads across social media. “The Holy Grail will be: can we actually measure, in the moment, if you’re able to apply that prebunking lesson and recall it a week later when you see Alex Jones using emotional language?” says Goldberg. “I’m not sure that we will get significantly closer in the near term.” But for now, the work opens the door to more research on whether a misinformation vaccine makes sense.

Today’s Storystream

Feed refreshed Two hours ago Midjourneys

A
Youtube
Alex CranzTwo hours ago
After DART smashed into Dimorphos, I can’t stop thinking about the best “blow up an asteroid” story.

LucasArts and Steven Spielberg came up with The Dig, a game about an astronaut, scientist, and journalist blowing up an asteroid and finding a spaceship inside, and they did it years before Bruce Willis, or NASA. You can still buy and play it on Steam!


R
Instagram
Richard LawlerTwo hours ago
Everything looks better in slow motion.

Apple’s Dynamic Island alert system isn’t sitting still around your iPhone 14’s front-facing camera array. We’ve been enjoying its contextual animations — and even an Android copycat — since it was unveiled, but take a look at it here, captured at 240fps, to see exactly how iOS applies animations that make it feel a bit more lively.


R
External Link
Russell Brandom5:47 PM UTC
Oracle will pay $23 million to settle foreign bribery charges.

The SEC alleges that Oracle used a slush fund to bribe officials in India, Turkey and the United Arab Emirates.

This behavior is sadly common among software companies doing business overseas, and it’s not unique to Oracle. In March, a former Microsoft executive claimed the company spent as much as $200 million a year in bribes for foreign officials.


Asian America learns how to hit back

The desperate, confused, righteous campaign to stop Asian hate

Esther WangSep 26
E
External Link
Emma Roth3:16 PM UTC
Celsius’ CEO is out.

Alex Mashinsky, the head of the bankrupt crypto lending firm Celsius, announced his resignation today, but not after patting himself on the back for working “tirelessly to help the company.”

In Mashinsky’s eyes, I guess that means designing “Unbankrupt yourself” t-shirts on Cafepress and then selling them to a user base that just had their funds vaporized.

At least customers of the embattled Voyager Digital crypto firm are in slightly better shape, as the Sam Bankman-Fried-owned FTX just bought out the company’s assets.


M
Twitter
Mary Beth Griggs2:46 PM UTC
NASA’s SLS rocket is secure as Hurricane Ian barrels towards Florida.

The rocket — and the Orion spacecraft on top — are now back inside the massive Vehicle Assembly Building. Facing menacing forecasts, NASA decided to roll it away from the launchpad yesterday.


A
External Link
Andrew J. Hawkins1:30 PM UTC
Harley-Davidson’s electric motorcycle brand is about to go public via SPAC

LiveWire has completed its merger with a blank-check company and will make its debut on the New York Stock Exchange today. Harley-Davison CEO Jochen Zeitz called it “a proud and exciting milestone for LiveWire towards its ambition to become the most desirable electric motorcycle brand in the world.” Hopefully it also manages to avoid the cash crunch of other EV SPACs, like Canoo, Arrival, Faraday Future, and Lordstown.


A
The Verge
Andrew Webster1:06 PM UTC
“There’s an endless array of drama going on surrounding Twitch right now.”

That’s Ryan Morrison, CEO of Evolved Talent Agency, which represents some of the biggest streamers around. And he’s right — as you can read in this investigation from my colleague Ash Parrish, who looked into just what’s going on with Amazon’s livestreaming service.


R
The Verge
Richard Lawler12:59 PM UTC
Green light.

NASA’s spacecraft crashed, and everyone is very happy about it.

Otherwise, Mitchell Clark is kicking off the day with a deeper look at Dish Network’s definitely-real 5G wireless service , and Walmart’s metaverse vision in Roblox is not looking good at all.


J
External Link
Jess Weatherbed11:49 AM UTC
Won’t anyone think of the billionaires?

Forbes reports that rising inflation and falling stock prices have collectively cost members of the Forbes 400 US rich list $500 billion in 2022 with tech tycoons suffering the biggest losses.

Jeff Bezos (worth $151 billion) lost $50 billion, Google’s Larry Page and Sergey Brin (worth a collective $182b) lost almost $60b, Mark Zuckerberg (worth $57.7b) lost $76.8b, and Twitter co-founder Jack Dorsey (worth $4.5b) lost $10.4b. Former Microsoft CEO Steve Ballmer (worth $83b) lost $13.5b while his ex-boss Bill Gates (worth $106b) lost $28b, albeit $20b of that via charity donations.