Skip to main content

YouTube’s ‘dislike’ and ‘not interested’ buttons barely work, study finds

YouTube’s ‘dislike’ and ‘not interested’ buttons barely work, study finds

/

A Mozilla report found feedback buttons didn’t stop the majority of similar recommendations

Share this story

YouTube’s logo with geometric design in the background
Illustration by Alex Castro / The Verge

Even when users tell YouTube they aren’t interested in certain types of videos, similar recommendations keep coming, a new study by Mozilla found.

Using video recommendations data from more than 20,000 YouTube users, Mozilla researchers found that buttons like “not interested,” “dislike,” “stop recommending channel,” and “remove from watch history” are largely ineffective at preventing similar content from being recommended. Even at their best, these buttons still allow through more than half the recommendations similar to what a user said they weren’t interested in, the report found. At their worst, the buttons barely made a dent in blocking similar videos.

To collect data from real videos and users, Mozilla researchers enlisted volunteers who used the foundation’s RegretsReporter, a browser extension that overlays a general “stop recommending” button to YouTube videos viewed by participants. On the back end, users were randomly assigned a group, so different signals were sent to YouTube each time they clicked the button placed by Mozilla — dislike, not interested, don’t recommend channel, remove from history, and a control group for whom no feedback was sent to the platform.

Using data collected from over 500 million recommended videos, research assistants created over 44,000 pairs of videos — one “rejected” video, plus a video subsequently recommended by YouTube. Researchers then assessed pairs themselves or used machine learning to decide whether the recommendation was too similar to the video a user rejected.

Compared to the baseline control group, sending the “dislike” and “not interested” signals were only “marginally effective” at preventing bad recommendations, preventing 12 percent of 11 percent of bad recommendations, respectively. “Don’t recommend channel” and “remove from history” buttons were slightly more effective — they prevented 43 percent and 29 percent of bad recommendations — but researchers say the tools offered by the platform are still inadequate for steering away unwanted content.

“YouTube should respect the feedback users share about their experience, treating them as meaningful signals about how people want to spend their time on the platform,” researchers write.

YouTube spokesperson Elena Hernandez says these behaviors are intentional because the platform doesn’t try to block all content related to a topic. But Hernandez criticized the report, saying it doesn’t consider how YouTube’s controls are designed.

“Importantly, our controls do not filter out entire topics or viewpoints, as this could have negative effects for viewers, like creating echo chambers,” Hernandez told The Verge. “We welcome academic research on our platform, which is why we recently expanded Data API access through our YouTube Researcher Program. Mozilla’s report doesn’t take into account how our systems actually work, and therefore it’s difficult for us to glean many insights.” 

Hernandez says Mozilla’s definition of “similar” fails to consider how YouTube’s recommendation system works. The “not interested” option removes a specific video, and the “don’t recommend channel” button prevents the channel from being recommended in the future, Hernandez says. The company says it doesn’t seek to stop recommendations of all content related to a topic, opinion, or speaker.

Besides YouTube, other platforms like TikTok and Instagram have introduced more and more feedback tools for users to train the algorithm, supposedly, to show them relevant content. But users often complain that even when flagging that they don’t want to see something, similar recommendations persist. It’s not always clear what different controls actually do, Mozilla researcher Becca Ricks says, and platforms aren’t transparent about how feedback is taken into account.

“I think that in the case of YouTube, the platform is balancing user engagement with user satisfaction, which is ultimately a tradeoff between recommending content that leads people to spend more time on the site and content the algorithm thinks people will like,” Ricks told The Verge via email. “The platform has the power to tweak which of these signals get the most weight in its algorithm, but our study suggests that user feedback may not always be the most important one.”

Today’s Storystream

Feed refreshed 16 minutes ago Striking out

A
The Verge
Andrew Webster16 minutes ago
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.


A
Andrew Webster1:05 PM UTC
Looking for something to do this weekend?

Why not hang out on the couch playing video games and watching TV. It’s a good time for it, with intriguing recent releases like Return to Monkey Island, Session: Skate Sim, and the Star Wars spinoff Andor. Or you could check out some of the new anime on Netflix, including Thermae Romae Novae (pictured below), which is my personal favorite time-traveling story about bathing.


A screenshot from the Netflix anime Thermae Romae Novae.
Thermae Romae Novae.
Image: Netflix
J
Twitter
Jay PetersSep 23
Twitch’s creators SVP is leaving the company.

Constance Knight, Twitch’s senior vice president of global creators, is leaving for a new opportunity, according to Bloomberg’s Cecilia D’Anastasio. Knight shared her departure with staff on the same day Twitch announced impending cuts to how much its biggest streamers will earn from subscriptions.


T
Twitter
Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.


A
External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.


A
External Link
Ford is running out of its own Blue Oval badges.

Running out of semiconductors is one thing, but running out of your own iconic nameplates is just downright brutal. The Wall Street Journal reports badge and nameplate shortages are impacting the automaker's popular F-series pickup lineup, delaying deliveries and causing general chaos.

Some executives are even proposing a 3D printing workaround, but they didn’t feel like the substitutes would clear the bar. All in all, it's been a dreadful summer of supply chain setbacks for Ford, leading the company to reorganize its org chart to bring some sort of relief.


E
TikTok
Spain’s Transports Urbans de Sabadell has La Bussí.

Once again, the US has fallen behind in transportation — call it the Bussí gap. A hole in our infrastructure, if you will.


J
External Link
Jay PetersSep 23
Doing more with less (extravagant holiday parties).

Sundar Pichai addressed employees’ questions about Google’s spending changes at an all-hands this week, according to CNBC.

“Maybe you were planning on hiring six more people but maybe you are going to have to do with four and how are you going to make that happen?” Pichai sent a memo to workers in July about a hiring slowdown.

In the all-hands, Google’s head of finance also asked staff to try not to go “over the top” for holiday parties.


E
External Link
Insiders made the most money off of Helium’s “People’s Network.”

Remember Helium, which was touted by The New York Times in an article entitled “Maybe There’s a Use for Crypto After All?” Not only was the company misleading people about who used it — Salesforce and Lime weren’t using it, despite what Helium said on its site — Helium disproportionately enriched insiders, Forbes reports.


J
Youtube
James VincentSep 23
Nvidia’s latest AI model generates endless 3D models.

Need to fill your video game, VR world, or project render with 3D chaff? Nvidia’s latest AI model could help. Trained on 2D images, it can churn out customizable 3D objects ready to import and tweak.

The model seems rudimentary (the renders aren’t amazing quality and seem limited in their variety), but generative AI models like this are only going to improve, speeding up work for all sorts of creative types.