Skip to main content

Microsoft to retire controversial facial recognition tool that claims to identify emotion

Microsoft to retire controversial facial recognition tool that claims to identify emotion

/

AI-powered ‘emotion recognition’ has been criticized as unscientific

Share this story

If you buy something from a Verge link, Vox Media may earn a commission. See our ethics statement.

Image: Microsoft

Microsoft is phasing out public access to a number of AI-powered facial analysis tools — including one that claims to identify a subject’s emotion from videos and pictures.

Such “emotion recognition” tools have been criticized by experts. They say not only do facial expressions that are thought to be universal differ across different populations but that it is unscientific to equate external displays of emotion with internal feelings.

“Companies can say whatever they want, but the data are clear,” Lisa Feldman Barrett, a professor of psychology at Northeastern University who conducted a review into the subject of AI-powered emotion recognition, told The Verge in 2019. “They can detect a scowl, but that’s not the same thing as detecting anger.”

“They can detect a scowl, but that’s not the same thing as detecting anger.”

The decision is part of a larger overhaul of Microsoft’s AI ethics policies. The company’s updated Responsible AI Standards (first outlined in 2019) emphasize accountability to find out who uses its services and greater human oversight into where these tools are applied.

The Verge’s new docuseries, The Future Of — where we explore how technology will change everything — is now streaming on Netflix. Watch it here!

In practical terms, this means Microsoft will limit access to some features of its facial recognition services (known as Azure Face) and remove others entirely. Users will have to apply to use Azure Face for facial identification, for example, telling Microsoft exactly how and where they’ll be deploying its systems. Some use cases with less harmful potential (like automatically blurring faces in images and videos) will remain open-access.

In addition to removing public access to its emotion recognition tool, Microsoft is also retiring Azure Face’s ability to identify “attributes such as gender, age, smile, facial hair, hair, and makeup.”

“Experts inside and outside the company have highlighted the lack of scientific consensus on the definition of ‘emotions,’ the challenges in how inferences generalize across use cases, regions, and demographics, and the heightened privacy concerns around this type of capability,” wrote Microsoft’s chief responsible AI officer, Natasha Crampton, in a blog post announcing the news.

Microsoft says that it will stop offering these features to new customers from today, June 21st, while existing customers will have their access revoked on June 30th, 2023.

Microsoft’s Seeing AI app will still offer emotion recognition

However, while Microsoft is retiring public access to these features, it will continue using them in at least one of its own products: an app named Seeing AI that uses machine vision to describe the world for people with visual impairments.

In a blog post, Microsoft’s principal group product manager for Azure AI, Sarah Bird, said that tools such as emotion recognition “can be valuable when used for a set of controlled accessibility scenarios.” It’s not clear if these tools will be used in any other Microsoft products.

Microsoft is also introducing similar restrictions to its Custom Neural Voice feature, which lets customers create AI voices based on recordings of real people (sometimes known as an audio deepfake).

The tool “has exciting potential in education, accessibility, and entertainment,” writes Bird, but she notes that it “is also easy to imagine how it could be used to inappropriately impersonate speakers and deceive listeners.” Microsoft says that in the future, it will limit access to the feature to “managed customers and partners” and “ensure the active participation of the speaker when creating a synthetic voice.”

Today’s Storystream

Feed refreshed 5:33 PM UTC Striking out

A
Youtube
Andrew Webster5:33 PM UTC
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.


A
The Verge
Andrew Webster4:28 PM UTC
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.


J
Twitter
Jay PetersSep 23
Twitch’s creators SVP is leaving the company.

Constance Knight, Twitch’s senior vice president of global creators, is leaving for a new opportunity, according to Bloomberg’s Cecilia D’Anastasio. Knight shared her departure with staff on the same day Twitch announced impending cuts to how much its biggest streamers will earn from subscriptions.


T
Twitter
Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.


A
External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.


A
External Link
Ford is running out of its own Blue Oval badges.

Running out of semiconductors is one thing, but running out of your own iconic nameplates is just downright brutal. The Wall Street Journal reports badge and nameplate shortages are impacting the automaker's popular F-series pickup lineup, delaying deliveries and causing general chaos.

Some executives are even proposing a 3D printing workaround, but they didn’t feel like the substitutes would clear the bar. All in all, it's been a dreadful summer of supply chain setbacks for Ford, leading the company to reorganize its org chart to bring some sort of relief.


E
TikTok
Spain’s Transports Urbans de Sabadell has La Bussí.

Once again, the US has fallen behind in transportation — call it the Bussí gap. A hole in our infrastructure, if you will.


J
External Link
Jay PetersSep 23
Doing more with less (extravagant holiday parties).

Sundar Pichai addressed employees’ questions about Google’s spending changes at an all-hands this week, according to CNBC.

“Maybe you were planning on hiring six more people but maybe you are going to have to do with four and how are you going to make that happen?” Pichai sent a memo to workers in July about a hiring slowdown.

In the all-hands, Google’s head of finance also asked staff to try not to go “over the top” for holiday parties.


E
External Link
Insiders made the most money off of Helium’s “People’s Network.”

Remember Helium, which was touted by The New York Times in an article entitled “Maybe There’s a Use for Crypto After All?” Not only was the company misleading people about who used it — Salesforce and Lime weren’t using it, despite what Helium said on its site — Helium disproportionately enriched insiders, Forbes reports.