Skip to main content

Microsoft won’t sell facial recognition to police until Congress passes new privacy law

Microsoft won’t sell facial recognition to police until Congress passes new privacy law


Following a similar pledge from Amazon yesterday

Share this story

Illustration by Alex Castro / The Verge

Microsoft has followed competitors Amazon and IBM in restricting how it provides facial recognition technology to third parties, in particular to law enforcement agencies. The company says that it does not currently provide the technology to police, but it’s now saying it will not do so until there are federal laws governing how it can be deployed safely and without infringing on human rights or civil liberties.

IBM said earlier this week it will outright cease all sales, development, and research of the controversial tech. Amazon on Wednesday said it would stop providing it to police for one year to give Congress time to put in place “stronger regulations to govern the ethical use of facial recognition technology.”

Microsoft president Brad Smith most closely echoed Amazon’s stance on Thursday in outlining the company’s new approach to facial recognition: not ruling out that it will one day sell the tech to police but calling for regulation first.

“As a result of the principles that we’ve put in place, we do not sell facial recognition technology to police departments in the United States today,” Smith told The Washington Post. “But I do think this is a moment in time that really calls on us to listen more, to learn more, and most importantly, to do more. Given that, we’ve decided that we will not sell facial recognition to police departments in the United States until we have a national law in place ground in human rights that will govern this technology.”

Smith said Microsoft would also “put in place some additional review factors so that we’re looking into other potential uses of the technology that goes even beyond what we already have.” That seems to indicate Microsoft may still provide facial recognition to human rights groups to combat trafficking and other abuses, as Amazon said it would continue doing with its Rekognition platform.

“We will not sell facial recognition to police departments until we have a national law in place ground in human rights.”

Amid ongoing protests around the US and the world against racism and police brutality and a national conversation about racial injustice, the tech industry is reckoning with its own role in providing law enforcement agencies with unregulated, potentially racially biased technology.

Research has shown facial recognition systems, due to being trained using data sets composed of mostly white males, have significant trouble identifying darker-skinned people and even determining the gender of such individuals. Artificial intelligence researchers, activists, and lawmakers have for years sounded the alarm about selling the technology to police, warning not just against racial bias, but also human rights and privacy violations inherent in a technology that could contribute to the rise of surveillance states.

While Microsoft has previously sold police departments access to such technology, the company has taken a more principled approach since. Last year, Microsoft denied California law enforcement access to its facial recognition tech out of concern for human rights violations. It also announced it would no longer invest in third-party firms developing the tech back in March, following accusations that an Israeli startup Microsoft invested in provided the technology to the Israel government for spying on Palestinians. (Microsoft later declared that its internal investigation found that the company, AnyVision, “has not previously and does not currently power a mass surveillance program in the West Bank,” but it divested from the company nonetheless.)

Microsoft has been a vocal supporter of federal regulation that would dictate how such systems can be used and what protections will be in place to protect privacy and guard against discrimination. Smith himself has been publicly expressing concerns over the dangers of unregulated facial recognition since at least 2018. But the company was also caught last year providing a facial recognition dataset of more than 10 million faces, including images of many people who were not aware of and did not consent to their participation in the dataset. The company pulled the dataset offline only after a Financial Times investigation.

According to the American Civil Liberties Union (ACLU), Microsoft, as recently as this year, supported legislation in California that would allow police departments and private companies to purchase and use such systems. That’s following laws in San Francisco, Oakland, and other Californian cities that banned use of the technology by police and governments last year. The bill, AB 2261, failed last week, in a victory for the ACLU and coalition of 65 organizations that came together to combat it.

Matt Cagle, the ACLU’s technology and civil liberties attorney with its Northern California branch, released this statement on Thursday regarding Microsoft’s decision:

When even the makers of face recognition refuse to sell this surveillance technology because it is so dangerous, lawmakers can no longer deny the threats to our rights and liberties. Congress and legislatures nationwide must swiftly stop law enforcement use of face recognition, and companies like Microsoft should work with the civil rights community — not against it — to make that happen. This includes halting its current efforts to advance legislation that would legitimize and expand the police use of facial recognition in multiple states nationwide.

It should not have taken the police killings of George Floyd, Breonna Taylor, and far too many other Black people, hundred of thousands of people taking to the streets, brutal law enforcement attacks against protesters and journalists, and the deployment of military-grade surveillance equipment on protests led by Black activists for these companies to wake up to the everyday realities of police surveillance for Black and Brown communities. We welcome these companies finally taking action — as little and as late as it may be. We also urge these companies to work to forever shut the door on America’s sordid chapter of over-policing of Black and Brown communities, including the surveillance technologies that disproportionately harm them.

No company backed bill should be taken seriously unless the communities most impacted say it is the right solution.

Today’s Storystream

Feed refreshed Sep 25 Not just you

Emma RothSep 25
Rihanna’s headlining the Super Bowl Halftime Show.

Apple Music’s set to sponsor the Halftime Show next February, and it’s starting out strong with a performance from Rihanna. I honestly can’t remember which company sponsored the Halftime Show before Pepsi, so it’ll be nice to see how Apple handles the show for Super Bowl LVII.

Emma RothSep 25
Starlink is growing.

The Elon Musk-owned satellite internet service, which covers all seven continents including Antarctica, has now made over 1 million user terminals. Musk has big plans for the service, which he hopes to expand to cruise ships, planes, and even school buses.

Musk recently said he’ll sidestep sanctions to activate the service in Iran, where the government put restrictions on communications due to mass protests. He followed through on his promise to bring Starlink to Ukraine at the start of Russia’s invasion, so we’ll have to wait and see if he manages to bring the service to Iran as well.

External Link
Emma RothSep 25
We might not get another Apple event this year.

While Apple was initially expected to hold an event to launch its rumored M2-equipped Macs and iPads in October, Bloomberg’s Mark Gurman predicts Apple will announce its new devices in a series of press releases, website updates, and media briefings instead.

I know that it probably takes a lot of work to put these polished events together, but if Apple does pass on it this year, I will kind of miss vibing to the livestream’s music and seeing all the new products get presented.

External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.

Welcome to the new Verge

Revolutionizing the media with blog posts

Nilay PatelSep 13
Andrew WebsterSep 24
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.

The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.

Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.