One of the core subjects I cover is the still-emerging field that tech companies call trust and safety. Most of the time, it’s safety that grabs the headlines: hate speech on Facebook; Apple scanning devices for images of child abuse; COVID misinformation on YouTube. Today I want to talk about the trust side of the equation — specifically how platforms verify profiles. More specifically, why they should verify your profiles, if you want them to. No matter who you are.
Verification might seem like a dry subject, but those little checkmarks mean a lot to people. (You learn this once you get your checkmark, and friends and family immediately start asking how they can get theirs, too.)
They also wind up embarrassing online platforms on a regular basis.
Twitter hadn’t anticipated the authenticity of rank-and-file workers would ever be up for scrutiny
In April, I wrote about the case of Amazon’s Twitter army. At the height of Amazon’s labor battle in Bessemer, Alabama, there was no way to distinguish between workers who actually represented Amazon, and those who were posting satirically. Twitter’s verification program, which it had just spent three years overhauling, had not anticipated a case in which the authenticity of rank-and-file workers would ever be up for scrutiny.
Twitter is halting the expansion of its verification program, saying it needs to work on the application and review process that lets people into the blue check mark club. This change, where Twitter won’t be letting new people apply for verification, is coming after Twitter admitted that several fake accounts, which reportedly seemed to be part of a botnet, were incorrectly verified. […]
This isn’t the first time Twitter has paused its verification program — it put the public process on hold in 2017, after it received backlash for verifying one of the organizers behind the Unite The Right rally in Charlottesville. It brought back a revamped version in 2021 — and paused it a week later due to an avalanche of requests.
Baked into Twitter’s approach is the idea that verification should be rare and precious — reserved for “notable” accounts only. Facebook and Instagram take a similar approach. One of my core beliefs is that reserving verification for “notable” accounts actually reduces trust in networks overall. it reserves special privileges for elites — like customer service — that should be available to all; it confers moral authority on whoever manages to get a checkmark, even if they are one of the worst actors on the network; and, of course, It breeds contempt between regular users and “bluechecks.”
Now, maybe at this point you’re saying: great, thanks Casey. Another intractable platform problem that shall haunt us as long as we live. Not so! For another platform has tackled the problem of user authenticity in a totally different way, and the results have been … pretty great.
The platform is Tinder, Match Group’s popular dating app. In April I wrote about the app’s move last year to let anyone verify their account by sending in a few selfies:
Upon request, Tinder sends the user a picture of a model performing specific poses. Users take selfies in the poses shown and submit them to Tinder; photos are reviewed by its community team. If the user’s poses match the model’s, they get a blue checkmark. The process takes about a day.
Catfishing remains a significant problem on dating apps, so self-serve verification like this addresses an obvious problem. And while a blue checkmark on Tinder doesn’t tell you everything you need to know about a potential date, it dramatically increases the odds that the person you’re talking to at least looks like their picture. The benefits are significant enough that, from what I can tell, the majority of Tinder users in my area have now verified their profiles.
Tinder could have stopped there. But executives noted that their approach to verification was limited in one significant way: a significant number of Tinder users do not display images of themselves for safety reasons — particularly women and LGBTQ+ people outside of the United States. Many of these users could still benefit from verifying that they are authentic human beings looking for romance and friendship, and not bots or scammers. But if they declined to upload photos of themselves, how could they?
This week, Tinder said it is developing a solution to that problem. The company is preparing to release a second, complementary form of verification for users who don’t want to show their face. Instead of verifying a user’s identity via photos, Tinder will ask them for another form of verification — a drivers’ license, for example. (The company said it would “take into consideration expert recommendations, input from our members, what documents are most appropriate in each country, and local laws and regulations, as it determines how the feature will roll out.”)
Many users could benefit from verifying they are authentic human beings, not bots or scammers
“An ID verification offers that person a way to say, I’ve proven to Tinder that I’m real, without having to necessarily show their face if that’s something you’re not comfortable doing,” said Rory Kozoll, head of trust and safety product at Tinder, in an interview.
The feature is still in development, and there is no timeline for its release (beyond “in the coming quarters”). But Tinder has been testing ID verification in Japan since 2019, and the company says it has worked well enough there that it is planning to release it globally. When that happens, you could choose to verify yourself both through your photos and your ID, with both checks appearing on your profile. (The company hasn’t decided exactly how it will represent this visually on the profile.) And as Tinder gets more and more people to participate, trust in its network will increase.
“We’ve heard from customers from the beginning that authenticity was the biggest issue they had,” said Kozoll, who joined Tinder four years ago. “Just knowing: is this person who they say they are?”
The company declined to tell me how many people have chosen to verify their profiles, but said it’s by far the most popular safety-related feature the company has introduced to date. Tinder also said verified profiles are more likely to “have success” on Tinder — more matches, more conversations. It’s also helping the company counter the perception that its app, like any dating app, is overrun with catfish.
“We’re definitely starting to see in our survey data and qualitative research that people are turning the corner on that,” Kozoll said. “Starting to feel like more of the people they see on Tinder are real. And we can correlate it with the introduction and adoption of photo verification.”
Kozoll told me that, as on Twitter, users are sometimes verified even when they don’t match. But “the volume is extremely low, almost to be statistically insignificant,” he said.
In any case, he said, the benefits to verifying anyone who asks have outweighed the risks of the occasional false positive.
“Starting to feel like more of the people they see on Tinder are real”
Looking at Tinder’s success here, I can’t help but wonder what would happen if Facebook, Instagram, Twitter, or even YouTube took a similar approach. (You need 100,000 subscribers to request verification on YouTube.) Photo verification could help platforms sort out human beings from bots — an increasingly urgent need in a world where images generated by artificial intelligence can often fool the naked eye. ID verification could help people prove their authenticity even if they aren’t considered notable figures.
I’d also love to see platforms let people optionally verify their employers through an email address, so we’d know if all those scientists, academics, and law enforcement officers are who they say they are, whenever events conspire to bring them into the daily news cycle.
I asked Kozoll to what extent he thought Tinder’s verification measures could be adopted by the industry at large.
“I don’t want to presume to know more about other businesses than they do,” he said. “But I think what we’re doing today is a viable approach for dating apps.” He noted that Tinder’s ideas here are not totally original — the company took inspiration from gig economy startups that require drivers to verify their photos in a similar way.
“I think businesses that are bringing people together in real life … have more interest in making sure that those people have a higher level of authenticity,” he said. “The same rules may apply more broadly in social media, but I understand the concerns around free speech and anonymity.”
But the key lesson from Tinder is that verification doesn’t have to be a binary, yes-or-no choice. Platforms can choose to let users verify aspects of their identity in different ways, granting different badges or other benefits based on what people choose to share. If they do, I imagine they’ll see what Tinder did: a network where, over time, more people come to trust one another.
In the meantime, you’re likely to be able to verify yourself twice on Tinder before you can do it once anywhere else. As Twitter reconsiders how to verify its user base yet again, Tinder has offered it a compelling roadmap. Here’s hoping Twitter swipes it.
This column was co-published with Platformer, a daily newsletter about Big Tech and democracy.