Skip to main content

Facebook’s plans to augment reality are as dystopian as they are smart

Facebook’s plans to augment reality are as dystopian as they are smart


Our AR future could be an advertising and social hellscape

Share this story

Mark Zuckerberg Delivers Keynote Address At Facebook F8 Conference
Photo by Justin Sullivan/Getty Images

Gary Shteyngart's Super Sad True Love Story feels more prescient every year. The 2010 dystopian fiction novel imagined a world where holographic, smartphone-like devices called äppäräts project everyone’s personal information all of the time, while a mammoth world-spanning social network called GlobalTeens stratifies society by their looks and net worth.

In Shteyngart's not-too-distant future, everyone is ranked with ludicrous metrics like Hotness and Fuckability, on credit score-esque scales out of 800. Society is forever on the brink of economic collapse, and yet the tech-obsessed populace worries only about its corporate status and the availability of life extension and cosmetic surgery. The novel, which ended up inadvertently predicting Google Glass and even Occupy Wall Street to some extent, now feels like it keeps telling dark truths about the time we live in, seven years after it was published.

Facebook thinks the future of smartphones lies in AR

Take, for instance, Facebook’s recent proclamation that the smartphone camera will be the world’s first ubiquitous augmented reality platform. CEO Mark Zuckerberg explained the vision on Tuesday, during his company’s F8 developer conference, in his well-meaning and rehearsed geniality as a way to merge the digital and the physical in new ways. That’s always been the mission at Facebook: to connect people, digitally, in ways they could never do in the physical realm. With AR, which can overlay virtual images onto our everyday surroundings, this blend of the real and non-real is supposed to bring us new ways to share, communicate, and experience the world.

But AR is also a clear path toward the type of dysfunction Shteyngart so eloquently illustrated in his biting satire. We often hear about virtual reality, and not the augmented variety, as the scary technology on the horizon. It’s easy to look at Ready Player One-inspired fears of escapism, where we all dine on Soylent, never leave our homes, and avoid physical contact for extended periods of time. VR and all of its cyberpunk beginnings also have direct throughlines to The Matrix and other popular forms of speculative dystopian fiction. (I mean, who could forget that disturbing photo of Zuckerberg last year, amid a sea of headset-wearing audience members looking like an army of slavish corporate citizens?)

Photo: Facebook

In fact, I’d argue it’s AR that provides the vastly more real, immediate, and frightening route to dystopian tropes that VR — as an expensive hardware hobby years away from the mainstream — could never yield. Ubiquitous and free-to-use AR built right into our smartphones is fast approaching. That paves the way for aggressive advertising overlaid over every inch of our line of sight, and the kinds of public ranking systems that split society into the have’s and have not’s. You could imagine a future where every inch of wall space becomes an AR canvass for corporate messaging, or Tinder releases an AR add-on powered by facial recognition that lets you identify and swipe on strangers you see on the street.

Facebook didn’t shy away from the marketing opportunities AR provides. In fact, it embraced the idea that you could hover your viewfinder over a restaurant and be told its Yelp rating, or find messages your friends leave you in public locales by peering through the camera lens on Facebook’s app. It seems clear that for every consumer benefit AR provides, there will also be a corporate one designed to exploit our attention, extract our wants and needs, and attempt to sell us products.

Right now, AR is restricted to the silly and playful. We have camera masks that give us cat ears and style transfers that turn selfies into impressionist paintings. But it’s not farfetched to see where it might all be headed in the future, in both expected and unexpected directions.

Facebook VP Deborah Liu shows off an AR concept where a Yelp-style review and a suggestion from a friend are overlaid over a real-life scene.
Facebook VP Deborah Liu shows off an AR concept where a Yelp-style review and a suggestion from a friend are overlaid over a real-life scene.
Photo: Facebook

As my colleague Adi Robertson wrote yesterday, even simple tools like AR makeup seem like such obviously useful applications of the tech that it’s hard to imagine it not taking off and becoming the norm, at least for when you’re using Facebook Live or Snapchat. From there you could imagine a world where it’s hard to tell what or who is even real at any given moment, just like a post-Photoshop world calls into question the veracity of static 2D photography. “Just how much will people be able to doctor the photos that appear in their feeds?” writes BuzzFeed’s Nitasha Tiku. “And will the people who see them know they’ve been manipulated?”

We rate everything these days, including people

Of course, then there’s the ability to augment every object, including another person, with data culled from the internet. We already rate everything these days: the dating apps we use; the contract drivers who take us to work; every meal we eat out; every customer service experience we have. As The Verge’s Josh Dzieza wrote in the fall of 2015, the on-demand economy has turned us into over-sensitive and hypercritical bosses, determining on a whim whether someone’s performance in even the most benign of interactions is worthy of a much-sought-after five-star rating.

Thinking about this and its connections to real AR on the horizon, I’m reminded of “Nosedive.” The unsettling season three premiere episode of Black Mirror showcased a world where every product, service, and life opportunity — where you live, where you work, who your friends are — is dictated by your placement on a 5.0 scale. This number is presented any time someone waves their phone at you. Any sleight, no matter how trivial or imagined, can get you docked a few fractions of a point, the equivalent of a plummet in your credit score, or in Shteyngart's twisted fiction, your Hotness rating.

Photo: Netflix

It was a deeply frightening episode not just because its illustration of society felt so close to reality, but because the hardware and software required did too. “Nosedive” wasn’t imagining a world where we have AR glasses or optical implants. There wasn’t some evil class of corporate elites exploiting consumers for personal gain, or an oppressive government interested in forcing people to conform to a single standard of congenial interaction.

The episode featured just a phone, powered by software that understands what it’s looking at, that nonetheless gets used to reduce people to a face on a screen and a numerical figure. We don’t have to speculate what it would take for this type of tech to arrive in the real world. It’s already here.

Today’s Storystream

Feed refreshed 50 minutes ago Not just you

Emma Roth50 minutes ago
Rihanna’s headlining the Super Bowl Halftime Show.

Apple Music’s set to sponsor the Halftime Show next February, and it’s starting out strong with a performance from Rihanna. I honestly can’t remember which company sponsored the Halftime Show before Pepsi, so it’ll be nice to see how Apple handles the show for Super Bowl LVII.

Emma RothAn hour ago
Starlink is growing.

The Elon Musk-owned satellite internet service, which covers all seven continents including Antarctica, has now made over 1 million user terminals. Musk has big plans for the service, which he hopes to expand to cruise ships, planes, and even school buses.

Musk recently said he’ll sidestep sanctions to activate the service in Iran, where the government put restrictions on communications due to mass protests. He followed through on his promise to bring Starlink to Ukraine at the start of Russia’s invasion, so we’ll have to wait and see if he manages to bring the service to Iran as well.

External Link
Emma Roth5:52 PM UTC
We might not get another Apple event this year.

While Apple was initially expected to hold an event to launch its rumored M2-equipped Macs and iPads in October, Bloomberg’s Mark Gurman predicts Apple will announce its new devices in a series of press releases, website updates, and media briefings instead.

I know that it probably takes a lot of work to put these polished events together, but if Apple does pass on it this year, I will kind of miss vibing to the livestream’s music and seeing all the new products get presented.

External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.

Welcome to the new Verge

Revolutionizing the media with blog posts

Nilay PatelSep 13
Andrew WebsterSep 24
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.

The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.

Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.

External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.