Skip to main content

Mark Zuckerberg has so many VR headset prototypes to show us

And none of them are shipping

Share this story

Mark Zuckerberg trying on a black VR headset prototype, surrounded by other headsets
Mark Zuckerberg tries on the Holocake 2 prototype.
Meta Reality Labs

Meta’s Reality Labs division has revealed new prototypes in its roadmap toward lightweight, hyper-realistic virtual reality graphics. The breakthroughs remain far from consumer-ready, but the designs — codenamed Butterscotch, Starburst, Holocake 2, and Mirror Lake — could add up to a slender, brightly lit headset that supports finer detail than its current Quest 2 display.

Meta CEO Mark Zuckerberg and Reality Labs chief scientist Michael Abrash, along with other Reality Labs members, presented their work at a virtual roundtable last week. The event focused on designs that Meta refers to as “time machines”: bulky proofs of concept meant for testing one specific feature, like a super-bright backlight or super-high-resolution screen. “I think we’re in the middle right now of a big step forward towards realism,” Zuckerberg told reporters. “I don’t think it’s going to be that long until we can create scenes with basically perfect fidelity.” Display tech isn’t the only unsolved piece of that puzzle, but it’s an area where Meta’s intensive VR hardware research gives it a leg up.

A wall of prototype designs from Meta Reality Labs
A wall of prototype designs from Meta Reality Labs

Zuckerberg reiterated plans to ship a high-end headset codenamed Project Cambria in 2022, following its initial announcement last year. Cambria supports full VR as well as mixed reality, thanks to high-resolution cameras that can pass a video feed to an internal screen. It will also ship with eye tracking, a key feature for future Meta headsets. From there, Zuckerberg says Meta is planning two lines of VR headsets: one that will remain cheap and consumer-focused, like today’s Quest 2, and one that will incorporate the company’s newest technology, aimed at a “prosumer or professional-grade” market. That tracks with reports that the company is already planning updates to Cambria and the Quest 2, although those prototypes weren’t discussed on the call.

A black VR headset with a custom high-resolution display.
The Butterscotch high-definition headset prototype.

Meta’s VR headsets sit alongside a separate lineup of augmented reality smart glasses, which are meant to project images onto the real world instead of blocking it with a screen. Meta recently scaled back the launch of its first-generation AR glasses, and in general, VR screens have reached consumers much faster than AR holograms. But Meta’s prototypes demonstrate how far the company thinks it has left to go.

Butterscotch is an attempt at a near-retina-quality headset display — something you can find in high-end headsets from companies like Varjo, but not the current Meta lineup. The design is “nowhere near shippable” and required roughly halving the Meta Quest 2’s 110-degree field of view. But it offers about 2.5 times the resolution of the Quest 2’s (sort of) 1832 x 1920 pixels per eye, letting users read the 20/20 vision line on an eye chart. Zuckerberg says it offers about 55 pixels per field-of-view degree, slightly short of Meta’s 60-pixel-per-degree retina standard and a bit lower than Varjo’s 64 pixels per degree.

A bulky binoculars-style VR headset.
The Starburst headset prototype.

Starburst is even less shippable than Butterscotch but tests a similarly impressive upgrade. The bulky design uses a powerful lamp — requiring handles to support its weight — and produces high dynamic range (HDR) lighting with 20,000 nits of brightness. “This one is wildly impractical to consider as a product direction for the first generation, but we’re using it as a testbed for further research and studies,” says Zuckerberg. “The goal of all this work is to help us identify which technical paths are going to allow us to make meaningful enough improvements that we can start approaching visual realism.”

“The jury is still out on a suitable laser source.”

Holocake 2 moves in the opposite direction, exploring Meta’s options for making VR headsets thinner and lighter. It’s the successor to a 2020 design built on holographic optics, a light-bending technique that lets a nearly flat panel stand in for a thick refractive lens. The result could be as thin as sunglasses, but Meta is still working on developing a self-contained light source that would power them — almost certainly a laser, not the OLEDs commonly used today. “We’ll need to do a lot of engineering to achieve a consumer-viable laser that meets our specs: that’s safe, low-cost, and efficient, and that can fit a slim VR headset,” says Zuckerberg. “Honestly, as of today, the jury is still out on a suitable laser source.”

The presentation also discussed Half Dome, a long-running series of prototypes that can shift focal planes depending on where users are looking. These varifocal optics began as a clunky mechanical system in 2017 and later switched to an array of liquid crystal lenses, and according to internal Meta research, they can create a more convincing (and physically comfortable) illusion of depth in VR.

A thin VR headset prototype seen from the side
The Holocake 2 prototype.

Meta described Half Dome’s tech as “almost ready for prime time” back in 2020, but today, Zuckerberg was more measured. “This stuff is pretty far off,” he said in response to a question about the “prime time” comment. “We’re working on it, we really want to get it into one of the upcoming headsets, I’m confident that we will at some point, but I’m not going to pre-announce anything today.”

Reality Labs will discuss more research, including how to more accurately capture real-world footage for mixed reality, at August’s SIGGRAPH tradeshow.

The designs above exist as actual hardware that Zuckerberg showed off briefly during the event. But Meta also revealed one prototype, called Mirror Lake, that’s essentially aspirational and has never been built. The design looks more like a pair of ski goggles than Meta’s bulky Quest hardware, and it would incorporate the thin optics of Holocake 2, the HDR capabilities of Starburst, and the resolution of Butterscotch. “It shows what a complete next-gen display system could look like,” said Abrash.

On top of these features, Mirror Lake would include an outward-facing display that projects an image of the user’s eyes, reducing the sense of physical separation for people outside the headset. Meta showed this slightly uncanny feature off in a prototype last year, and it may not be the only company interested in the concept: Apple has reportedly considered a similar feature for its rumored headset. The idea is tailored for a mixed reality world where Meta has staked much of its future — but today, the company is emphasizing the incremental steps along the way.

Today’s Storystream

Feed refreshed Sep 24 Not just you

E
External Link
Emma RothSep 24
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.


A
Youtube
Andrew WebsterSep 24
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.


Welcome to the new Verge

Revolutionizing the media with blog posts

Nilay PatelSep 13
A
The Verge
Andrew WebsterSep 24
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.


A
Andrew WebsterSep 24
Looking for something to do this weekend?

Why not hang out on the couch playing video games and watching TV. It’s a good time for it, with intriguing recent releases like Return to Monkey Island, Session: Skate Sim, and the Star Wars spinoff Andor. Or you could check out some of the new anime on Netflix, including Thermae Romae Novae (pictured below), which is my personal favorite time-traveling story about bathing.


A screenshot from the Netflix anime Thermae Romae Novae.
Thermae Romae Novae.
Image: Netflix
T
Twitter
Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.


A
External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.


A
External Link
Ford is running out of its own Blue Oval badges.

Running out of semiconductors is one thing, but running out of your own iconic nameplates is just downright brutal. The Wall Street Journal reports badge and nameplate shortages are impacting the automaker's popular F-series pickup lineup, delaying deliveries and causing general chaos.

Some executives are even proposing a 3D printing workaround, but they didn’t feel like the substitutes would clear the bar. All in all, it's been a dreadful summer of supply chain setbacks for Ford, leading the company to reorganize its org chart to bring some sort of relief.