Skip to main content

Did Elon Musk’s AI champ destroy humans at video games? It’s complicated

Did Elon Musk’s AI champ destroy humans at video games? It’s complicated

Share this story

You might not have noticed, but over the weekend a little coup took place. On Friday night, in front of a crowd of thousands, an AI bot beat a professional human player at Dota 2 — one of the world’s most popular video games. The human champ, the affable Danil "Dendi" Ishutin, threw in the towel after being killed three times, saying he couldn’t beat the unstoppable bot. “It feels a little bit like human,” said Dendi. “But at the same time, it’s something else.”

The bot’s patron was none other than tech billionaire Elon Musk, who helped found and fund the institution that designed it, OpenAI. Musk wasn’t present, but made his feelings known on Twitter, saying: “OpenAI first ever to defeat world's best players in competitive eSports. Vastly more complex than traditional board games like chess & Go.” Even more exciting, said OpenAI, was that the AI had taught itself everything it knew. It learned purely by playing successive versions of itself, amassing “lifetimes” of in-game experience over the course of just two weeks.

But how big a deal is all this? Was Friday night’s showdown really more impressive than Google’s AI victories at the board game Go? The short answer is probably not, but it still represents a significant step forward — both for the world of e-sports and the world of artificial intelligence.

Dota 2
The Shadow Fiend hero used by the AI.
Image: Valve

Yes, video games are more complex than chess

First, we need to look at Musk’s claim that Dota is “vastly more complex than traditional board games like chess & Go.” This is completely true. Real-time battle and strategy games like Dota and Starcraft II pose major challenges that computers just can’t handle yet. Not only do these games demand long-term strategic thinking, but — unlike board games — they keep vital information hidden from players. You can see everything that’s happening on a chess board, but you can’t in a video game. This means you have to predict and preempt what your opponent will do. It takes imagination and intuition.

In Dota, this complexity is increased as human players are asked to work together in teams of five, coordinating strategies that will change on the fly based on which characters players choose. To make things even more complex, there are more than 100 different characters in-game, each with their own unique skill set; and characters can be equipped with a number of unique items, each of which can be game-winning if deployed at the right moment. All this means it’s basically impossible to comprehensively program winning strategies into a Dota bot.

But, the game that OpenAI’s bot played was nowhere near as complex as all this. Instead of 5v5, it took on humans at 1v1; and instead of choosing a character, both human and computer were limited to the same “hero” — a fellow named the Shadow Fiend, who has a pretty straightforward set of attacks. My colleague Vlad Savov, a confirmed Dota addict who also wrote up his thoughts on Friday’s match, said the 1v1 match represents “only a fraction of the complexity of the full team contest.” So: probably not as complex as Go.

Normal games in Dota are 5v5 — much more complex than the 1v1 games the bot played.
Normal games in Dota are 5v5 — much more complex than the 1v1 games the bot played.

You can’t beat a calculator at calculation

The second major caveat is knowing what advantages OpenAI’s agent had over its human opponents. One of the major points of discussion in the AI community was whether or not the bot had access to Dota’s bot API — which would let it tap directly into streams of information from the game, like the distances between players. OpenAI’s Greg Brockman confirmed to The Verge that the AI did indeed use the API, and that certain techniques were hardcoded in the agent, including the items it should use in the game. It was also taught certain strategies (like one called “creep block”) using a trial-and-error technique known as reinforcement learning. Basically, it did get a little coaching.

Andreas Theodorou, a games AI researcher at the University of Bath and an experienced Dota player, explains why this makes a difference. “One of the main things in Dota is that you need to calculate distances to know how far some [attacks] travel,” he says. “The API allows bots to have specific indications of range. So you can say, ‘If someone is in 500 meters range, do that,’ but the human player has to calculate it themselves, learning through trial and error. It really gives them an advantage if they have access to information that a human player does not.” This is particularly true in a 1v1 setting with a hero like Shadow Fiend; where players have to focus on timing their attacks correctly, rather than overall strategy.

Brockman’s response is that this sort of skill is trivial for an AI to learn, and was never the focus of OpenAI’s research. He says the institute’s bot could have done without information from the API, but “you’d just be spending a lot more of your time learning to do vision, which we already know works, so what’s the benefit?”

Some skills aren’t taught — they’re learned

So, knowing all this, should we dismiss OpenAI’s victory? Not at all, says Brockman. He points out that, perhaps more important than the bot’s victory, was how it taught itself in the first place. While previous AI champions like AlphaGo have learned how to play games by soaking up past matches by human champions, OpenAI’s bot taught itself (nearly) everything it knows.

“You have this system that has just played against itself, and it has learned robust enough strategies to beat the top pros. That’s not something you should take for granted,” says Brockman. “And it’s a big question for any machine learning system: how does complexity get into the model? Where does it come from?”

As OpenAI’s Dota bot shows, he says, we don’t have to teach computers complexity: they can learn it themselves. And although some of the bot’s behavior was preprogrammed, it did develop some strategies by itself. For example, it learned how to fake out its opponents by pretending to trigger an attack, only to cancel at the last second, leaving the human player to dodge an attack that never comes — exactly like a feint in boxing.

Others, though, are still a little skeptical. AI researcher Denny Britz, who wrote a popular blog post that put the victory in context, tells The Verge that it’s difficult to judge the scale of this achievement without knowing more technical details. (Brockman says these are forthcoming, but couldn’t give an exact time frame.) “It’s not clear what the technical contribution is at this point before the paper comes out,” says Britz.

Theodorou points out that although OpenAI’s bot beat Dendi onstage, once players got a good look at its tactics, they were able to outwit it. “If you look at the strategies they used, they played outside the box a bit and they won,” he says. The players used offbeat strategies — the sort that wouldn’t faze a human opponent, but which the AI had never seen before. “It didn’t look like the bot was flexible enough,” says Theodorou. (Brockman counters that once the bot learned these strategies, it wouldn’t fall for them twice.)

All the experts agree that this was a major achievement, but that the real challenge is yet to come. That will be a 5v5 match, where OpenAI’s agents have to manage not just a duel in the middle of the map, but a sprawling, chaotic battlefield, with multiple heroes, dozens of support units, and unexpected twists. Brockman says that OpenAI is currently targeting next year’s grand Dota tournament in 12 months’ time to pull this off. Between now and then, there’s much more training to be done.

Today’s Storystream

Feed refreshed 48 minutes ago Striking out

External Link
Emma Roth48 minutes ago
California Governor Gavin Newsom vetoes the state’s “BitLicense” law.

The bill, called the Digital Financial Assets Law, would establish a regulatory framework for companies that transact with cryptocurrency in the state, similar to New York’s BitLicense system. In a statement, Newsom says it’s “premature to lock a licensing structure” and that implementing such a program is a “costly undertaking:”

A more flexible approach is needed to ensure regulatory oversight can keep up with rapidly evolving technology and use cases, and is tailored with the proper tools to address trends and mitigate consumer harm.

Andrew Webster5:33 PM UTC
Look at this Thing.

At its Tudum event today, Netflix showed off a new clip from the Tim Burton series Wednesday, which focused on a very important character: the sentient hand known as Thing. The full series starts streaming on November 23rd.

The Verge
Andrew Webster4:28 PM UTC
Get ready for some Netflix news.

At 1PM ET today Netflix is streaming its second annual Tudum event, where you can expect to hear news about and see trailers from its biggest franchises, including The Witcher and Bridgerton. I’ll be covering the event live alongside my colleague Charles Pulliam-Moore, and you can also watch along at the link below. There will be lots of expected names during the stream, but I have my fingers crossed for a new season of Hemlock Grove.

Andrew Webster1:05 PM UTC
Looking for something to do this weekend?

Why not hang out on the couch playing video games and watching TV. It’s a good time for it, with intriguing recent releases like Return to Monkey Island, Session: Skate Sim, and the Star Wars spinoff Andor. Or you could check out some of the new anime on Netflix, including Thermae Romae Novae (pictured below), which is my personal favorite time-traveling story about bathing.

A screenshot from the Netflix anime Thermae Romae Novae.
Thermae Romae Novae.
Image: Netflix
Jay PetersSep 23
Twitch’s creators SVP is leaving the company.

Constance Knight, Twitch’s senior vice president of global creators, is leaving for a new opportunity, according to Bloomberg’s Cecilia D’Anastasio. Knight shared her departure with staff on the same day Twitch announced impending cuts to how much its biggest streamers will earn from subscriptions.

Tom WarrenSep 23
Has the Windows 11 2022 Update made your gaming PC stutter?

Nvidia GPU owners have been complaining of stuttering and poor frame rates with the latest Windows 11 update, but thankfully there’s a fix. Nvidia has identified an issue with its GeForce Experience overlay and the Windows 11 2022 Update (22H2). A fix is available in beta from Nvidia’s website.

External Link
If you’re using crash detection on the iPhone 14, invest in a really good phone mount.

Motorcycle owner Douglas Sonders has a cautionary tale in Jalopnik today about the iPhone 14’s new crash detection feature. He was riding his LiveWire One motorcycle down the West Side Highway at about 60 mph when he hit a bump, causing his iPhone 14 Pro Max to fly off its handlebar mount. Soon after, his girlfriend and parents received text messages that he had been in a horrible accident, causing several hours of panic. The phone even called the police, all because it fell off the handlebars. All thanks to crash detection.

Riding a motorcycle is very dangerous, and the last thing anyone needs is to think their loved one was in a horrible crash when they weren’t. This is obviously an edge case, but it makes me wonder what other sort of false positives we see as more phones adopt this technology.

External Link
Ford is running out of its own Blue Oval badges.

Running out of semiconductors is one thing, but running out of your own iconic nameplates is just downright brutal. The Wall Street Journal reports badge and nameplate shortages are impacting the automaker's popular F-series pickup lineup, delaying deliveries and causing general chaos.

Some executives are even proposing a 3D printing workaround, but they didn’t feel like the substitutes would clear the bar. All in all, it's been a dreadful summer of supply chain setbacks for Ford, leading the company to reorganize its org chart to bring some sort of relief.