Skip to main content

Leading AI researchers threaten Korean university with boycott over its work on ‘killer robots’

Leading AI researchers threaten Korean university with boycott over its work on ‘killer robots’

Share this story

An unmanned military robot operates on a beach during a training exercise organized by the US Navy.
An unmanned military robot operates on a beach during a training exercise organized by the US Navy.
Photo by John F. Williams / US Navy

More than 50 leading AI and robotics researchers have said they will boycott South Korea’s KAIST university over the institute’s plans to help develop AI-powered weapons. The threat was announced ahead of a UN meeting set in Geneva next week to discuss international restrictions on so-called “killer robots.” It marks an escalation in tactics from the part of the scientific community actively fighting for stronger controls on AI-controlled weaponry.

The boycott was organized by Professor Toby Walsh of the University of New South Wales, who warned in a press statement that the race to build autonomous weapons had already begun. “We can see prototypes of autonomous weapons under development today by many nations including the US, China, Russia, and the UK,” said Walsh. “We are locked into an arms race that no one wants to happen. KAIST’s actions will only accelerate this arms race. We cannot tolerate this.”

Signatories of the boycott include some of world’s leading AI researchers, most notably professors Geoffrey Hinton, Yoshua Bengio, and Jü​rgen Schmidhuber. The boycott would forbid all contact and academic collaboration with KAIST until the university makes assurances that the weaponry it develops will have “meaningful human control.”

“KAIST’s actions will only accelerate this arms race.”

The trigger for this action was KAIST’s announcement in February that it was launching a joint research center with South Korean defense company Hanwha Systems. According to The Korean Times, the goal of the center is to “develop artificial intelligence (AI) technologies to be applied to military weapons” that would “search for and eliminate targets without human control.”

But according to a report from Times Higher Education, KAIST’s president Sung-Chul Shin said he was “saddened” by the threatened boycott, and denies that the university is building autonomous weapon systems at all. “As an academic institution, we value human rights and ethical standards to a very high degree. KAIST will not conduct any research activities counter to human dignity, including autonomous weapons lacking meaningful human control,” he said. Boycott organizer Walsh told Times Higher Education he would need to consult with his co-signatories on what to do next, and added that KAIST’s response still left ”some questions unanswered.”

KAIST’s partnership with Hanwha brings together two of the world’s leading robotics and military organizations. KAIST is a world-class research university, known for work such as the transforming DRC-HUBO robot, which won the 2015 DARPA robotics challenge.

Hanwha Systems, meanwhile, is the defense subsidiary of South Korea’s powerful Hanwha chaebol. Hanwha is already involved in the development of autonomous weapons such as the SGR-A1 sentry gun, which has reportedly been deployed on the border between North and South Korea. The company also builds cluster munitions, banned by international treaty (although many nations abstain from this ban, including South Korea, the US, Russia, and China).

DARPA Robotics Challenge Showcases Cutting Edge In Artificial Intelligence
KAIST robotics research is internationally respected, including its work developing the DRC-HUBO robot.
Photo by Chip Somodevilla / Getty Images

Although a boycott against KAIST would be significant, some experts say the campaign to control the development of autonomous weaponry is futile.

Previously, leaders in AI and robotics have written to the UN arguing that weapons that kill without human intervention could destabilize the world and should be controlled by international treaty. This has received some international support, with 19 countries including Egypt, Argentina, and Pakistan, backing such an initiative. But other countries like the US and UK say such legislation would be impractical, because of the impossibility of defining what does and does not constitute human control. Many systems already have at least some autonomous capabilities, including drones and missile defense networks.

For Walsh and others, though, the danger is too great to be complacent. “If developed, autonomous weapons will [...] permit war to be fought faster and at a scale greater than ever before,” said Walsh in a press statement. “This Pandora’s box will be hard to close if it is opened.“

Update April 4th, 11:00AM ET: The story has been updated to include a response from KAIST and boycott organizer Toby Walsh.