April 14, 2015

When ‘Killer Robots’ Declare War

This week, nations from around the world will debate the future of lethal autonomous weapon systems (LAWS), or so-called “killer robots,” at the United Nations Convention on Certain Conventional Weapons in Geneva. As they do, they should remember that automated systems have long controlled operations across a variety of endeavors, including military ones, often with unexpected results. Some have been amusing, while others have been nearly catastrophic. This essay presents three historical case studies that underscore how LAWS could unexpectedly lead us to war.

Textbooks on insect genetic design are not typically bestsellers. Yet, on April 18, 2011, the Amazon.com price for The Making of a Fly topped $23.6 million. How could this be? The answer is a robotic price war. Unbeknownst to consumers, the pricing algorithms employed by two competing booksellers triggered a feedback loop. The first algorithm always set its price at 1.27059 times the next-most-expensive copy of the book. The second always set its price at 0.9983 times the price set by the first. An absurd price spiral ensued.

Read the full opinion piece at Defense One.

  • Reports
    • October 12, 2022
    Artificial Intelligence and Arms Control

    Advances in artificial intelligence (AI) pose immense opportunity for militaries around the world. With this rising potential for AI-enabled military systems, some activists a...

    By Paul Scharre & Megan Lamberth

  • Podcast
    • April 29, 2021
    Fire and Ice

    In this week’s edition of the SpyTalk podcast, Jeff Stein goes deep on the CIA’s looming eviction from Afghanistan with Lisa Curtis, a longtime former CIA, State Department an...

    By Lisa Curtis, Jeff Stein, Jeanne Meserve & Alma Katsu

  • Reports
    • April 28, 2021
    Principles for the Combat Employment of Weapon Systems with Autonomous Functionalities

    These seven new principles concentrate on the responsible use of autonomous functionalities in armed conflict in ways that preserve human judgment and responsibility over the ...

    By Robert O. Work

  • Podcast
    • March 25, 2021
    Are ‘killer robots’ the future of warfare?

    Paul Scharre joins host Suzanna Kianpour to discuss the technology, fears and even potential advantages of developing autonomous weapons. Listen to the full conversation from...

    By Paul Scharre

View All Reports View All Articles & Multimedia