November 25, 2014

UNIDIR White Paper on Meaningful Human Control

By Matthew Seeley

The United Nations Institute for Disarmament Research (UNIDIR) recently published a second report centered around the weaponization of increasingly autonomous technologies.  An important contribution to the understanding of autonomy in weapons, this report focuses on the objective of maintaining “meaningful human control” over weapons that incorporate increasing autonomy.  The report analyzes the concept of meaningful human control and the positives and negatives associated with embracing this principle in an attempt to advance the discussion on autonomous weapons.

The concept of meaningful human control evolved out of repeated calls regarding the importance of human control in autonomous weapons.  Even though the concept is still in nascent form, many countries and experts in the field have already welcomed the objective of meaningful human control as a valuable concept.  As a result, the concept has been frequently mentioned over the last year at multiple meetings of the Convention on Certain Conventional Weapons on lethal autonomous weapons systems (LAWS).

UNIDIR determines that meaningful human control provides “an approach to the discussion regarding the weaponization of increasingly autonomous technologies, but not a solution to the technical, legal, moral, and regulatory questions that they pose.”  The report calls for deeper discussions on topics including parameters that shape human control over current weapons systems, human-machine interaction, responsibility, and accountability in order to better articulate the concept of meaningful human control. 

The report also analyzes alternative approaches to the weaponization of increasingly autonomous technologies, including what UNIDIR determines to be positive and negative attributes of these approaches.  These approaches include the predictability of compliance with international humanitarian law (notably distinction, proportionality, and precautions in attack), and ensuring any use of lethal force is consistent with human intent. 

Ultimately, UNIDIR concludes that both predictability and human intent are captured in the broader concept of meaningful human control, and that this common ground serves as a welcome entry point for discussing the issues around the weaponization of increasingly autonomous technologies.  UNIDIR also emphasizes the importance of social and political processes in addition to the frequently discussed technical and legal aspects of the debate on autonomous weapons.      

  • Commentary
    • Texas National Security Review
    • June 2, 2020
    The Militarization of Artificial Intelligence

    Militaries are racing to adopt artificial intelligence (AI) with the aim of gaining military advantage over competitors. And yet, there is little understanding of AI’s long-te...

    By Paul Scharre

  • Commentary
    • Wired
    • May 19, 2020
    Are AI-Powered Killer Robots Inevitable?

    In war, speed kills. The soldier who is a split second quicker on the draw may walk away from a firefight unscathed; the ship that sinks an enemy vessel first may spare i...

    By Paul Scharre

  • Commentary
    • The New York Times
    • February 12, 2020
    The Iranian Missile Strike Did Far More Damage Than Trump Admits

    Over 100 American soldiers have been treated for traumatic brain injuries following Iran’s missile strike on Al Asad Air Base in western Iraq. The strike came in retaliation f...

    By Loren DeJonge Schulman & Paul Scharre

  • Podcast
    • January 16, 2020
    Episode 26 - Paul Scharre

    What are autonomous weapons systems? How are they used in modern warfare? And how do we strengthen international cooperation? In this episode, the Director of the Technology a...

    By Paul Scharre

View All Reports View All Articles & Multimedia