November 02, 2023

Time to Act: Building the Technical and Institutional Foundations for AI Assurance

In March 2022, an Indian BrahMos missile launched from Sirsa landed in a sparsely populated region of Mian Channu in Pakistan. The episode, which India described as an accident, fortunately, caused no casualties but led to fears that Pakistan might respond in kind, fueling escalation. A few months later, similar uncertainty surrounding the origin of a missile that exploded in Przewodów, Poland during a particularly acute period of Russian bombardment of Ukrainian energy facilities triggered fears that NATO might find itself at war. And perhaps the most famous close call was the nuclear false alarm in 1983 when a Soviet early warning system detected the launch of five U.S. intercontinental ballistic missiles. Stanislav Petrov’s decision to ignore that warning is credited with avoiding nuclear war. The integration of AI tools for targeting and engagement, as well as early warning and decision support functions, might make these close calls more common. In light of this increased risk, efforts to increase confidence that AI-enabled systems are acting as designed become increasingly important.

Assurance for AI systems presents unique challenges.

While the challenges facing policymakers in the realm of AI governance are significant, they are not insurmountable.

Over the last several years, analyses of potential future conflicts have stressed the growing role that autonomous systems will play across domains and functions. As these systems are integrated into global militaries, it is increasingly likely that accidents could lead to escalation (inadvertent or advertent) in the face of improperly tested and evaluated platforms. Collaboration with both allies and adversaries on testing and evaluation has the potential to reduce these accidents and the consequent escalation of conflicts, driving compliance with international law. Establishing international standards and norms about the employment of AI in safety-critical contexts is the prudent way forward for this collaboration.

Read the full article from Lawfare.

  • Podcast
    • May 17, 2024
    The Future of Europe with Constanze Stelzenmüller and Nathalie Tocci

    On April 25th, French President Emmanuel Macron gave a nearly two-hour-long speech at the Sorbonne that outlined his vision for Europe. In the context of major challenges such...

    By Andrea Kendall-Taylor, Jim Townsend, Constanze Stelzenmüller & Nathalie Tocci

  • Reports
    • May 10, 2024
    Space to Grow

    Executive Summary In the more than 50 years since the first satellite launch, space has become irrevocably intertwined with the American way of life and the American way of wa...

    By Hannah Dennis

  • Commentary
    • May 8, 2024
    Sharper: Nuclear Deterrence

    The United States faces two determined near-peer competitors with robust conventional military forces and increasingly advanced nuclear arsenals. In the Indo-Pacific, the Peop...

    By Philip Sheers, Anna Pederson & Alexa Whaley

  • Commentary
    • War on the Rocks
    • May 1, 2024
    Uncrewed but Confident: Forging New Rules of the Road to Avoid Accidental Escalation

    Air and maritime uncrewed platforms in the Indo-Pacific may be a promising area for developing new confidence-building measures....

    By Tom Shugart

View All Reports View All Articles & Multimedia