February 26, 2020

How Adversarial Attacks Could Destabilize Military AI Systems

Artificial intelligence and robotic technologies with semi-autonomous learning, reasoning, and decision-making capabilities are increasingly being incorporated into defense, military, and security systems. Unsurprisingly, there is increasing concern about the stability and safety of these systems. In a different sector, runaway interactions between autonomous trading systems in financial markets have produced a series of stock market “flash crashes,” and as a result, those markets now have rules to prevent such interactions from having a significant impact.

Could the same kinds of unexpected interactions and feedback loops lead to similar instability with defense or security AIs?

Read the full article from IEEE Spectrum.

Learn more about the Artificial Intelligence and International Stability Project:

Artificial Intelligence and International Stability Project

Despite calls from prominent scientists to avoid militarizing AI, nation-states are already using AI and machine-learning tools for national security purposes. AI has the pote...

Read More
  • Congressional Testimony
    • October 19, 2023
    Obstacles and Opportunities for Transformative Change

    Watch:...

    By Paul Scharre

  • Commentary
    • Foreign Policy
    • June 13, 2023
    Every Country Is on Its Own on AI

    But establishing such an institution quickly enough to match AI’s accelerating progress is likely a pipe dream, given the history of nuclear arms controls and their status tod...

    By Bill Drexel & Michael Depp

  • Commentary
    • The Hill
    • June 10, 2023
    The Time to Regulate AI Is Now

    Policymakers should also be under no illusion that a light regulatory touch will somehow prevent a degree of concentration at AI’s frontier....

    By Caleb Withers

  • Video
    • June 6, 2023
    Is an AI arms race underway?

    The role of artificial intelligence has long been debated in military communities. But as recent leapfrog advancements in technology have garnered headlines about the effects ...

    By Paul Scharre

View All Reports View All Articles & Multimedia