February 29, 2024
The Perilous Coming Age of AI Warfare
Last year, the Ukrainian drone company Saker claimed it had fielded a fully autonomous weapon, the Saker Scout, which uses artificial intelligence to make its own decisions about who to kill on the battlefield. The drone, Saker officials declared, had carried out autonomous attacks on a small scale. Although this has not been independently verified, the technology necessary to create such a weapon certainly exists. It is a small technical step—but a consequential moral, legal, and ethical one—to then produce fully autonomous weapons that are capable of searching out and selecting targets on their own.
The end state of this competition will likely be war executed at machine speed and beyond human control.
The deployment of Saker’s drone shows that the window to regulate autonomous weapons is closing fast. Countries have been discussing what to do about autonomous weapons for a decade, but they have been unable to agree on regulations to limit the weapons’ harms. Yet there is an urgent need for international agreement. The unconstrained development of autonomous weapons could lead to wars that expand beyond human control, with fewer protections for both combatants and civilians. Even if a wholesale ban is not realistic, there are many practical regulations that governments can adopt to mitigate autonomous weapons’ worst dangers. Without limits, humanity risks barreling toward a future of dangerous, machine-driven warfare.
Read the full article from Foreign Affairs.
More from CNAS
-
Defense / Technology & National Security
The Dawn of Automated WarfareDrone-on-drone battle is now a central part of the war....
By Greg Grant & Eric Schmidt
-
Energy, Economics & Security / Technology & National Security
Scrapping AI Export Controls Is Self-DefeatingBeijing surely has two goals in mind: Signal to domestic companies that they ought to shun American technology as soon as possible, and manipulate Nvidia to reveal how it desi...
By Liza Tobin & Matt Pottinger
-
Defense / Technology & National Security
Stop Obsessing Over AGIWhat’s lacking? Thoughtful, deliberate, and evidence-based deployment and adoption strategies....
By Lt. Gen. Jack Shanahan
-
Technology & National Security
Global Compute and National SecurityThe current pathway to breakthrough artificial intelligence (AI) capabilities relies on amassing and leveraging vast “compute”—specialized chips housed within massive data cen...
By Janet Egan