February 29, 2024
The Perilous Coming Age of AI Warfare
Last year, the Ukrainian drone company Saker claimed it had fielded a fully autonomous weapon, the Saker Scout, which uses artificial intelligence to make its own decisions about who to kill on the battlefield. The drone, Saker officials declared, had carried out autonomous attacks on a small scale. Although this has not been independently verified, the technology necessary to create such a weapon certainly exists. It is a small technical step—but a consequential moral, legal, and ethical one—to then produce fully autonomous weapons that are capable of searching out and selecting targets on their own.
The end state of this competition will likely be war executed at machine speed and beyond human control.
The deployment of Saker’s drone shows that the window to regulate autonomous weapons is closing fast. Countries have been discussing what to do about autonomous weapons for a decade, but they have been unable to agree on regulations to limit the weapons’ harms. Yet there is an urgent need for international agreement. The unconstrained development of autonomous weapons could lead to wars that expand beyond human control, with fewer protections for both combatants and civilians. Even if a wholesale ban is not realistic, there are many practical regulations that governments can adopt to mitigate autonomous weapons’ worst dangers. Without limits, humanity risks barreling toward a future of dangerous, machine-driven warfare.
Read the full article from Foreign Affairs.
More from CNAS
-
Podcast
Technology & National Security
The White House’s Secret AI Rules + the State of Model Alignment With METR’s Chris Painter + the Final Hot Mess ExpressThen, yet another report details new incidents in which A.I. agents have gone rogue. Chris Painter, an adjunct senior fellow at the Center for a New American Security and the ...
By Chris Painter
-
Podcast
Technology & National Security
AI Roundup: AI Going Rogue, Music Labels Want Popular AI Music GuidelinesDaniel Remler, senior fellow with the Technology and National Security Program at the Center for a New American Security (CNAS), joined AirTalk to discuss the White House's me...
By Daniel Remler
-
Commentary
Technology & National Security
The Cure for Russia’s Labor Shortage Is Worse Than the DiseaseAltogether, while Russia’s labor crisis is becoming a structural constraint on the Kremlin’s wartime economy, domestic stability, and long-term geopolitical ambitions, its res...
By Samuel Bendett
-
Podcast
Technology & National Security
AI Diplomacy: Dueling Banjos?Its economic potential is huge, but AI also brings serious national security threats. How exactly do diplomats work to create global standards that promote innovation but also...
By Daniel Remler
