February 29, 2024
The Perilous Coming Age of AI Warfare
Last year, the Ukrainian drone company Saker claimed it had fielded a fully autonomous weapon, the Saker Scout, which uses artificial intelligence to make its own decisions about who to kill on the battlefield. The drone, Saker officials declared, had carried out autonomous attacks on a small scale. Although this has not been independently verified, the technology necessary to create such a weapon certainly exists. It is a small technical step—but a consequential moral, legal, and ethical one—to then produce fully autonomous weapons that are capable of searching out and selecting targets on their own.
The end state of this competition will likely be war executed at machine speed and beyond human control.
The deployment of Saker’s drone shows that the window to regulate autonomous weapons is closing fast. Countries have been discussing what to do about autonomous weapons for a decade, but they have been unable to agree on regulations to limit the weapons’ harms. Yet there is an urgent need for international agreement. The unconstrained development of autonomous weapons could lead to wars that expand beyond human control, with fewer protections for both combatants and civilians. Even if a wholesale ban is not realistic, there are many practical regulations that governments can adopt to mitigate autonomous weapons’ worst dangers. Without limits, humanity risks barreling toward a future of dangerous, machine-driven warfare.
Read the full article from Foreign Affairs.
More from CNAS
-
Technology & National Security
The U.S.-Iran Stalemate Explained: How Drones and AI Are Changing WarBetween cheap-to-produce drones and artificial intelligence, the future of warfare may already be here. Paul Scharre, former US Army Ranger and executive vice president of the...
By Paul Scharre
-
Technology & National Security
Mr. Xi Goes to Washington: An Opportunity for U.S.-China AI AssuranceArtificial intelligence is advancing too rapidly, and its ramifications too consequential, for either country to believe that competition alone is a strategy....
By Lt. Gen. Jack Shanahan
-
Technology & National Security
CNAS Insights | U.S.-China AI Agreements Need Verification, Not TrustThe upcoming Trump-Xi summit is likely to disappoint the leaders of top AI labs that have recently called for urgent, coordinated pacing of frontier AI progress. While agreeme...
By Ruby Scanlon & Janet Egan
-
Technology & National Security
U.S. & China AI Competition Raises Questions About Risk and OversightThe United States and China are moving quickly to develop increasingly powerful artificial intelligence systems, and Lt. Gen. Jack Shanahan (Ret.), former director of the Pent...
By Lt. Gen. Jack Shanahan
