November 16, 2017
The critical human element in the machine age of warfare
In 1983, Stanislav Petrov helped to prevent the accidental outbreak of nuclear war by recognizing that a false alarm in Soviet early warning systems was not a real report of an imminent US attack. In retrospect, it was a remarkable call made under enormous stress, based on a guess and gut instinct. If another officer had been in his place that night—an officer who simply trusted the early warning system—there could have been a very different outcome: worldwide thermonuclear war.
As major militaries progress towards the introduction of artificial intelligence (AI) into intelligence, surveillance, and reconnaissance, and even command systems, Petrov’s decision should serve as a potent reminder of the risks of reliance on complex systems in which errors and malfunctions are not only probable, but probably inevitable. Certainly, the use of big data analytics and machine learning can resolve key problems for militaries that are struggling to process a flood of text and numerical data, video, and imagery. The introduction of algorithms to process data at speed and scale could enable a critical advantage in intelligence and command decision-making. Consequently, the US military is seeking to accelerate its integration of big data and machine learning through Project Maven, and the Chinese military is similarly pursuing research and development that leverage these technologies to enable automated data and information fusion, enhance intelligence analysis, and support command decision-making. Russian President Vladimir Putin, meanwhile, has suggested, “Artificial intelligence is the future, not only for Russia, but for all humankind… Whoever becomes the leader in this sphere will become the ruler of the world.”
Read the full op-ed in the Bulletin of the Atomic Scientists.
More from CNAS
-
Technology & National Security
Jensen Huang's Exit: What It Means For Nvidia And America's AI SecurityWhat does Jensen Huang's exit mean for Nvidia, and could the controversy have wider implications for America's AI leadership and national security? Speaking to NDTV, Vivek Chi...
By Vivek Chilukuri
-
Energy, Economics & Security / Technology & National Security
CNAS Insights | The Nvidia Scandal Is a Wake-Up Call for CongressNvidia founder and CEO Jensen Huang has resigned amid revelations of extramarital affairs, including with an alleged Chinese spy. The suspected Chinese asset, Alice Huang, has...
By Emily Kilcrease & Vivek Chilukuri
-
Technology & National Security
Jensen Huang latest: Scandal-hit Nvidia founder asked to testify to Senate - as details of Trump call emergeJensen Huang's resignation was "inevitable" following the affair allegations and while it will be hard for Nvidia in the short term, they still have the best chips in the worl...
By Vivek Chilukuri
-
Technology & National Security
China’s AI Diplomacy Is WorkingIf the United States wants to maintain its lead and make meaningful progress on safety, it needs to treat the dialogue as part of the competition with China....
By Daniel Remler
