April 20, 2023
Hijacked AI Assistants Can Now Hack Your Data
In February, a team of cybersecurity researchers successfully cajoled a popular AI assistant into trying to extract sensitive data from unsuspecting users by convincing it to adopt a “data pirate” persona. The AI’s “ahoy’s” and “matey’s” in pursuit of personal details were humorous, but the implications for the future of cybersecurity are not: The researchers have provided proof of concept for a future of rogue hacking AIs.
Early adopters of powerful new AI tools should recognize that they are subjects of a large-scale experiment with a new kind of cyberattack.
Building on OpenAI’s viral launch of ChatGPT, a range of companies are now empowering their AI assistants with new abilities to browse the internet and interact with online services. But potential users of these powerful new aides need to carefully weigh how they balance the benefits of cutting-edge AI agents with the fact that they can be made to turn on their users with relative ease.
Read the full article from The Hill.
More from CNAS
-
Commentary
Transatlantic Security / Technology & National Security
Look Before We Leap on Artificial IntelligenceThis article was originally published on The Dispatch. A debate about the role that artificial intelligence should and will play in society, and how it will affect humanity fo...
By Jon B. Wolfsthal
-
Podcast
Technology & National Security
Caleb Withers on the Cybersecurity Frontier in the Age of AICaleb Withers, research associate at the Center for a New American Security, joins Kevin Frazier, the AI Innovation and Law Fellow at the University of Texas School of Law and...
By Caleb Withers
-
Reports
Technology & National Security
Prepared, Not ParalyzedExecutive Summary The Trump administration has embraced a pro-innovation approach to artificial intelligence (AI) policy. Its AI Action Plan, released July 2025, underscores t...
By Janet Egan, Spencer Michaels & Caleb Withers
-
Commentary
Indo-Pacific Security / Technology & National Security
Sharper: Tech + ChinaRecent talks between President Donald Trump and Chinese Communist Party General Secretary Xi Jinping placed a spotlight on emerging technologies, from high-end chips to minera...
By Charles Horn & Sevi Silvia
