August 14, 2019

Why Are Deepfakes So Effective?

It's because we often want them to be true.

Public opinion shifts, skewed election results, mass confusion, ethnic violence, war. All of these events could easily be triggered by deep fakes—realistic seeming but falsified audio and video made with AI techniques. Leaders in government and industry, and the public at large are justifiably alarmed. Fueled by advances in AI and spread over the tentacles of social media, deep fakes may prove to be among the most destabilizing of forces humankind has faced in generations.

It will soon be impossible to tell by the naked eye or ear whether a video or audio clip is authentic. While propaganda is nothing new, the visceral immediacy of voice and image give deep fakes unprecedented impact and authority; as a result, both governments and industry are scrambling to develop ways to reliably detect them. Silicon Valley startup Amber, for example, is working on ways to detect even the most sophisticated altered video. You can imagine a day when we can verify the authenticity and provenance of a video by way of a digital watermark.

Developing deep fake detection technology is important, but it's only part of the solution. It is the human factor—weaknesses in our human psychology—not their technical sophistication that make deep fakes so effective. New research hints at how foundational the problem is.

After showing over 3,000 adults fake images accompanied by fabricated text, a group of researchers reached two conclusions. First, the more online experience and familiarity with digital photography one had, the more skeptical the person evaluating the information was. Second, confirmation bias—the tendency to frame new information to support our pre-existing beliefs—was a big factor in how people judged the veracity of the fake information.

Read the full article in Scientific American.

  • Video
    • January 24, 2025
    PONI Live Debate: AI Integration in NC3

    Dr. Paul Scharre, executive vice president and director of studies at the Center for New American Security joins in a live debate moderated to discuss AI Integration in NC3. ...

    By Paul Scharre

  • Commentary
    • January 22, 2025
    Sharper: Trump's First 100 Days

    Donald Trump takes office in a complex and volatile global environment. Rising tensions with China, the continued war in Ukraine, and instability in the Middle East all pose s...

    By Charles Horn

  • Commentary
    • January 20, 2025
    Accelerate America’s Quantum Technology Leadership

    As the U.S.-China competition for quantum technology leadership continues to intensify, the Trump administration should prioritize both advancing and protecting the country’s ...

    By Constanza M. Vidal Bustamante

  • Commentary
    • January 20, 2025
    Secure America’s Tech Competitiveness

    The Trump administration must bolster America’s science, technology, engineering, and mathematics (STEM) workforce and broader technological competitiveness—documented shortag...

    By Sam Howell

View All Reports View All Articles & Multimedia