Top Paper Award for Teresa Weikmann & Hannah Greber

29.05.2023

What happens after someone has been deceived by a deepfake? Is it true, that people do no longer believe wat they see? And how does this work for different deepfake formats? Teresa Weikmann, Hannah Greber and Alina Nikolaou tackle these questions in their experimental study called “After deception: How falling for a deepfake affects the way we see, hear and experience media”, for which they have received the Top Student Paper Runner Up award from the Visual Communication Studies Division at the ICA Conference in Toronto.

With the emergence of artificial intelligence, deepfakes have rendered it possible to manipulate anyone’s and anything’s audio-visual representation, adding fuel to the discussion about the believability of what we hear and see in the news. However, we do not know yet whether deepfakes can actually impact (1) the credibility attributed to audio-visual media in general, as well as (2) the perceived self-efficacy to discern between real and fake media. Furthermore, it remains unclear if different deepfake formats can affect citizens to differing degrees. This study employs a 3 x 2 x 2 between-within-subjects experiment (N = 951) with the between-subjects factor format (audio vs. video vs. 360° video) and facticity (real vs. fake) and the within- subjects factor reveal (pre vs. post reveal). We explore what happens after revealing to a sample of German participants that they have been deceived by a deepfake. Our findings show that credibility of media drops across all formats after revealing the stimulus was fake, whereas the control group is not affected. On the other hand, self- efficacy is impacted even for people who were exposed to authentic news media. This shows that deepfakes may have further-reaching societal implications that go beyond deception, whereas modality seems to matter little for such effects.