EEG EVIDENCE FOR DIFFERENTIATING DEEPFAKE AND HUMAN SPEAKERS
Tilburg University
Presentation
Date TBA
Event Information
Poster Board
PS01-07AM-600
Poster
View posterAbstract
Deepfake videos increasingly resemble real humans, raising questions about how the brain distinguishes artificial from human communicators during emotional narrative processing. This study investigated how real-human versus AI-generated video stories modulate EEG oscillations and event-related potentials (ERPs). Thirty adults viewed short everyday-life narratives presented either by a human speaker or a deepfake matched in appearance and motion, with stories varying in emotional valence. EEG time–frequency power (theta, alpha, beta) was extracted from frontal, parietal, temporal, and occipital regions, and ERPs (P1, N170, EPN, LPP) were analyzed with region-specific tests. Human speakers elicited stronger frontal beta and theta power than deepfakes, whereas deepfake videos produced greater alpha, beta, and theta power in parietal and occipital regions, revealing a clear anterior–posterior dissociation. Emotional valence effects were agent-dependent, with frontal alpha being higher for negative than for positive stories across agents, while frontal theta encoded valence only for human speakers. In contrast, parietal oscillations reflected valence exclusively for deepfakes, showing increased theta for negative narratives. ERP results showed early discrimination of agents. P1 and N170 amplitudes differed between human and deepfake videos depending on region and emotional condition. Later components primarily encoded emotion: LPP differentiated positive from negative narratives, and EPN showed a valence effect only for deepfake stimuli in frontal regions. Overall, deepfake communicators evoked distinct temporal and spatial neurocognitive signatures compared with real humans, highlighting differential processing of speaker identity and emotional meaning across early perceptual and later evaluative stages.
Recommended posters
DISSOCIATING EXOGENOUS AND ENDOGENOUS INFLUENCES OF EMOTIONAL PROSODY ON NEURAL SPEECH TRACKING
Asena Akkaya, Giovanni Di Liberto
FACE FAMILIARITY DISPLAYS GREATER MODULATORY EFFECTS FOR NEUTRAL THAN FOR HAPPY OR ANGRY IDENTITIES - FINDINGS FROM A MIXED BEHAVIOURAL-ELECTROPHYSIOLOGICAL STUDY
Constantin-Iulian Chiță, Simon P. Liversedge, Philipp Ruhnau
ENHANCED CORTICAL SPEECH TRACKING FOR UNTRUSTWORTHY SPEAKERS
Jaimy Hannah, Giovanni Di Liberto
EMPATHY ACROSS AGENTS: NEURAL AND BEHAVIORAL MODULATION OF AFFECTIVE INCONGRUENCE PROCESSING IN HUMANS AND A HUMANOID ROBOT
Rabea Breininger, Ann-Kathrin Beck, Ashita Ashok, Karsten Berns, Thomas Lachmann
ALPHA POWER AND PHASE LOCKING AS MARKERS OF CONVERSATIONAL ENGAGEMENT IN TRIADIC INTERACTIONS
Pablo Ochoa de Eribe Delgado, Ronny Hannemann, Frederic Marmel, Tobias Reichenbach
AUDIOVISUAL INTEGRATION IN CORTICAL SPEECH TRACKING EVOKED BY TALKING AVATARS
Jasmin Riegel, Alina Schüller, Constantin Jehn, Alexander Wißmann, Steffen Zeiler, Dorothea Kolossa, Tobias Reichenbach