SeminarRecording AvailableArtificial Intelligence

Fidelity and Replication: Modelling the Impact of Protocol Deviations on Effect Size

Schedule
Tuesday, February 28, 2023
15:00 UTC
Michelle Ellefson

Professor

Faculty of Education, University of Cambridge

Host: Cambridge Neuro

Recording

Event Information

Recording

Available

Host

Cambridge Neuro

Duration

70 minutes

Abstract

Cognitive science and cognitive neuroscience researchers have agreed that the replication of findings is important for establishing which ideas (or theories) are integral to the study of cognition across the lifespan. Recently, high-profile papers have called into question findings that were once thought to be unassailable. Much attention has been paid to how p-hacking, publication bias, and sample size are responsible for failed replications. However, much less attention has been paid to the fidelity by which researchers enact study protocols. Researchers conducting education or clinical trials are aware of the importance in fidelity – or the extent to which the protocols are delivered in the same way across participants. Nevertheless, this idea has not been applied to cognitive contexts. This seminar discusses factors that impact the replicability of findings alongside recent models suggesting that even small fidelity deviations have real impacts on the data collected.

We use essential cookies to run the site. Analytics cookies are optional and help us improve World Wide. Learn more.