Fidelity and Replication: Modelling the Impact of Protocol Deviations on Effect Size
Recording · Feb 28, 2023
Michelle Ellefson, Faculty of Education, University of Cambridge
We use cookies for analytics.
Seminar, Hosted by Helmholtz Information & Data Science Academy (HIDA)
Helmholtz-Zentrum Dresden-Rossendorf
The growth of machine-learning conference submissions and rapid uptake of large language models have accelerated research, while leaving open the question of whether findings have become more reliable. A favourable random seed or contamination of a test set can be mistaken for a scientific advance. This lecture examines the resulting gap in trust, analyses common research practices that produce fragile conclusions, and discusses safeguards needed for machine-learning studies to make a durable scientific contribution.