underpowered studies

Lessons from the credibility revolution – social thermoregulation as a case study

The goal of this talk is to first provide a realization of why the replication crisis is omnipresent and then point to several tools via which the listener can improve their own work. To do so, I will go through our own work on social thermoregulation, point out why I thought changes were necessary, discuss which shortcomings we have in our own work, which measures we have taken to reduce those shortcomings, which tools we have relied on to do so, and which steps I believe we still need to make. Specifically, I will go through the following points: Major replication failures and data fabrication in the field of psychology; Replication failures of social thermoregulation studies; Realization that many of our studies were underpowered; Realization that many of our studies were very narrow in scope (i.e., in undergraduate students and mostly in EU/US); Realization that a lot of our measures were not independently validated. I will show these for our own work (but will also show why, via a meta-analysis, we have enough confidence to proceed with social thermoregulation research). Throughout the talk I will point you to the following tools that facilitate our work: Templates for exploratory and confirmatory research and for meta-analyses (developed for our work, but easily adaptable for other programs). I will also show you how to fork our templates; A lab philosophy; A research milestones sheet for collaborations and overviews; Excel sheet for contributorship; A tutorial for exploratory research; I would recommend listeners to read through this chapter before the talk (I will repeat a lot of that work, but I will go into greater depth). own work. To do so, I will go through our own work on social thermoregulation, point out why I thought changes were necessary, discuss which shortcomings we have in our own work, which measures we have taken to reduce those shortcomings, which tools we have relied on to do so, and which steps I believe we still need to make.