Josefina Weinerova
Josefina is interested in cognitive psychology and meta-research. She is currently working as a postdoctoral researcher at Birkbeck, University of London on Making Replications Count project: https://forrt.org/marco/
Birkbeck, University of London
@josefinaw.bsky.social,
Session
Replication is a cornerstone of cumulative science, yet failed replications often do not appear to reduce belief in or use of original claims. If replications are fundamental to scientific self-correction, why do their results so often fail to shape the trajectory of knowledge?
We used the FORRT Library of Replication Attempts (FLoRA), which includes over 1,000 replications from across different fields, to estimate the effect of failed replications on subsequent citations of original studies. We fit a Fixed Effects Counterfactual (FECT) model to citation data for studies with a failed replication alongside matched control studies, and then used meta-analytic regression to test whether the citation impact is moderated by characteristics such as open-access status or journal rank. We present the preliminary results of this analysis — shedding light on what it would take to make science's self-corrective mechanism more effective.