SIPS 2026 DC

ManyQRPs
2026-06-09 , WS Room 2418

Questionable Research Practices (QRPs) are “ways of producing, maintaining, sharing, analyzing, or interpreting data that are likely to produce misleading conclusions, typically in the interest of the researcher” (Nagy et al., 2025, page 8). The aim of this hackathon is to refine the methodology for a project “ManyQRPs”, which will systematically investigate QRPs across disciplines by having research teams analyse the same datasets under two conditions: once following their own preregistered, transparent protocol, and once deliberately using QRPs to construct a compelling narrative. In this hackathon, we will collaboratively refine the protocol for this planned project. The protocol will include instructions on how teams or individuals should construct their “twin” manuscripts. Time allowing, the hackathon may include applying (or making a plan for applying) the protocol to (a) pilot dataset(s), helping identify obstacles and further refine the protocol.


Acknowledgment of Co-Authors:

Tracey Weissgerber

Please classify your session as the theme it fits best in:: Incentives/Culture - Content related to the incentive structure of science, culture, and norms of science What is your end product?:

A refined protocol for the ManyQRPs project, ready to be piloted further.

How will the session's content foster diversity & inclusion (e.g., who will present, who will it serve), and how will it improve psychological science?:

The session lead is an ECR, and the session will be open to people of all backgrounds. The hackathon will help ensure the ManyQRPs project protocol is well-designed, and that it has been stress-tested by a range of researchers. Results of the overall ManyQRPs project will help improve psychological science by improving our understanding of QRPs across disciplines.

Please note any pre-requisite knowledge/expertise you will expect from attendees (i.e., is the session most appropriate for someone who already has experience with a topic?).:

There is no specific pre-requisite knowledge or expertise expected for attendance. However, the exact format the hackathon takes for different participants may vary as a function of expertise. For example, those very confident in data analysis may want to jump straight in and pilot the protocol on a dataset, whereas others might be more comfortable giving feedback on the protocol via open discussion or comments on a live document. A knowledge of what QRPs are would be beneficial – suggested reading is Nagy et al. (2025) https://doi.org/10.1177/25152459251348431 [which happens to be a previous SIPS product!]

I am currently an Assistant Researcher on the EXCELScIOR project at the University of Coimbra. My work falls into two main themes: 1. replicability and generalisability, and 2. uptake of open science practices by students, researchers, and journal editors. I am also currently Associate Director of the Journal Editors Discussion Interface.

This speaker also appears in: