SIPS 2026 Online

oLT13: Pilot reporting in psychology: Preliminary findings from an assessment of recent articles in psychology journals
2026-05-07 , Track 1

Pilot studies, typically conducted to refine methods and procedures ahead of planned data collection, are common in psychological research, but little guidance exists on how to report such studies in publications. Therefore, we designed a study that aims to examine whether 1) pilot studies are reported in published psychology literature and 2) how they are reported when mentioned. To answer these questions, we conduct a retrospective, observational assessment of recent articles in psychology journals. In the current presentation, we will present and discuss the study methodology and preliminary findings from two pilot studies where we sampled and coded over 300 articles published in 2022 and 2023. We report the main descriptive findings (e.g., proportion of pilots mentioned and related details such as pilot sample size, purpose, or results) alongside qualitative observations on how pilot studies were reported.


Landing page: Landing page Acknowledgment of Co-Authors:

Caroline Zygar-Hoffmann
Hannah Dorothea Loenneker
Julia Beitner
Lukas Wallrich
Christopher J Graham
Yashvin Seetahul
Mahmoud Elsherif
Maria Montefinese
Yu-Yang (Patrick) Chou
Brett Buttliere
Isaac Handley-Miner
Ekaterina Pronizius
Radhika Srivastava
Jane Hergert
Ilse L. Pit
Andrea H. Stoevenbelt
Armand Bardeau
Amélie Gourdon-Kanhukamwe
Irene Di Pietro
Ettore Ambrosini
Giada Viviani

Could you give us a rough idea of what your lightning talk will cover? Such as:: A brief presentation of future research (a study that has not yet started), A brief presentation of past research (a completed study)

I am a researcher and a research advisor focusing on implementing open research and reproducibility practices across disciplines at University of Oslo. My background is in cognitive psychology and linguistics with a special focus on the relationship between language and cognitive abilities in children and adults, including developmental conditions like autism. My current interest is also in meta-scientific assessments and evaluating implementation of open research.

This speaker also appears in:

Mary Beth Neff is a (contract) Associate Professor at the University of Oslo, Norway and lead of the Pilot Reporting Task Force. Her research focuses broadly on method development, alongside more domain-specific work on developmental pragmatics, theory of mind, and common ground reasoning

This speaker also appears in: