Manchester Metropolitan University's Research Repository

    We don't know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing

    Loenneker, Hannah D ORCID logoORCID: https://orcid.org/0000-0003-0327-6507, Buchanan, Erin M ORCID logoORCID: https://orcid.org/0000-0002-9689-4189, Martinovici, Ana ORCID logoORCID: https://orcid.org/0000-0003-1940-0293, Primbs, Maximilian A ORCID logoORCID: https://orcid.org/0000-0002-3398-5569, Elsherif, Mahmoud M ORCID logoORCID: https://orcid.org/0000-0002-0540-3998, Baker, Bradley J ORCID logoORCID: https://orcid.org/0000-0002-1697-4198, Dudda, Leonie A, Đurđević, Dušica F ORCID logoORCID: https://orcid.org/0000-0001-5044-5428, Mišić, Ksenija, Peetz, Hannah K ORCID logoORCID: https://orcid.org/0000-0002-1486-5342, Röer, Jan P ORCID logoORCID: https://orcid.org/0000-0001-7774-3433, Schulze, Lars ORCID logoORCID: https://orcid.org/0000-0003-4720-2411, Wagner, Lisa ORCID logoORCID: https://orcid.org/0000-0002-1925-2676, Wolska, Julia K ORCID logoORCID: https://orcid.org/0000-0001-8675-4388, Kührt, Corinna ORCID logoORCID: https://orcid.org/0000-0002-6418-6479 and Pronizius, Ekaterina ORCID logoORCID: https://orcid.org/0000-0003-1446-196X (2024) We don't know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing. Cortex, 172. pp. 14-37. ISSN 0010-9452

    Published Version
    Available under License Creative Commons Attribution.

    Download (3MB) | Preview


    In behavioral, cognitive, and social sciences, reaction time measures are an important source of information. However, analyses on reaction time data are affected by researchers' analytical choices and the order in which these choices are applied. The results of a systematic literature review, presented in this paper, revealed that the justification for and order in which analytical choices are conducted are rarely reported, leading to difficulty in reproducing results and interpreting mixed findings. To address this methodological shortcoming, we created a checklist on reporting reaction time pre-processing to make these decisions more explicit, improve transparency, and thus, promote best practices within the field. The importance of the pre-processing checklist was additionally supported by an expert consensus survey and a multiverse analysis. Consequently, we appeal for maximal transparency on all methods applied and offer a checklist to improve replicability and reproducibility of studies that use reaction time measures.

    Impact and Reach


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics for this dataset are available via IRStats2.


    Repository staff only

    Edit record Edit record