Workshop “Reproducible research practices for psychologists”

Johannes Breuer & Frederik Aust

Workshop description

For several years, psychological science has been facing a crisis of confidence fueled by concerns about low rates of successful replications of empirical findings. Different solutions have been proposed to address this issue. A key factor in these efforts is increasing transparency and computational reproducibility of psychological research. While transparent and computationally reproducible research is not necessarily more replicable, it facilitates replication attempts and helps to foster trust in empirical findings. The evolving open science ecosystem provides a variety of tools and services that can be used to implement reproducible research practices. Navigating the growing space of tools and practices, however, can be a daunting task.

Hence, the purpose of this 2 days workshop is to introduce researchers to the essential components of tailored reproducible research workflows as well as the tools for implementing them. Combining lectures with practical hands-on sessions, the workshop will focus on data analysis, reporting of results, and sharing data and materials. Regarding the tool stack, the workshop will cover version control with Git and writing reports with RMarkdown as key components of a reproducible research workflow, but will also introduce other tools, such as the Open Science Framework (OSF), Docker, and Binder.

Learning objectives

Upon course completion, participants should

  1. be familiar with key concepts of reproducible research
  2. be able to choose the appropriate tools to implement a tailored workflow
  3. have gained basic proficiency of Git, LaTeX, R Markdown, and papaja
  4. be able to manage projects and collaborate using Git and GitHub

Prerequisites

Participants should have some basic knowledge of R have used R Studio before.

Modules

Topic Duration Slides Exercises
Introduction to key concepts 2
R Markdown 2
papaja 1.5
Git & GitHub 1
Git & RStudio 1
Collarboration with Git and GitHub 1.5
Combating code rot 1
Publishing 0.5

Acknowledgements

Materials are based on Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Hofelich Mohr, A., … Frank, M. C. (2018). A Practical Guide for Transparency in Psychological Science. Collabra: Psychology, 4(1). doi: 10.1525/collabra.158 (Supplementary material)

Icons by Icons8, CC-BY-ND 3.0.

GitHub

View Github