Logo Datenfrühstück

To get started with replications (and reproductions) there is now a growing body of literature to get into the topic. There are also initiatives that collect knowledge around the topics of replicability and reproducibility such as FORRT. Here, we list some publications that have received attention in this regard.

  • Artner, R., Verliefde, T., Steegen, S., ..., & Vanpaemel, W. (2021). The reproducibility of statistical results in psychological research: An investigation using unpublished raw data. Psychological Methods, 26(5), 527–546. https://doi.org/10.1037/met0000365
  • Breuer, J., & Haim, M. (2024). Are we replicating yet? Reproduction and replication in communication research. Media and Communication, 12, 1-7. https://doi.org/10.17645/mac.8382
  • Camerer, C. F., Dreber, A., Forsell, E., ..., & Wu, H. (2016). Evaluating replicability of laboratory experiments in economics. Science, 351(6280), 1433–1436. https://doi.org/10.1126/science.aaf0918
  • Camerer, C. F., Dreber, A., Holzmeister, F., ..., & Wu, H. (2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour, 2(9), 637–644. https://doi.org/10.1038/s41562-018-0399-z
  • Chan, C.-hong, Schatto-Eckrodt, T., & Gruber, J. (2024). What makes computational communication science (ir)reproducible?. Computational Communication Research, 6(1). https://doi.org/10.5117/CCR2024.1.5.CHAN
  • Dienlin, T., Johannes, N., Bowman, N.D., ..., de Vreese, C. (2021). An agenda for open science in communication. Journal of Communication, 71(1), 1–26. https://doi.org/10.1093/joc/jqz052
  • Dreber, A., & Johannesson, M. (2019). Statistical significance and the replication crisis in the social sciences. In Oxford Research Encyclopedia of Economics and Finance. Oxford University Press. https://doi.org/10.1093/acrefore/9780190625979.013.461
  • Dreber, A., & Johannesson, M. (2023). A framework for evaluating reproducibility and replicability in economics (Working Paper 38; I4R Discussion Paper Series). Institute for Replication (I4R). http://hdl.handle.net/10419/271678
  • Earp, B. D., & Trafimow, D. (2015). Replication, falsification, and the crisis of confidence in social psychology. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00621
  • Haim, M., & Jungblut, M. (2023). How open is communication science? Open-science principles in the field. Annals of the International Communication Association, 47(3), 338–357. https://doi.org/10.1080/23808985.2023.2201601
  • Keating, D. M., & Totzkay, D. (2019). We do publish (conceptual) replications (sometimes): Publication trends in communication science, 2007–2016. Annals of the International Communication Association, 43(3), 225–239. https://doi.org/10.1080/23808985.2019.1632218
  • Kelly, C. W., Chase, L. J., & Tucker, R. K. (1979). Replication in experimental communication research: An analysis. Human Communication Research, 5(4), 338–342. https://doi.org/10.1111/j.1468-2958.1979.tb00646.x
  • Krähmer, D., Schächtele, L., & Schneck, A. (2023). Care to share? Experimental evidence on code sharing behavior in the social sciences. PLOS ONE, 18(8), e0289380. https://doi.org/10.1371/journal.pone.0289380
  • McEwan, B., Carpenter, C.J., Westerman, D. (2018). On replication in Communication Science. Communication Studies, 69(3), 235–241. https://doi.org/10.1080/10510974.2018.1464938
  • Mede, N. G., Schäfer, M. S., Ziegler, R., & Weißkopf, M. (2021). The "replication crisis" in the public eye: Germans’ awareness and perceptions of the (ir)reproducibility of scientific research. Public Understanding of Science, 30(1), 91–102. https://doi.org/10.1177/0963662520954370
  • Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2024). Replication of "null results" – Absence of evidence or evidence of absence? eLife, 12(reviewed preprint), RP92311. https://doi.org/10.7554/eLife.92311.2
  • Schoch, D., Chan, C., Wagner, C., & Bleier, A. (2023). Computational reproducibility in computational social science (2307.01918; Version 4). arXiv. https://doi.org/10.48550/ARXIV.2307.01918

On a more personal note, this project is a collection of various endeavors in communication science (and slightly beyond), conducted by both students and others. Inspiration has been drawn from Leipziger Replikationsstudien. Source code publicly available on GitHub.

In case of questions, do not hesitate to reach out.