Reproducibility Project
Originally at https://meta-science.tumblr.com/post/21494423941/reproducibility-project
From the website:
Do normative scientific practices and incentive structures produce a biased body of research evidence? The Reproducibility Project is the first known empirical effort to estimate the reproducibility of a sample of studies from the scientific literature. The project is a large-scale, open collaboration involving dozens of scientists from around the world. The investigation is currently sampling from the 2008 issues of three prominent psychology journals - Journal of Personality and Social Psychology, Psychological Science, and Journal of Experimental Psychology: Learning, Memory, and Cognition. Individuals or teams of scientists follow a structured protocol for designing and conducting a close, high-powered replication of a key effect from the selected articles. The project will evaluate the ability to reproduce the original study procedures and the overall probability of replicating the original results. Further, it will examine the predictors of replication success - e.g., publishing journal, number of conceptual/direct replications in the published literature, citation impact of the original article, closeness of the replication to the original circumstances: sample, setting, materials. Interested contributors can still join the project.