Daisy-chained replications
Originally at https://metascience.shaunagm.net/post/57431726255/daisy-chained-replications
This is a little old - I’m going through my bookmarks - but:
Nobel prize-winner Daniel Kahneman has issued a strongly worded call to one group of psychologists to restore the credibility of their field by creating a replication ring to check each others’ results.
…
To address this problem, Kahneman recommends that established social psychologists set up a “daisy chain” of replications. Each lab would try to repeat a priming effect demonstrated by its neighbour, supervised by someone from the replicated lab. Both parties would record every detail of the methods, commit beforehand to publish the results, and make all data openly available.
I’ve seen the daisy-chain methodology a few times in the medical research. I very much like the idea of a group of labs getting together and attempting to replicate, openly and rigorously, a specific finding, or to solve an open question. As I’ve mentioned previously, only one in every thousand psychology studies has a published replication. We’re a long way from fixing this problem across all of psychology, but within a specific sub-field a little daisy-chaining could go a long way.
You can see Kahneman’s letter here.