Meta-science

Study on data compliance unearths incorrect analyses

Originally at https://metascience.shaunagm.net/post/41874985235/study-on-data-compliance-unearths-incorrect-analyses

A post at Retraction Watch summarizes the situation:

Overall, data submission was reported at publication for 40% of all articles, and almost 75% of articles were MIAME noncompliant. On average, articles that included full data submission scored significantly higher on a quality metric than articles with limited or no data submission, and studies with adequate description of methods disproportionately included larger numbers of experimental repeats. Finally, for several articles that were not MIAME compliant, data reanalysis revealed less than complete support for the published conclusions, in 1 case leading to retraction.

That post also links to an editorial on data access and reproducibility:

Ideally, reproduction (which should be faster and cheaper) should precede replication as a sanity check. Poor data access hinders both. Even when data are supplied, reproducibility should not be presumed; in their survey of 18 microarray studies, Ioannidis et al. (5 ) were able to access data for 10 studies but could reproduce quantitative results for just 2.