P-curve: A Key to The File Drawer

Loading...
Thumbnail Image
Penn collection
Operations, Information and Decisions Papers
Degree type
Discipline
Subject
publication bias
selective reporting
p-hacking
false-positive psychology
hypothesis testing
Other Psychology
Other Statistics and Probability
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Simonsohn, Uri
Nelson, Leif. D
Simmons, Joseph. P
Contributor
Abstract

Because scientists tend to report only studies (publication bias) or analyses (p-hacking) that “work,” readers must ask, “Are these effects true, or do they merely reflect selective reporting?” We introduce p-curve as a way to answer this question. P-curve is the distribution of statistically significant p values for a set of studies (ps .05). Because only true effects are expected to generate right-skewed p-curves— containing more low (.01s) than high (.04s) significant p values— only right-skewed p-curves are diagnostic of evidential value. By telling us whether we can rule out selective reporting as the sole explanation for a set of findings, p-curve offers a solution to the age-old inferential problems caused by file-drawers of failed studies and analyses.

Advisor
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Publication date
2014-01-01
Journal title
Journal of Experimental Psychology: General
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
This article may not exactly replicate the final version published in the APA journal. It is not the copy of record.
Recommended citation
Collection