Finance Papers

Document Type

Journal Article

Date of this Version

12-2015

Publication Source

Journal of Experimental Psychology: General

Volume

144

Issue

6

Start Page

1146

Last Page

1152

DOI

10.1037%2Fxge0000104

Abstract

When studies examine true effects, they generate right-skewed p-curves, distributions of statistically significant results with more low (.01 s) than high (.04 s) p values. What else can cause a right-skewed p-curve? First, we consider the possibility that researchers report only the smallest significant pvalue (as conjectured by Ulrich & Miller, 2015), concluding that it is a very uncommon problem. We then consider more common problems, including (a) p-curvers selecting the wrong p values, (b) fake data, (c) honest errors, and (d) ambitiously p-hacked (beyond p < .05) results. We evaluate the impact of these common problems on the validity of p-curve analysis, and provide practical solutions that substantially increase its robustness.

Copyright/Permission Statement

©American Psychological Association, 2015. This paper is not the copy of record and may not exactly replicate the authoritative document published in the APA journal. Please do not copy or cite without author's permission. The final article is available, upon publication, at: http://dx.doi.org/10.1037/xge0000104

Share

COinS
 

Date Posted: 27 November 2017

This document has been peer reviewed.