 |
 |
 |
|
|
|
| HAL : halshs-00710122, version 1 |
| Fiche détaillée |  Récupérer au format |
 |
|
|
| Star wars: The empirics strike back |
|
|
| Abel Brodeur 1, 2Mathias Lé 1, 2 |
|
|
| (06/2012) |
|
|
|
| Journals favor rejections of the null hypothesis. This selection upon results may distort the behavior of researchers. Using 50,000 tests published between 2005 and 2011 in the AER, JPE and QJE, we identify a residual in the distribution of tests that cannot be explained by selection. The distribution of p-values exhibits a camel shape with abundant p-values above :25, a valley between :25 and :10 and a bump slightly under :05. Missing tests are those which would have been accepted but close to being rejected (p-values between :25 and :10). We show that this pattern corresponds to a shift in the distribution of p-values: between 10% and 20% of marginally rejected tests are misallocated. Our interpretation is that researchers might be tempted to inflate the value of their tests by choosing the specification that provides the highest statistics. Note that Inflation is larger in articles where stars are used in order to highlight statistical significance and lower in articles with theoretical models. |
|
|
|
|
|
|
|
|
|
|
|
| 1 : | Paris-Jourdan Sciences Economiques (PSE) |
|
|
|
CNRS : UMR8545 – École des Hautes Études en Sciences Sociales [EHESS] – Ecole des Ponts ParisTech – Ecole normale supérieure de Paris - ENS Paris – Institut national de la recherche agronomique (INRA) |
|
|
| 2 : | Ecole d'Économie de Paris - Paris School of Economics (EEP-PSE) |
|
|
|
Ecole d'Économie de Paris |
|
|
| 3 : | Sciences Po Paris - Institut d'études politiques de Paris (IEP Paris) |
|
|
|
Institut d'Études Politiques [IEP] - Paris – PRES Sorbonne Paris Cité – Fondation Nationale des Sciences Politiques [FNSP] |
|
|
| 4 : | Centre de Recerca en Economia Internacional (CREI) |
|
|
|
Universitat Pompeu Fabra |
|
|
|
|
|
|
|
|
|
| Discipline | : | Sciences de l'Homme et Société/Economie et finances |
|
|
| Hypothesis testing – Distorting incentives – Selection bias – Research in economics |
|
|
|
| Liste des fichiers attachés à ce document : | |||||
|
|||||
|
|
|
| halshs-00710122, version 1 | |
| http://halshs.archives-ouvertes.fr/halshs-00710122 | |
| oai:halshs.archives-ouvertes.fr:halshs-00710122 | |
| Contributeur : Caroline Bauer | |
| Soumis le : Mercredi 20 Juin 2012, 10:13:36 | |
| Dernière modification le : Jeudi 21 Juin 2012, 11:43:29 | |
