The Psychology of Intelligence Analysis: Drivers of Prediction Accuracy in World Politics

Loading...
Thumbnail Image
Penn collection
Finance Papers
Degree type
Discipline
Subject
Finance and Financial Management
Social and Behavioral Sciences
Funder
Grant number
License
Copyright date
Distributor
Related resources
Author
Mellers, Barbara
Stone, Eric
Atanasov, Pavel
Rohrbaugh, Nick
Metz, S. Emlen
Ungar, Lyle
Bishop, Michael M
Horowitz, Michael C
Merkle, Ed
Tetlock, Philip E
Contributor
Abstract

This article extends psychological methods and concepts into a domain that is as profoundly consequential as it is poorly understood: intelligence analysis. We report findings from a geopolitical forecasting tournament that assessed the accuracy of more than 150,000 forecasts of 743 participants on 199 events occurring over 2 years. Participants were above average in intelligence and political knowledge relative to the general population. Individual differences in performance emerged, and forecasting skills were surprisingly consistent over time. Key predictors were (a) dispositional variables of cognitive ability, political knowledge, and open-mindedness; (b) situational variables of training in probabilistic reasoning and participation in collaborative teams that shared information and discussed rationales (Mellers, Ungar, et al., 2014); and (c) behavioral variables of deliberation time and frequency of belief updating. We developed a profile of the best forecasters; they were better at inductive reasoning, pattern detection, cognitive flexibility, and open-mindedness. They had greater understanding of geopolitics, training in probabilistic reasoning, and opportunities to succeed in cognitively enriched team environments. Last but not least, they viewed forecasting as a skill that required deliberate practice, sustained effort, and constant monitoring of current affairs.

Advisor
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Publication date
2015-03-01
Journal title
Journal of Experimental Psychology: Applied
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation
Collection