Date of this Version
Perspectives on Psychological Science
Intelligence analysis plays a vital role in policy decision making. Key functions of intelligence analysis include accurately forecasting significant events, appropriately characterizing the uncertainties inherent in such forecasts, and effectively communicating those probabilistic forecasts to stakeholders. We review decision research on probabilistic forecasting and uncertainty communication, drawing attention to findings that could be used to reform intelligence processes and contribute to more effective intelligence oversight. We recommend that the intelligence community (IC) regularly and quantitatively monitor its forecasting accuracy to better understand how well it is achieving its functions. We also recommend that the IC use decision science to improve these functions (namely, forecasting and communication of intelligence estimates made under conditions of uncertainty). In the case of forecasting, decision research offers suggestions for improvement that involve interventions on data (e.g., transforming forecasts to debias them) and behavior (e.g., via selection, training, and effective team structuring). In the case of uncertainty communication, the literature suggests that current intelligence procedures, which emphasize the use of verbal probabilities, are ineffective. The IC should, therefore, leverage research that points to ways in which verbal probability use may be improved as well as exploring the use of numerical probabilities wherever feasible.
Mandeep K. Dhami, David R. Mandel, Barbara A. Mellers & Phillip E. Tetlock, "Improving Intelligence Analysis With Decision Science", Perspectives on Psychological Science, 10(6), pp. 753-757. Copyright © 2015 SAGE. Reprinted by permission of SAGE Publications.
intelligence analysis, decision science, forecasting, uncertainty
Dhami, M. K., Mandel, D. R., Mellers, B., & Tetlock, P. E. (2015). Improving Intelligence Analysis With Decision Science. Perspectives on Psychological Science, 10 (6), 753-757. http://dx.doi.org/10.1177/1745691615598511
Date Posted: 19 February 2018
This document has been peer reviewed.