Partial Information Framework: Basic Theory and Applications

Loading...
Thumbnail Image
Degree type
Doctor of Philosophy (PhD)
Graduate group
Statistics
Discipline
Subject
Expert belief
Forecast heterogeneity
Judgmental forecasting
Model averaging
Noise reduction
Probability modeling
Applied Mathematics
Mathematics
Statistics and Probability
Funder
Grant number
License
Copyright date
2016-11-29T00:00:00-08:00
Distributor
Related resources
Contributor
Abstract

Many real-world decisions depend on accurate predictions of some future outcome. In such cases the decision-maker often seeks to consult multiple people or/and models for their forecasts. These forecasts are then aggregated into a consensus that is inputted in the final decision-making process. Principled aggregation requires an understanding of why the forecasts are different. Historically, such forecast heterogeneity has been explained by measurement error. This dissertation, however, first shows that measurement error is not appropriate for modeling forecast heterogeneity and then introduces information diversity as a more appropriate yet fundamentally different alternative. Under information diversity differences in the forecasts stem purely from differences in the information that is used in the forecasts. This is made mathematically precise in a new modeling framework called the partial information framework. At its most general level, the partial information framework is a very reasonable model of multiple forecasts and hence offers an ideal platform for theoretical analysis. For one, it explains the empirical phenomenon known as extremization. This is a popular technique that often improves the out-of-sample performance of simple aggregators, such as the average or median, by transforming them directly away from the marginal mean of the outcome. Unfortunately, the general framework is too abstract for practical applications. To apply the framework in practice one needs to choose a parametric distribution for the forecasts and outcome. This dissertation motivates and chooses the multivariate Gaussian distribution. The result, known as the Gaussian partial information model, is a very close yet practical specification of the framework. The optimal aggregator under the Gaussian model is shown to outperform the state-of-the-art measurement error aggregators on both synthetic and many different types of real-world forecasts.

Advisor
Lyle H. Ungar
Shane T. Jensen
Date of degree
2016-01-01
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation