Optimizing Adaptive Marketing Experiments with the Multi-Armed Bandit

Loading...
Thumbnail Image
Degree type
Doctor of Philosophy (PhD)
Graduate group
Marketing
Discipline
Subject
Advertising and Promotion Management
Marketing
Funder
Grant number
License
Copyright date
2014-08-20T20:13:00-07:00
Distributor
Related resources
Contributor
Abstract

Sequential decision making is central to a range of marketing problems. Both firms and consumers aim to maximize their objectives over time, yet they remain uncertain about the best course of action. So they allocate resources to both explore to reduce uncertainty (learning) and exploit their current information for immediate reward (earning). This explore/exploit tradeoff is best captured by the multi-armed bandit, the conceptual and methodological backbone of this dissertation. We focus on this class of marketing problems and aim to make the following substantive and methodological contributions. Our substantive contribution is that we solve an important and practical marketing problem with challenges that exceed those handled by existing multi-armed bandit methods: sequentially allocating resources for online advertising to acquire customers. Online advertisers serve millions of ad impressions to learn which ads work best on which websites. However, recognizing that ad effectiveness differs by website in unobserved ways creates a methodological challenge. Our methodological contribution is that we propose a novel bandit policy that simultaneously handles attributes of ads and how their importance differs across websites (heterogeneity) to generate recommended allocations of ad impressions. We not only test this in simulation, but we also run a live field experiment with a large retail bank to improve customer acquisition rates, lowering the firm's cost per acquisition. Serving ads across websites is just one of a broader class of problems. Broadening our scope to that class, we aim to contribute a body of empirical results to better understand how key managerial issues in marketing experiments affect the performance of bandit methods. As firms become more sophisticated in their ability to test and adapt quickly, managers and researchers should understand the empirical realities of the problems and policies, such as, under what conditions do certain methods perform better than other methods. We run a numerical experiment motivated by common managerial issues to learn about these contingencies of bandit methods. Finally, while the literature spans disparate fields of research, we hope to organize the various streams of work to better guide future research using multi-armed bandit methods to solve marketing problems.

Advisor
Eric T. Bradlow
Peter S. Fader
Date of degree
2013-01-01
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation