Skip to Content

Sponsors

No results

Keywords

No results

Types

No results

Search Results

Events

No results
Search events using: keywords, sponsors, locations or event type
When / Where

Presented By: Department of Economics

Empirical Bayes for Compound Adaptive Experiments (joint with Karun Adusumilli and Junfan Tao)

Jiaying Gu, University of Toronto

Block M Block M
Block M
We investigate Empirical Bayes (EB) methods in the context of compound adaptive experiments, where the arm distribution in each experiment follows a normal distribution with an unknown mean that we seek to estimate. There are two main EB strategies: g-modeling, which estimates the prior by maximizing the marginal likelihood, and f-modeling, which derives posterior means directly from the empirical distribution of the observations. We show that g-modeling continues to be a valid EB procedure even when it incorrectly assumes that data are collected exogenously; its validity does not depend on the particular sampling algorithm or on whether sample sizes are endogenous. In practice, one can apply standard g-modeling techniques by acting as though the data were exogenously sampled. We extend regret guarantees from exogenous sampling to adaptively generated data. By contrast, naively applying the Tweedie formula based on the marginal density of the observed data, as in standard f-modeling, can produce biased rules under adaptive sampling. We corroborate the robustness of g-modeling through simulations with widely used adaptive algorithms and demonstrate its applicability using a real-world dataset consisting of multiple sequential experiments.

Explore Similar Events

  •  Loading Similar Events...

Back to Main Content