Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environments

Authors

  • Mitas Ray University of Washington, Seattle
  • Lillian J. Ratliff University of Washington, Seattle
  • Dmitriy Drusvyatskiy University of Washington, Seattle
  • Maryam Fazel University of Washington, Seattle

DOI:

https://doi.org/10.1609/aaai.v36i7.20780

Keywords:

Machine Learning (ML), Game Theory And Economic Paradigms (GTEP)

Abstract

This paper studies the problem of expected loss minimization given a data distribution that is dependent on the decision-maker's action and evolves dynamically in time according to a geometric decay process. Novel algorithms for both the information setting in which the decision-maker has a first order gradient oracle and the setting in which they have simply a loss function oracle are introduced. The algorithms operate on the same underlying principle: the decision-maker deploys a fixed decision repeatedly over the length of an epoch, thereby allowing the dynamically changing environment to sufficiently mix before updating the decision. The iteration complexity in each of the settings is shown to match existing rates for first and zero order stochastic gradient methods up to logarithmic factors. The algorithms are evaluated on a ``semi-synthetic" example using real world data from the SFpark dynamic pricing pilot study; it is shown that the announced prices result in an improvement for the institution's objective (target occupancy), while achieving an overall reduction in parking rates.

Downloads

Published

2022-06-28

How to Cite

Ray, M., Ratliff, L. J., Drusvyatskiy, D., & Fazel, M. (2022). Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environments. Proceedings of the AAAI Conference on Artificial Intelligence, 36(7), 8081-8088. https://doi.org/10.1609/aaai.v36i7.20780

Issue

Section

AAAI Technical Track on Machine Learning II