Thomas, P.; Theocharous, G.; Ghavamzadeh, M.; Durugkar, I.; Brunskill, E. Predictive Off-Policy Policy Evaluation for Nonstationary Decision Problems, With Applications to Digital Marketing. AAAI 2017, 31, 4740-4745.