Chandak, Y.; Shankar, S.; Thomas, P. S. High-Confidence Off-Policy (or Counterfactual) Variance Estimation. AAAI 2021, 35, 6939-6947.