Anomaly Attribution with Likelihood Compensation

Authors

  • Tsuyoshi Idé IBM Research, T. J. Watson Research Center
  • Amit Dhurandhar IBM Research
  • Jiří Navrátil IBM Research
  • Moninder Singh IBM Research
  • Naoki Abe IBM Research

DOI:

https://doi.org/10.1609/aaai.v35i5.16535

Keywords:

Anomaly/Outlier Detection

Abstract

This paper addresses the task of explaining anomalous predictions of a black-box regression model. When using a black-box model, such as one to predict building energy consumption from many sensor measurements, we often have a situation where some observed samples may significantly deviate from their prediction. It may be due to a sub-optimal black-box model, or simply because those samples are outliers. In either case, one would ideally want to compute a responsibility score indicative of the extent to which an input variable is responsible for the anomalous output. In this work, we formalize this task as a statistical inverse problem: Given model deviation from the expected value, infer the responsibility score of each of the input variables. We propose a new method called likelihood compensation (LC), which is founded on the likelihood principle and computes a correction to each input variable. To the best of our knowledge, this is the first principled framework that computes a responsibility score for real valued anomalous model deviations. We apply our approach to a real-world building energy prediction task and confirm its utility based on expert feedback.

Downloads

Published

2021-05-18

How to Cite

Idé, T., Dhurandhar, A., Navrátil, J., Singh, M., & Abe, N. (2021). Anomaly Attribution with Likelihood Compensation. Proceedings of the AAAI Conference on Artificial Intelligence, 35(5), 4131-4138. https://doi.org/10.1609/aaai.v35i5.16535

Issue

Section

AAAI Technical Track on Data Mining and Knowledge Management