Unsupervised Anomaly Detection by Robust Density Estimation

Authors

  • Boyang Liu Michigan State University
  • Pang-Ning Tan Michigan State University
  • Jiayu Zhou Michigan State University

DOI:

https://doi.org/10.1609/aaai.v36i4.20328

Keywords:

Data Mining & Knowledge Management (DMKM), Machine Learning (ML)

Abstract

Density estimation is a widely used method to perform unsupervised anomaly detection. By learning the density function, data points with relatively low densities are classified as anomalies. Unfortunately, the presence of anomalies in training data may significantly impact the density estimation process, thereby imposing significant challenges to the use of more sophisticated density estimation methods such as those based on deep neural networks. In this work, we propose RobustRealNVP, a deep density estimation framework that enhances the robustness of flow-based density estimation methods, enabling their application to unsupervised anomaly detection. RobustRealNVP differs from existing flow-based models from two perspectives. First, RobustRealNVP discards data points with low estimated densities during optimization to prevent them from corrupting the density estimation process. Furthermore, it imposes Lipschitz regularization to the flow-based model to enforce smoothness in the estimated density function. We demonstrate the robustness of our algorithm against anomalies in training data from both theoretical and empirical perspectives. The results show that our algorithm achieves competitive results as compared to state-of-the-art unsupervised anomaly detection methods.

Downloads

Published

2022-06-28

How to Cite

Liu, B., Tan, P.-N., & Zhou, J. (2022). Unsupervised Anomaly Detection by Robust Density Estimation. Proceedings of the AAAI Conference on Artificial Intelligence, 36(4), 4101-4108. https://doi.org/10.1609/aaai.v36i4.20328

Issue

Section

AAAI Technical Track on Data Mining and Knowledge Management