TY - JOUR AU - Borghesi, Andrea AU - Bartolini, Andrea AU - Lombardi, Michele AU - Milano, Michela AU - Benini, Luca PY - 2019/07/17 Y2 - 2024/03/28 TI - Anomaly Detection Using Autoencoders in High Performance Computing Systems JF - Proceedings of the AAAI Conference on Artificial Intelligence JA - AAAI VL - 33 IS - 01 SE - IAAI Technical Track: Emerging Papers DO - 10.1609/aaai.v33i01.33019428 UR - https://ojs.aaai.org/index.php/AAAI/article/view/4993 SP - 9428-9433 AB - <p>Anomaly detection in supercomputers is a very difficult problem due to the big scale of the systems and the high number of components. The current state of the art for automated anomaly detection employs Machine Learning methods or statistical regression models in a supervised fashion, meaning that the detection tool is trained to distinguish among a fixed set of behaviour classes (healthy and unhealthy states).</p><p>We propose a novel approach for anomaly detection in High</p><p>Performance Computing systems based on a Machine (Deep) Learning technique, namely a type of neural network called <em>autoencoder</em>. The key idea is to train a set of autoencoders to learn the normal (healthy) behaviour of the supercomputer nodes and, after training, use them to identify abnormal conditions. This is different from previous approaches which where based on learning the abnormal condition, for which there are much smaller datasets (since it is very hard to identify them to begin with).</p><p>We test our approach on a real supercomputer equipped with a fine-grained, scalable monitoring infrastructure that can provide large amount of data to characterize the system behaviour. The results are extremely promising: after the training phase to learn the normal system behaviour, our method is capable of detecting anomalies that have never been seen before with a very good accuracy (values ranging between 88% and 96%).</p> ER -