Multi-Dimensional Explanation of Target Variables from Documents

Authors

  • Diego Antognini École Polytechnique Fédérale de Lausanne
  • Claudiu Musat Swisscom
  • Boi Faltings École Polytechnique Fédérale de Lausanne

Keywords:

Interpretaility & Analysis of NLP Models, Text Classification & Sentiment Analysis

Abstract

Automated predictions require explanations to be interpretable by humans. Past work used attention and rationale mechanisms to find words that predict the target variable of a document. Often though, they result in a tradeoff between noisy explanations or a drop in accuracy. Furthermore, rationale methods cannot capture the multi-faceted nature of justifications for multiple targets, because of the non-probabilistic nature of the mask. In this paper, we propose the Multi-Target Masker (MTM) to address these shortcomings. The novelty lies in the soft multi-dimensional mask that models a relevance probability distribution over the set of target variables to handle ambiguities. Additionally, two regularizers guide MTM to induce long, meaningful explanations. We evaluate MTM on two datasets and show, using standard metrics and human annotations, that the resulting masks are more accurate and coherent than those generated by the state-of-the-art methods. Moreover, MTM is the first to also achieve the highest F1 scores for all the target variables simultaneously.

Downloads

Published

2021-05-18

How to Cite

Antognini, D., Musat, C., & Faltings, B. (2021). Multi-Dimensional Explanation of Target Variables from Documents. Proceedings of the AAAI Conference on Artificial Intelligence, 35(14), 12507-12515. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/17483

Issue

Section

AAAI Technical Track on Speech and Natural Language Processing I