SNNN: Promoting Word Sentiment and Negation in Neural Sentiment Classification

Authors

  • Qinmin Hu East China Normal University
  • Jie Zhou East China Normal University
  • Qin Chen East China Normal University
  • Liang He East China Normal University

DOI:

https://doi.org/10.1609/aaai.v32i1.11665

Keywords:

Neural Sentiment Classification, Word Sentiment, Word Negation, LSTM

Abstract

We mainly investigate word influence in neural sentiment classification, which results in a novel approach to promoting word sentiment and negation as attentions. Particularly, a sentiment and negation neural network (SNNN) is proposed, including a sentiment neural network (SNN) and a negation neural network (NNN). First, we modify the word level by embedding the word sentiment and negation information as the extra layers for the input. Second, we adopt a hierarchical LSTM model to generate the word-level, sentence-level and document-level representations respectively. After that, we enhance word sentiment and negation as attentions over the semantic level. Finally, the experiments conducting on the IMDB and Yelp data sets show that our approach is superior to the state-of-the-art baselines. Furthermore, we draw the interesting conclusions that (1) LSTM performs better than CNN and RNN for neural sentiment classification; (2) word sentiment and negation are a strong alliance with attention, while overfitting occurs when they are simultaneously applied at the embedding layer; and (3) word sentiment/negation can be singly implemented for better performance as both embedding layer and attention at the same time.

Downloads

Published

2018-04-29

How to Cite

Hu, Q., Zhou, J., Chen, Q., & He, L. (2018). SNNN: Promoting Word Sentiment and Negation in Neural Sentiment Classification. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1). https://doi.org/10.1609/aaai.v32i1.11665