Improving Review Representations With User Attention and Product Attention for Sentiment Classification

Authors

  • Zhen Wu Nanjing University
  • Xin-Yu Dai Nanjing University
  • Cunyan Yin Nanjing University
  • Shujian Huang Nanjing University
  • Jiajun Chen Nanjing University

Keywords:

Neural network, Attention, Sentiment classification

Abstract

Neural network methods have achieved great success in reviews sentiment classification. Recently, some works achieved improvement by incorporating user and product information to generate a review representation. However, in reviews, we observe that some words or sentences show strong user's preference, and some others tend to indicate product's characteristic. The two kinds of information play different roles in determining the sentiment label of a review. Therefore, it is not reasonable to encode user and product information together into one representation. In this paper, we propose a novel framework to encode user and product information. Firstly, we apply two individual hierarchical neural networks to generate two representations, with user attention or with product attention. Then, we design a combined strategy to make full use of the two representations for training and final prediction. The experimental results show that our model obviously outperforms other state-of-the-art methods on IMDB and Yelp datasets. Through the visualization of attention over words related to user or product, we validate our observation mentioned above.

Downloads

Published

2018-04-26

How to Cite

Wu, Z., Dai, X.-Y., Yin, C., Huang, S., & Chen, J. (2018). Improving Review Representations With User Attention and Product Attention for Sentiment Classification. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1). Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/12054