American Politicians Diverge Systematically, Indian Politicians do so Chaotically: Text Embeddings as a Window into Party Polarization

Authors

  • Amar Budhiraja Myntra Designs Pvt. Ltd.
  • Ankur Sharma Microsoft Redmond
  • Rahul Agrawal Bing Ads, Microsoft
  • Monojit Choudhury Microsoft Research, India
  • Joyojeet Pal Microsoft Research India

DOI:

https://doi.org/10.1609/icwsm.v15i1.18129

Keywords:

Qualitative and quantitative studies of social media, Social network analysis; communities identification; expertise and authority discovery, Text categorization; topic recognition; demographic/gender/age identification, Measuring predictability of real world phenomena based on social media, e.g., spanning politics, finance, and health

Abstract

Conversations on polarization are increasingly central to discussions of politics and society, but the schisms between parties and states can be hard to identify systematically in what politicians say. In this paper, we demonstrate the use of representation learning as a window into political dialogue on social media through the tweets authored by politicians on Twitter. We propose to embed politicians in a space such that their output embedding vectors represent the content similarity between the two politicians based on their tweets. We further propose a short-text based embedding technique to overcome some of the shortcomings of the previous methods. The learnt embeddings for politicians of India and the United States show two trends. First, that in the US case, we find a clear distinction between Democrats and Republicans, which is also reflected in the coalescing of the states that lean towards each party placing likewise in a graphical space. However, in the Indian case, the federal structure, multiparty system, and linguistic differences clearly manifest in the coalescing political discourse in the largely monolingual north and the scattered regional states. Our work shows ways in which machine learning methods can offer a window into thinking about how polarized political discourses manifest in what politicians say online.

Downloads

Published

2021-05-22

How to Cite

Budhiraja, A., Sharma, A., Agrawal, R., Choudhury, M., & Pal, J. (2021). American Politicians Diverge Systematically, Indian Politicians do so Chaotically: Text Embeddings as a Window into Party Polarization. Proceedings of the International AAAI Conference on Web and Social Media, 15(1), 1054-1058. https://doi.org/10.1609/icwsm.v15i1.18129