LeadLag LDA: Estimating Topic Specific Leads and Lags of Information Outlets

Authors

  • Ramesh Nallapati Stanford University
  • Xiaolin Shi Stanford University
  • Daniel McFarland Stanford University
  • Jure Leskovec Stanford University
  • Daniel Jurafsky Stanford University

Abstract

Identifying which outlet in social media leads the rest in disseminating novel information on specific topics is an interesting challenge for information analysts and social scientists. In this work, we hypothesize that novel ideas are disseminated through the creation and propagation of new or newly emphasized key words, and therefore lead/lag of outlets can be estimated by tracking word usage across these outlets. First, we demonstrate the validaty of our hypothesis by showing that a simple TF-IDF based nearest-neighbors approach can recover generally accepted lead/lag behavior on the outlets pair of ACM journal articles and conference papers. Next, we build a new topic model called LeadLag LDA that estimates the lead/lag of the outlets on specific topics. We validate the topic model using the lead/lag results from the TF-IDF nearest neighbors approach. Finally, we present results from our model on two different outlet pairs of blogs vs. news media and grant proposals vs. research publications that reveal interesting patterns.

Downloads

Published

2021-08-03

How to Cite

Nallapati, R., Shi, X., McFarland, D., Leskovec, J., & Jurafsky, D. (2021). LeadLag LDA: Estimating Topic Specific Leads and Lags of Information Outlets. Proceedings of the International AAAI Conference on Web and Social Media, 5(1), 558-561. Retrieved from https://ojs.aaai.org/index.php/ICWSM/article/view/14147