The Healthy States of America: Creating a Health Taxonomy with Social Media

Authors

  • Sanja Šćepanović Nokia Bell Labs
  • Luca Maria Aiello Nokia Bell Labs, IT University of Copenhagen
  • Ke Zhou Nokia Bell Labs, University of Nottingham
  • Sagar Joglekar Nokia Bell Labs
  • Daniele Quercia Nokia Bell Labs, CUSP King's College London

Keywords:

Measuring predictability of real world phenomena based on social media, e.g., spanning politics, finance, and health, Qualitative and quantitative studies of social media, Credibility of online content

Abstract

Since the uptake of social media, researchers have mined online discussions to track the outbreak and evolution of specific diseases or chronic conditions such as influenza or depression. To broaden the set of diseases under study, we developed a Deep Learning tool for Natural Language Processing that extracts mentions of virtually any medical condition or disease from unstructured social media text. With that tool at hand, we processed Reddit and Twitter posts, analyzed the clusters of the two resulting co-occurrence networks of conditions, and discovered that they correspond to well-defined categories of medical conditions. This resulted in the creation of the first comprehensive taxonomy of medical conditions automatically derived from online discussions. We validated the structure of our taxonomy against the official International Statistical Classification of Diseases and Related Health Problems (ICD-11), finding matches of our clusters with 20 official categories, out of 22. Based on the mentions of our taxonomy's sub-categories on Reddit posts geo-referenced in the U.S., we were then able to compute disease-specific health scores. As opposed to counts of disease mentions or counts with no knowledge of our taxonomy's structure, we found that our disease-specific health scores are causally linked with the officially reported prevalences of 18 conditions.

Downloads

Published

2021-05-22

How to Cite

Šćepanović, S., Aiello, L. M., Zhou, K., Joglekar, S., & Quercia, D. (2021). The Healthy States of America: Creating a Health Taxonomy with Social Media. Proceedings of the International AAAI Conference on Web and Social Media, 15(1), 621-632. Retrieved from https://ojs.aaai.org/index.php/ICWSM/article/view/18089