280 Characters to Employment: Using Twitter to Quantify Job Vacancies

Authors

  • Boris Sobol Ben-Gurion University of the Negev
  • Manuel Tonneau University of Oxford World Bank New York University
  • Samuel Fraiberger World Bank New York University Massachusetts Institute of Technology
  • Do Lee New York University
  • Nir Grinberg Ben-Gurion University of the Negev

DOI:

https://doi.org/10.1609/icwsm.v18i1.31403

Abstract

Accurate assessment of workforce needs is critical for designing well-informed economic policy and improving market efficiency. While surveys are the gold standard for estimating when and where workers are needed, they also have important limitations, most notably their substantial costs, dependence on existing and extensive surveying infrastructure, and limited temporal, geographical, and sectorial resolution. Here, we investigate the potential of social media to provide a complementary signal for estimating labor market demand. We introduce a novel statistical approach for extracting information about the location and occupation advertised in job vacancies posted on Twitter. We then construct an aggregate index of labor market demand by occupational class in every major U.S. city from 2015 to 2022, which we evaluate against two sources of official statistics and an index from a large aggregator of online job postings. We find that the newly constructed index is strongly correlated with official statistics and, in some cases, advantageous compared to statistics from job aggregators. Moreover, we demonstrate that our index can robustly improve the prediction of official statistics across occupations and states.

Downloads

Published

2024-05-28

How to Cite

Sobol, B., Tonneau, M., Fraiberger, S., Lee, D., & Grinberg, N. (2024). 280 Characters to Employment: Using Twitter to Quantify Job Vacancies. Proceedings of the International AAAI Conference on Web and Social Media, 18(1), 1477-1489. https://doi.org/10.1609/icwsm.v18i1.31403