Reading Between the Lines: How Electronic Nonverbal Cues Shape Emotion Decoding

Authors

  • Taara Muthu Kumar National University of Singapore
  • Kokil Jaidka National University of Singapore

DOI:

https://doi.org/10.1609/icwsm.v20i1.42716

Abstract

As text-based computer-mediated communication (CMC) increasingly structures everyday interaction, a central question re-emerges with new urgency: How do users reconstruct nonverbal expression in environments where embodied cues are absent? This paper provides the first systematic, theory-driven account of electronic nonverbal cues (eNVCs) - textual analogues of kinesics, vocalics, and paralinguistics - in public microblog communication. Across three complementary studies, we advance conceptual, empirical, and methodological contributions. Study 1 develops a unified taxonomy of eNVCs grounded in foundational nonverbal communication theory and introduces a scalable Python toolkit for their automated detection. Study 2, a within-subject survey experiment, offers the first causal evidence that eNVCs substantially improve emotional decoding accuracy and lower perceived ambiguity, while also identifying boundary conditions, such as sarcasm, under which these benefits weaken or disappear. Study 3, through focus group discussions, reveals the interpretive strategies users employ when reasoning about digital prosody, including drawing meaning from the absence of expected cues and defaulting toward negative interpretations in ambiguous contexts. Together, these studies establish eNVCs as a coherent and measurable class of digital behaviors, refine theoretical accounts of cue richness and interpretive effort, and provide practical tools for affective computing, user modeling, and emotion-aware interface design.

Downloads

Published

2026-05-25

How to Cite

Muthu Kumar, T., & Jaidka, K. (2026). Reading Between the Lines: How Electronic Nonverbal Cues Shape Emotion Decoding. Proceedings of the International AAAI Conference on Web and Social Media, 20(1), 1634–1651. https://doi.org/10.1609/icwsm.v20i1.42716