A Dialogue-Based Learning Analytics Framework for Collaborative Game-Based Learning

Authors

  • Yeo Jin Kim North Carolina State University
  • Daeun Hong Indiana University
  • Tianshu Wang North Carolina State University
  • Wookhee Min North Carolina State University
  • Snigdha Chaturvedi UNC Chapel Hill
  • Cindy E. Hmelo-Silver Indiana University
  • James Lester North Carolina State University

DOI:

https://doi.org/10.1609/aaai.v40i48.42116

Abstract

In computer-supported collaborative learning environments, analyzing student dialogue is essential for understanding collaborative problem-solving behaviors and supporting effective learning. Prior work often treats all dialogue interactions uniformly, failing to capture how specific dialogue interaction differentially impact learning experiences and outcomes. To address this limitation, we introduce a dialogue-based learning analytics framework that integrates weighted temporal clustering of dialogue with large language model-based interpretation. Our framework identifies student interaction patterns most predictive of group learning gains and uses these insights to enable early prediction of learning outcomes and generate pedagogically meaningful interpretations. We evaluate our framework on collaborative dialogue from middle school students engaged in a collaborative game-based learning environment. Our results show that our framework achieves 83.1% accuracy in learning outcome prediction. In addition, expert evaluations and case studies demonstrate that the identified weighted dialogue patterns reflect key collaborative problem-solving behaviors recognized as important in collaborative learning. By surfacing high-impact interaction patterns and enabling prioritized interpretation generation, our framework provides a promising approach for accurately analyzing students’ collaborative dialogue.

Published

2026-03-14

How to Cite

Kim, Y. J., Hong, D., Wang, T., Min, W., Chaturvedi, S., Hmelo-Silver, C. E., & Lester, J. (2026). A Dialogue-Based Learning Analytics Framework for Collaborative Game-Based Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(48), 40840–40848. https://doi.org/10.1609/aaai.v40i48.42116