Deep Discourse Analysis for Generating Personalized Feedback in Intelligent Tutor Systems

Authors

  • Matt Grenander University of Edinburgh
  • Robert Belfer Korbit Technologies
  • Ekaterina Kochmar Korbit Technologies University of Cambridge
  • Iulian V. Serban Korbit Technologies
  • François St-Hilaire Korbit Technologies
  • Jackie C. K. Cheung McGill University Mila

Keywords:

Intelligent Tutoring Systems (ITS), Natural Language Processing (NLP), Deep Learning, Personalized Feedback, STEM Education

Abstract

We explore creating automated, personalized feedback in an intelligent tutoring system (ITS). Our goal is to pinpoint correct and incorrect concepts in student answers in order to achieve better student learning gains. Although automatic methods for providing personalized feedback exist, they do not explicitly inform students about which concepts in their answers are correct or incorrect. Our approach involves decomposing students answers using neural discourse segmentation and classification techniques. This decomposition yields a relational graph over all discourse units covered by the reference solutions and student answers. We use this inferred relational graph structure and a neural classifier to match student answers with reference solutions and generate personalized feedback. Although the process is completely automated and data-driven, the personalized feedback generated is highly contextual, domain-aware and effectively targets each student's misconceptions and knowledge gaps. We test our method in a dialogue-based ITS and demonstrate that our approach results in high-quality feedback and significantly improved student learning gains.

Downloads

Published

2021-05-18

How to Cite

Grenander, M., Belfer, R., Kochmar, E., Serban, I. V., St-Hilaire, F., & Cheung, J. C. K. (2021). Deep Discourse Analysis for Generating Personalized Feedback in Intelligent Tutor Systems. Proceedings of the AAAI Conference on Artificial Intelligence, 35(17), 15534-15544. Retrieved from https://ojs.aaai.org/index.php/AAAI/article/view/17829