What’s Most Broken? A Tool to Assist Data-Driven Iterative Improvement of an Intelligent Tutoring System

Authors

  • Mononito Goswami Delhi Technology University
  • Shiven Mian Indraprastha Institute of Information Technolog Delhi
  • Jack Mostow Carnegie Mellon University

DOI:

https://doi.org/10.1609/aaai.v33i01.33019941

Abstract

Intelligent Tutoring Systems (ITS) have great potential to change the educational landscape by bringing scientifically tested one-to-one tutoring to remote and under-served areas. However, effective ITSs are too complex to perfect. Instead, a practical guiding principle for ITS development and improvement is to fix what’s most broken. In this paper we present SPOT (Statistical Probe of Tutoring): a tool that mines data logged by an Intelligent Tutoring System to identify the ‘hot spots’ most detrimental to its efficiency and effectiveness in terms of its software reliability, usability, task difficulty, student engagement, and other criteria. SPOT uses heuristics and machine learning to discover, characterize, and prioritize such hot spots in order to focus ITS refinement on what matters most. We applied SPOT to data logged by RoboTutor, an ITS that teaches children basic reading, writing and arithmetic.

AAAI-19 Proceedings Cover

Downloads

Published

2019-07-17

How to Cite

Goswami, M., Mian, S., & Mostow, J. (2019). What’s Most Broken? A Tool to Assist Data-Driven Iterative Improvement of an Intelligent Tutoring System. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01), 9941-9942. https://doi.org/10.1609/aaai.v33i01.33019941

Issue

Vol. 33 No. 01: AAAI-19, IAAI-19, EAAI-20

Section

Student Abstract Track