Towards Action Model Learning for Player Modeling


  • Abhijeet Krishnan North Carolina State University
  • Aaron Williams North Carolina State University
  • Chris Martens North Carolina State University



Player modeling attempts to create a computational model which accurately approximates a player’s behavior in a game. Most player modeling techniques rely on domain knowledge and are not transferable across games. Additionally, player models do not currently yield any explanatory insight about a player’s cognitive processes, such as the creation and refinement of mental models. In this paper, we present our findings with using action model learning (AML), in which an action model is learned given data in the form of a play trace, to learn a player model in a domain-agnostic manner. We demonstrate the utility of this model by introducing a technique to quantitatively estimate how well a player understands the mechanics of a game. We evaluate an existing AML algorithm (FAMA) for player modeling and develop a novel algorithm called Blackout that is inspired by player cognition. We compare Blackout with FAMA using the puzzle game Sokoban and show that Blackout generates better player models.



2020-10-01 — Updated on 2021-04-12


How to Cite

Krishnan, A., Williams, A., & Martens, C. (2021). Towards Action Model Learning for Player Modeling. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 16(1), 238-244. (Original work published October 1, 2020)