Combining Model-Based Meta-Reasoning and Reinforcement Learning For Adapting Game-Playing Agents

Authors

  • Patrick Ulam Georgia Institute of Technology
  • Joshua Jones Georgia Institute of Technology
  • A. Goel Georgia Institute of Technology

DOI:

https://doi.org/10.1609/aiide.v4i1.18685

Abstract

Human experience with interactive games will be enhanced if the software agents that play the game learn from their failures. Techniques such as reinforcement learning provide one way in which these agents may learn from their failures. Model-based meta-reasoning, a technique in which an agent uses a self-model for blame assignment, provides another. This paper evaluates a framework in which both these approaches are combined. We describe an experimental investigation of a specific task (defending a city) in a computer war strategy game called FreeCiv. Our results indicate that in the task examined, model-based meta-reasoning coupled with reinforcement learning enables the agent to learn the task with performance matching that of an expert designed agent and with speed exceeding that of a pure reinforcement learning agent.

Downloads

Published

2021-09-27

How to Cite

Ulam, P., Jones, J., & Goel, A. (2021). Combining Model-Based Meta-Reasoning and Reinforcement Learning For Adapting Game-Playing Agents. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 4(1), 132-137. https://doi.org/10.1609/aiide.v4i1.18685