Abstracting Complex Domains Using Modular Object-Oriented Markov Decision Processes

Authors

  • Shawn Squire University of Maryland, Baltimore County
  • Marie desJardins University of Maryland, Baltimore County

DOI:

https://doi.org/10.1609/aaai.v30i1.9964

Keywords:

markov decision process, mdp, object-oriented, options, affordances, abstraction

Abstract

We present an initial proposal for modular object-oriented MDPs, an extension of OO-MDPs that abstracts complex domains that are partially observable and stochastic with multiple goals. Modes reduce the curse of dimensionality by reducing the number of attributes, objects, and actions into only the features relevant for each goal. These modes may also be used as an abstracted domain to be transferred to other modes or to another domain.

AAAI 2016 Proceedings Cover

Downloads

Published

2016-03-05

How to Cite

Squire, S., & desJardins, M. (2016). Abstracting Complex Domains Using Modular Object-Oriented Markov Decision Processes. Proceedings of the AAAI Conference on Artificial Intelligence, 30(1). https://doi.org/10.1609/aaai.v30i1.9964

Issue

Vol. 30 No. 1 (2016): Thirtieth AAAI Conference on Artificial Intelligence

Section

Student Abstracts and Posters