Fast SSP Solvers Using Short-Sighted Labeling

Authors

  • Luis Pineda University of Massachusetts Amherst
  • Kyle Wray University of Massachusetts Amherst
  • Shlomo Zilberstein University of Massachusetts Amherst

DOI:

https://doi.org/10.1609/aaai.v31i1.11036

Keywords:

Markov Decision Process, Stochastic Shortest Path Problem, Planning under Uncertainty, Heuristic Search, Short-Sighted Search

Abstract

State-of-the-art methods for solving SSPs often work by limiting planning to restricted regions of the state space. The resulting problems can then be solved quickly, and the process is repeated during execution when states outside the restricted region are encountered. Typically, these approaches focus on states that are within some distance measure of the start state (e.g., number of actions or probability of being reached). However, these short-sighted approaches make it difficult to propagate information from states that are closer to a goal than to the start state, thus missing opportunities to improve planning. We present an alternative approach in which short-sightedness is used only to determine whether a state should be labeled as solved or not, but otherwise the set of states that can be accounted for during planning is unrestricted. Based on this idea, we propose the FLARES algorithm and show that it performs consistently well on a wide range of benchmark problems.

Downloads

Published

2017-02-12

How to Cite

Pineda, L., Wray, K., & Zilberstein, S. (2017). Fast SSP Solvers Using Short-Sighted Labeling. Proceedings of the AAAI Conference on Artificial Intelligence, 31(1). https://doi.org/10.1609/aaai.v31i1.11036