Heuristic AND/OR Search for Solving Influence Diagram

Authors

  • Junkyu Lee University of California, Irvine
  • Radu Marinescu IBM
  • Rina Dechter University of California, Irvine

DOI:

https://doi.org/10.1609/socs.v11i1.18523

Abstract

An influence diagram is a graphical representation of sequential decision-making under uncertainty, defining a structured decision problem by conditional probability functions and additive utility functions over discrete state and action variables. The task of finding the maximum expected utility of influence diagrams is closely related to the cost-optimal probabilistic planning, stochastic programmings, or model-based reinforcement learning. In this position paper, we address the heuristic search for solving influence diagram, where we generate admissible heuristic functions from graph decomposition schemes. Then, we demonstrate how such heuristics can guide an AND/OR branch and bound search. Finally, we briefly discuss the future directions for improving the quality of heuristic functions and search strategies.

Downloads

Published

2021-09-01