Domain-Independent Dynamic Programming: Generic State Space Search for Combinatorial Optimization

Authors

  • Ryo Kuroiwa University of Toronto
  • J. Christopher Beck University of Toronto

DOI:

https://doi.org/10.1609/icaps.v33i1.27200

Keywords:

Heuristic search, Knowledge representation for planning and scheduling, Planning and scheduling with mixed continuous and discrete states/actions/decisions

Abstract

For combinatorial optimization problems, model-based approaches such as mixed-integer programming (MIP) and constraint programming (CP) aim to decouple modeling and solving a problem: the `holy grail' of declarative problem solving. We propose domain-independent dynamic programming (DIDP), a new model-based paradigm based on dynamic programming (DP). While DP is not new, it has typically been implemented as a problem-specific method. We propose Dynamic Programming Description Language (DyPDL), a formalism to define DP models, and develop Cost-Algebraic A* Solver for DyPDL (CAASDy), a generic solver for DyPDL using state space search. We formalize existing problem-specific DP and state space search methods for combinatorial optimization problems as DP models in DyPDL. Using CAASDy and commercial MIP and CP solvers, we experimentally compare the DP models with existing MIP and CP models, showing that, despite its nascent nature, CAASDy outperforms MIP and CP on a number of common problem classes.

Downloads

Published

2023-07-01

How to Cite

Kuroiwa, R., & Beck, J. C. (2023). Domain-Independent Dynamic Programming: Generic State Space Search for Combinatorial Optimization. Proceedings of the International Conference on Automated Planning and Scheduling, 33(1), 236-244. https://doi.org/10.1609/icaps.v33i1.27200