Energy and Uncertainty: Models and Algorithms for Complex Energy Systems

Authors

  • Warren Powell Princeton University

DOI:

https://doi.org/10.1609/aimag.v35i3.2540

Abstract

The problem of controlling energy systems (generation, transmission, storage, investment) introduces a number of optimization problems which need to be solved in the presence of different types of uncertainty. We highlight several of these applications, using a simple energy storage problem as a case application. Using this setting, we describe a modeling framework based around five fundamental dimensions which is more natural than the standard canonical form widely used in the reinforcement learning community. The framework focuses on finding the best policy, where we identify four fundamental classes of policies consisting of policy function approximations (PFAs), cost function approximations (CFAs), policies based on value function approximations (VFAs), and lookahead policies. This organization unifies a number of competing strategies under a common umbrella.

Downloads

Published

2014-09-19

How to Cite

Powell, W. (2014). Energy and Uncertainty: Models and Algorithms for Complex Energy Systems. AI Magazine, 35(3), 8-21. https://doi.org/10.1609/aimag.v35i3.2540

Issue

Section

Articles