TY - JOUR AU - Hefny, Ahmed AU - Downey, Carlton AU - Gordon, Geoffrey PY - 2018/04/29 Y2 - 2024/03/29 TI - An Efficient, Expressive and Local Minima-Free Method for Learning Controlled Dynamical Systems JF - Proceedings of the AAAI Conference on Artificial Intelligence JA - AAAI VL - 32 IS - 1 SE - AAAI Technical Track: Machine Learning DO - 10.1609/aaai.v32i1.11773 UR - https://ojs.aaai.org/index.php/AAAI/article/view/11773 SP - AB - <p> We propose a framework for modeling and estimating the state of controlled dynamical systems, where an agent can affect the system through actions and receives partial observations. Based on this framework, we propose Predictive State Representation with Random Fourier Features (RFF-PSR). A key property in RFF-PSRs is that the state estimate is represented by a conditional distribution of future observations given future actions. RFFPSRs combine this representation with moment-matching, kernel embedding, and local optimization to achieve a method that enjoys several favorable qualities: It can represent controlled environments which can be affected by actions, it has an efficient and theoretically justified learning algorithm, it uses a non-parametric representation that has expressive power to represent continuous non-linear dynamics. We provide a detailed formulation, a theoretical analysis and an experimental evaluation that demonstrates the effectiveness of our method. </p> ER -