TY - JOUR AU - De Giacomo, Giuseppe AU - Iocchi, Luca AU - Favorito, Marco AU - Patrizi, Fabio PY - 2021/05/25 Y2 - 2024/03/28 TI - Foundations for Restraining Bolts: Reinforcement Learning with LTLf/LDLf Restraining Specifications JF - Proceedings of the International Conference on Automated Planning and Scheduling JA - ICAPS VL - 29 IS - 1 SE - Main Track DO - 10.1609/icaps.v29i1.3549 UR - https://ojs.aaai.org/index.php/ICAPS/article/view/3549 SP - 128-136 AB - <p>In this work we investigate on the concept of “<em>restraining bolt</em>”, envisioned in Science Fiction. Specifically we introduce a novel problem in AI. We have two distinct sets of features extracted from the world, one by the agent and one by the authority imposing restraining specifications (the “restraining bolt”). The two sets are apparently unrelated since of interest to independent parties, however they both account for (aspects of) the same world. We consider the case in which the agent is a reinforcement learning agent on the first set of features, while the restraining bolt is specified logically using linear time logic on finite traces LTL<sub><em>f</em></sub>/LDL<sub><em>f</em></sub> over the second set of features. We show formally, and illustrate with examples, that, under general circumstances, the agent can learn while shaping its goals to suitably conform (as much as possible) to the restraining bolt specifications.</p> ER -