Assessing Learned Representations under Open-World Novelty
DOI:
https://doi.org/10.1609/aaai.v37i13.26918Keywords:
Sequential Decision-making, Causal Reasoning, Open-world Novelty, Zero-shot Transfer, Statistical Relational LearningAbstract
My dissertation research focuses on sequential decision-making (SDM) in complex environments, and how agents can perform well even when novelty is introduced to those environments. The problem of how agents can respond intelligently to novelty has been a long-standing challenge in AI, and poses unique problems across approaches to SDM. This question has been studied in various formulations, including open-world learning and reasoning, transfer learning, concept drift, and statistical relational learning. Classical and modern approaches in agent design offer tradeoffs in human effort for feature encoding, ease of deployment in new domains, and the development of both provably and empirically reliable policies. I propose a formalism for studying open-world novelty in SDM processes with feature-rich observations. I study the conditions under which causal-relational queries can be estimated from non-novel observations, and empirically examine the effects of open-world novelty on agent behavior.Downloads
Published
2024-07-15
How to Cite
Clary, K. (2024). Assessing Learned Representations under Open-World Novelty. Proceedings of the AAAI Conference on Artificial Intelligence, 37(13), 16115-16116. https://doi.org/10.1609/aaai.v37i13.26918
Issue
Section
AAAI Doctoral Consortium Track