Adversarial Strong Story Experience Management

Abstract

In strong story experience management problems, an automated storytelling agent balances player autonomy with narrative structure in the context of an interactive story game world. However, it is possible for the game world to get softlocked in states outside narrative structures specified by the game designer. These states are called dead-ends. In this paper, we revisit adversarial strong story experience management, a framing of the experience management problem that models interactive storytelling as an adversarial game where dead-ends are losses. This framing is adversarial against narrative softlocks, not necessarily the player. We present a novel agent based on adversarial search and deep reinforcement learning, which is trained to avoid dead-ends while preserving player autonomy. We compare our approach to a reactive, narrative plan-based mediation system on a test set of games compatible with current narrative planning techniques. We show that our adversarial architecture outperforms narrative mediation on a suite of dead-end metrics during game trace and breadth-first tests of state transition system exploration, using classical and intentional planning domains.