Creating Playable Social Experiences through Whole-Body Interaction with Virtual Characters

Authors

  • Daniel Shapiro University of California, Santa Cruz
  • Josh McCoy University of California, Santa Cruz
  • April Grow University of California, Santa Cruz
  • Ben Samuel University of California, Santa Cruz
  • Andrew Stern University of California, Santa Cruz
  • Reid Swanson University of California, Santa Cruz
  • Mike Treanor University of California, Santa Cruz
  • Michael Mateas University of California, Santa Cruz

Keywords:

Social Reasoning and Agency, Authoring Tools, Interactive Drama and Story Generation, Virtual/Mixed Reality, Architecture, Training/Simulation, Group/Team Behavior, Personality, Gesture

Abstract

This paper describes work towards the goal of enabling unscripted interaction with non-player characters in virtual environments.  We hypothesize that we can define a layer of social affordances, based on physical and non-verbal signals exchanged between individuals and groups, which can be reused across games.  We have implemented a first version of that substrate that employs whole body interaction with virtual characters and generates nuanced, real-time character performance in response.  We describe the playable experience produced by the system, the implementation architecture (based on the behavior specification technology used in Façade, the social model employed in Prom Week, and gesture recognition technology), and illustrate the key behaviors and programming idioms that enable character performance.  These idioms include orthogonal coding of attitudes and activities, use of relational rules to nominate social behavior, use of volition rules to rank options, and priority based interleaving of character animations.

Downloads

Published

2021-06-30

How to Cite

Shapiro, D., McCoy, J., Grow, A., Samuel, B., Stern, A., Swanson, R., Treanor, M., & Mateas, M. (2021). Creating Playable Social Experiences through Whole-Body Interaction with Virtual Characters. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 9(1), 79-85. Retrieved from https://ojs.aaai.org/index.php/AIIDE/article/view/12691