Are You Talking to Me? A Case Study in Emotional Human-Machine Interaction

Authors

  • Manuel Flurin Hendry Zurich University of the Arts
  • Norbert Kottmann Zurich University of the Arts
  • Martin Fröhlich Zurich University of the Arts
  • Florian Bruggisser Zurich University of the Arts
  • Marco Quandt Zurich University of the Arts
  • Stella Speziali Zurich University of the Arts
  • Valentin Huber Zurich University of the Arts
  • Chris Salter Zurich University of the Arts

DOI:

https://doi.org/10.1609/aiide.v19i1.27538

Keywords:

Affective Computing, Acting, Interactive Art, Large Language Models, Immersive Art

Abstract

We present Stanley, a digital sculpture designed to engage audiences with the spontaneous and captivating emotional expressions of an artificial human. A 3D-printed face is brought to life through video projection mapping and a set of machine learning libraries and APIs, enabling real-time, embodied interactions with our virtual character. Stanley’s personality is shaped by traditional acting methods applied to a large language model. By creating human-machine encounters in emotionally salient scenarios, we explore how insights from acting and directing for the stage and the screen can enhance the development of compelling virtual agents. By interacting with Stanley, the audience experiences an entertaining yet unsettling encounter with AI technology, fostering a deeper understanding of machine learning techniques and enabling their critical reflection.

Downloads

Published

2023-10-06

How to Cite

Hendry, M. F., Kottmann, N., Fröhlich, M., Bruggisser, F., Quandt, M., Speziali, S., Huber, V., & Salter, C. (2023). Are You Talking to Me? A Case Study in Emotional Human-Machine Interaction. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 19(1), 417-424. https://doi.org/10.1609/aiide.v19i1.27538