The Rensselaer Mandarin Project — A Cognitive and Immersive Language Learning Environment

Authors

  • David Allen Rensselaer Polytechnic Institute
  • Rahul R. Divekar Rensselaer Polytechnic Institute
  • Jaimie Drozdal Rensselaer Polytechnic Institute
  • Lilit Balagyozyan Rensselaer Polytechnic Institute
  • Shuyue Zheng Rensselaer Polytechnic Institute
  • Ziyi Song Rensselaer Polytechnic Institute
  • Huang Zou Rensselaer Polytechnic Institute
  • Jeramey Tyler Rensselaer Polytechnic Institute
  • Xiangyang Mou Rensselaer Polytechnic Institute
  • Rui Zhao Rensselaer Polytechnic Institute
  • Helen Zhou Rensselaer Polytechnic Institute
  • Jianling Yue Rensselaer Polytechnic Institute
  • Jeffrey O. Kephart IBM Thomas J. Watson Research Center
  • Hui Su Rensselaer Polytechnic Institute

DOI:

https://doi.org/10.1609/aaai.v33i01.33019845

Abstract

The Rensselaer Mandarin Project enables a group of foreign language students to improve functional understanding, pronunciation and vocabulary in Mandarin Chinese through authentic speaking situations in a virtual visit to China. Students use speech, gestures, and combinations thereof to navigate an immersive, mixed reality, stylized realism game experience through interaction with AI agents, immersive technologies, and game mechanics. The environment was developed in a black box theater equipped with a human-scale 360◦ panoramic screen (140h, 200r), arrays of markerless motion tracking sensors, and speakers for spatial audio.

AAAI-19 Proceedings Cover

Downloads

Published

2019-07-17

How to Cite

Allen, D., Divekar, R. R., Drozdal, J., Balagyozyan, L., Zheng, S., Song, Z., Zou, H., Tyler, J., Mou, X., Zhao, R., Zhou, H., Yue, J., Kephart, J. O., & Su, H. (2019). The Rensselaer Mandarin Project — A Cognitive and Immersive Language Learning Environment. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01), 9845-9846. https://doi.org/10.1609/aaai.v33i01.33019845

Issue

Vol. 33 No. 01: AAAI-19, IAAI-19, EAAI-20

Section

Demonstration Track