"Is It Rectangular?" Using I Spy as an Interactive, Game-Based Approach to Multimodal Robot Learning

Authors

  • Natalie Parde University of North Texas
  • Michalis Papakostas University of Texas - Arlington and National Center for Scientific Research Demokritos
  • Konstantinos Tsiakas University of Texas - Arlington and National Center for Scientific Research Demokritos
  • Rodney Nielsen University of North Texas

DOI:

https://doi.org/10.1609/aaai.v29i1.9723

Keywords:

I Spy, 20 Questions, human-robot games, multimodal training data, games with a purpose

Abstract

Training robots about the objects in their environment requires a multimodal correlation of features extracted from visual and linguistic sources.  This work abstracts the task of collecting multimodal training data for object and feature learning by encapsulating it in an interactive game, I Spy, played between human players and robots.  It introduces the concept of the game, briefly describes its methodology, and finally presents an evaluation of the game's performance and its appeal to human players.

AAAI 2015 Proceedings Cover

Downloads

Published

2015-03-04

How to Cite

Parde, N., Papakostas, M., Tsiakas, K., & Nielsen, R. (2015). "Is It Rectangular?" Using I Spy as an Interactive, Game-Based Approach to Multimodal Robot Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 29(1). https://doi.org/10.1609/aaai.v29i1.9723

Issue

Vol. 29 No. 1 (2015): Twenty-Ninth AAAI Conference on Artificial Intelligence

Section

Student Abstract Track