Software Social Organisms: Implications for Measuring AI Progress

Authors

  • Kenneth D. Forbus Northwestern University

DOI:

https://doi.org/10.1609/aimag.v37i1.2648

Abstract

In this article I argue that achieving human-level AI is equivalent to learning how to create sufficiently smart software social organisms. This implies that no single test will be sufficient to measure progress. Instead, evaluations should be organized around showing increasing abilities to participate in our culture, as apprentices. This provides multiple dimensions within which progress can be measured, including how well different interaction modalities can be used, what range of domains can be tackled, what human-normed levels of knowledge they are able to acquire, as well as others. I begin by motivating the idea of software social organisms, drawing on ideas from other areas of cognitive science, and provide an analysis of the substrate capabilities that are needed in social organisms in terms closer to what is needed for computational modeling. Finally, the implications for evaluation are discussed.

Downloads

Published

2016-04-13

How to Cite

Forbus, K. D. (2016). Software Social Organisms: Implications for Measuring AI Progress. AI Magazine, 37(1), 85-90. https://doi.org/10.1609/aimag.v37i1.2648

Issue

Section

Articles