Modeling Subjective Experience-Based Learning under Uncertainty and Frames

Authors

  • Hyung-il Ahn IBM Research
  • Rosalind Picard MIT Media Lab

DOI:

https://doi.org/10.1609/aaai.v28i1.8750

Keywords:

subjective experience-based learning, subjective value function, prospect theory, subjective discriminability, experienced utility, decision utility, gain frame, loss frame

Abstract

In this paper we computationally examine how subjective experience may help or harm the decision maker's learning under uncertain outcomes, frames and their interactions. To model subjective experience, we propose the "experienced-utility function" based on a prospect theory (PT)-based parameterized subjective value function. Our analysis and simulations of two-armed bandit tasks present that the task domain (underlying outcome distributions) and framing (reference point selection) influence experienced utilities and in turn, the "subjective discriminability" of choices under uncertainty. Experiments demonstrate that subjective discriminability improves on objective discriminability by the use of the experienced-utility function with appropriate framing for a given task domain, and that bigger subjective discriminability leads to more optimal decisions in learning under uncertainty.

Downloads

Published

2014-06-19

How to Cite

Ahn, H.- il, & Picard, R. (2014). Modeling Subjective Experience-Based Learning under Uncertainty and Frames. Proceedings of the AAAI Conference on Artificial Intelligence, 28(1). https://doi.org/10.1609/aaai.v28i1.8750

Issue

Section

AAAI Technical Track: Cognitive Modeling