The Ownership Cost of AI Goal-Setting: Empirical Evidence for a Quality-Motivation Dissociation and Differential Harm to Vulnerable Users (Extended Abstract)

Authors

  • Vivienne Bihe Chi University of Pennsylvania
  • Roman Rietsche Bern University of Applied Sciences
  • Andreas Göldi Bern University of Applied Sciences
  • Lyle Ungar University of Pennsylvania
  • Sharath Chandra Guntuku University of Pennsylvania

DOI:

https://doi.org/10.1609/aies.v9i1.43172

Abstract

AI systems are now deployed at scale to author personal goals on users' behalf in coaching platforms and productivity tools, a practice justified by the assumption that better-structured outputs produce better outcomes. We provide a preregistered experimental test of this assumption in personal goal-setting, a domain where outputs must drive sustained behavior rather than merely be delivered. In a between-subjects experiment (N = 470), LLM-authored goals scored dramatically higher on objective SMART criteria (d = 2.26), yet participants reported lower psychological ownership (d = 1.38), commitment (d = 1.19), and perceived importance (d = 1.13). At two-week follow-up, 72.8% of self-authoring participants had acted on two or more goals, versus 46.6% in the LLM condition, a behavioral gap that goal quality cannot explain. Mediation analyses identify psychological ownership, not structural quality, as the mechanism behind every motivational and behavioral outcome. The findings reveal an equity paradox: the ownership costs are largest for users lowest in self-efficacy, the population most likely to seek AI assistance. Optimizing for output quality in identity-relevant, behavior-dependent tasks can silently degrade human Ownership and widen inequity. Authorship preservation is an ethical requirement for AI tools deployed in self-regulatory and wellbeing contexts.

Downloads

Published

2026-10-11

How to Cite

Chi, V. B., Rietsche, R., Göldi, A., Ungar, L., & Guntuku, S. C. (2026). The Ownership Cost of AI Goal-Setting: Empirical Evidence for a Quality-Motivation Dissociation and Differential Harm to Vulnerable Users (Extended Abstract). Proceedings of the AAAI ACM Conference on AI, Ethics, and Society, 9(1), 678–679. https://doi.org/10.1609/aies.v9i1.43172