LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs

Authors

  • Yan Wang Ant Group
  • Zhixuan Chu Ant Group
  • Xin Ouyang Ant Group
  • Simeng Wang Ant Group
  • Hongyan Hao Ant Group
  • Yue Shen Ant Group
  • Jinjie Gu Ant Group
  • Siqiao Xue Ant Group
  • James Zhang Ant Group
  • Qing Cui Ant Group
  • Longfei Li Ant Group
  • Jun Zhou Ant Group
  • Sheng Li University of Virginia

DOI:

https://doi.org/10.1609/aaai.v38i17.29887

Keywords:

NLP: Applications, CMS: Conceptual Inference and Reasoning, DMKM: Recommender Systems, NLP: (Large) Language Models

Abstract

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach that leverages large language models (LLMs) to construct personalized reasoning graphs. These graphs link a user's profile and behavioral sequences through causal and logical inferences, representing the user's interests in an interpretable way. Our approach, LLM reasoning graphs (LLMRG), has four components: chained graph reasoning, divergent extension, self-verification and scoring, and knowledge base self-improvement. The resulting reasoning graph is encoded using graph neural networks, which serves as additional input to improve conventional recommender systems, without requiring extra user or item information. Our approach demonstrates how LLMs can enable more logical and interpretable recommender systems through personalized reasoning graphs. LLMRG allows recommendations to benefit from both engineered recommendation systems and LLM-derived reasoning graphs. We demonstrate the effectiveness of LLMRG on benchmarks and real-world scenarios in enhancing base recommendation models.

Published

2024-03-24

How to Cite

Wang, Y., Chu, Z., Ouyang, X., Wang, S., Hao, H., Shen, Y., Gu, J., Xue, S., Zhang, J., Cui, Q., Li, L., Zhou, J., & Li, S. (2024). LLMRG: Improving Recommendations through Large Language Model Reasoning Graphs. Proceedings of the AAAI Conference on Artificial Intelligence, 38(17), 19189-19196. https://doi.org/10.1609/aaai.v38i17.29887

Issue

Section

AAAI Technical Track on Natural Language Processing II