Social Relation Reasoning Based on Triangular Constraints

Authors

  • Yunfei Guo National Laboratory of Pattern Recognition (NLPR), Institute of Automation of Chinese Academy of Sciences, Beijing 100190, China School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
  • Fei Yin National Laboratory of Pattern Recognition (NLPR), Institute of Automation of Chinese Academy of Sciences, Beijing 100190, China School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
  • Wei Feng National Laboratory of Pattern Recognition (NLPR), Institute of Automation of Chinese Academy of Sciences, Beijing 100190, China School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
  • Xudong Yan T Lab, Tencent Map, Tencent Technology (Beijing) Co., Ltd., Beijing 100193, China
  • Tao Xue T Lab, Tencent Map, Tencent Technology (Beijing) Co., Ltd., Beijing 100193, China
  • Shuqi Mei T Lab, Tencent Map, Tencent Technology (Beijing) Co., Ltd., Beijing 100193, China
  • Cheng-Lin Liu National Laboratory of Pattern Recognition (NLPR), Institute of Automation of Chinese Academy of Sciences, Beijing 100190, China School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China CAS Center for Excellence of Brain Science and Intelligence Technology, Beijing 100190, China

DOI:

https://doi.org/10.1609/aaai.v37i1.25151

Keywords:

CV: Scene Analysis & Understanding, CV: Visual Reasoning & Symbolic Representations

Abstract

Social networks are essentially in a graph structure where persons act as nodes and the edges connecting nodes denote social relations. The prediction of social relations, therefore, relies on the context in graphs to model the higher-order constraints among relations, which has not been exploited sufficiently by previous works, however. In this paper, we formulate the paradigm of the higher-order constraints in social relations into triangular relational closed-loop structures, i.e., triangular constraints, and further introduce the triangular reasoning graph attention network (TRGAT). Our TRGAT employs the attention mechanism to aggregate features with triangular constraints in the graph, thereby exploiting the higher-order context to reason social relations iteratively. Besides, to acquire better feature representations of persons, we introduce node contrastive learning into relation reasoning. Experimental results show that our method outperforms existing approaches significantly, with higher accuracy and better consistency in generating social relation graphs.

Downloads

Published

2023-06-26

How to Cite

Guo, Y., Yin, F., Feng, W., Yan, X., Xue, T., Mei, S., & Liu, C.-L. (2023). Social Relation Reasoning Based on Triangular Constraints. Proceedings of the AAAI Conference on Artificial Intelligence, 37(1), 737-745. https://doi.org/10.1609/aaai.v37i1.25151

Issue

Section

AAAI Technical Track on Computer Vision I