Social Relation Reasoning Based on Triangular Constraints
Keywords:CV: Scene Analysis & Understanding, CV: Visual Reasoning & Symbolic Representations
AbstractSocial networks are essentially in a graph structure where persons act as nodes and the edges connecting nodes denote social relations. The prediction of social relations, therefore, relies on the context in graphs to model the higher-order constraints among relations, which has not been exploited sufficiently by previous works, however. In this paper, we formulate the paradigm of the higher-order constraints in social relations into triangular relational closed-loop structures, i.e., triangular constraints, and further introduce the triangular reasoning graph attention network (TRGAT). Our TRGAT employs the attention mechanism to aggregate features with triangular constraints in the graph, thereby exploiting the higher-order context to reason social relations iteratively. Besides, to acquire better feature representations of persons, we introduce node contrastive learning into relation reasoning. Experimental results show that our method outperforms existing approaches significantly, with higher accuracy and better consistency in generating social relation graphs.
How to Cite
Guo, Y., Yin, F., Feng, W., Yan, X., Xue, T., Mei, S., & Liu, C.-L. (2023). Social Relation Reasoning Based on Triangular Constraints. Proceedings of the AAAI Conference on Artificial Intelligence, 37(1), 737-745. https://doi.org/10.1609/aaai.v37i1.25151
AAAI Technical Track on Computer Vision I