Probing Word Syntactic Representations in the Brain by a Feature Elimination Method

Authors

  • Xiaohan Zhang National Laboratory of Pattern Recognition, Institute of Automation, CAS School of Artificial Intelligence, University of Chinese Academy of Sciences
  • Shaonan Wang National Laboratory of Pattern Recognition, Institute of Automation, CAS School of Artificial Intelligence, University of Chinese Academy of Sciences
  • Nan Lin CAS Key Laboratory of Behavioural Sciences, Institute of Psychology Department of Psychology, University of Chinese Academy of Sciences
  • Jiajun Zhang National Laboratory of Pattern Recognition, Institute of Automation, CAS School of Artificial Intelligence, University of Chinese Academy of Sciences
  • Chengqing Zong National Laboratory of Pattern Recognition, Institute of Automation, CAS School of Artificial Intelligence, University of Chinese Academy of Sciences CAS Center for Excellence in Brain Science and Intelligence Technology

DOI:

https://doi.org/10.1609/aaai.v36i10.21427

Keywords:

Speech & Natural Language Processing (SNLP)

Abstract

Neuroimaging studies have identified multiple brain regions that are associated with semantic and syntactic processing when comprehending language. However, existing methods cannot explore the neural correlates of fine-grained word syntactic features, such as part-of-speech and dependency relations. This paper proposes an alternative framework to study how different word syntactic features are represented in the brain. To separate each syntactic feature, we propose a feature elimination method, called Mean Vector Null space Projection (MVNP). This method can remove a specific feature from word representations, resulting in one-feature-removed representations. Then we respectively associate one-feature-removed and the original word vectors with brain imaging data to explore how the brain represents the removed feature. This paper for the first time studies the cortical representations of multiple fine-grained syntactic features simultaneously and suggests some possible contributions of several brain regions to the complex division of syntactic processing. These findings indicate that the brain foundations of syntactic information processing might be broader than those suggested by classical studies.

Downloads

Published

2022-06-28

How to Cite

Zhang, X., Wang, S., Lin, N., Zhang, J., & Zong, C. (2022). Probing Word Syntactic Representations in the Brain by a Feature Elimination Method. Proceedings of the AAAI Conference on Artificial Intelligence, 36(10), 11721-11729. https://doi.org/10.1609/aaai.v36i10.21427

Issue

Section

AAAI Technical Track on Speech and Natural Language Processing