TY - JOUR AU - Ding, Lei AU - Yu, Dengdeng AU - Xie, Jinhan AU - Guo, Wenxing AU - Hu, Shenggang AU - Liu, Meichen AU - Kong, Linglong AU - Dai, Hongsheng AU - Bao, Yanchun AU - Jiang, Bei PY - 2022/06/28 Y2 - 2024/03/28 TI - Word Embeddings via Causal Inference: Gender Bias Reducing and Semantic Information Preserving JF - Proceedings of the AAAI Conference on Artificial Intelligence JA - AAAI VL - 36 IS - 11 SE - AAAI Special Track on AI for Social Impact DO - 10.1609/aaai.v36i11.21443 UR - https://ojs.aaai.org/index.php/AAAI/article/view/21443 SP - 11864-11872 AB - With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated corpora have strong gender biases that can produce discriminative results in downstream tasks. Previous debiasing methods focus mainly on modeling bias and only implicitly consider semantic information while completely overlooking the complex underlying causal structure among bias and semantic components. To address these issues, we propose a novel methodology that leverages a causal inference framework to effectively remove gender bias. The proposed method allows us to construct and analyze the complex causal mechanisms facilitating gender information flow while retaining oracle semantic information within word embeddings. Our comprehensive experiments show that the proposed method achieves state-of-the-art results in gender-debiasing tasks. In addition, our methods yield better performance in word similarity evaluation and various extrinsic downstream NLP tasks. ER -