Disentangling Biased Representations: A Causal Intervention Framework for Fairer NLP Models
Natural language processing (NLP) systems often inadvertently encode and amplify social biases through entangled representations of demographic attributes and task-related attributes.To mitigate this, we propose a novel framework that combines causal analysis with practical intervention strategies.The method leverages attribute-specific prompting to isolate sensitive attributes while applying information-theoretic constraints to minimize spurious correlations.Experiments across six language models and two classification tasks demonstrate its effectiveness.We hope this work will provide the NLP community with a causal disentanglement perspective for achieving fairness in NLP systems.
Authors
- Siqi Zhang (ORCID: https://orcid.org/0000-0001-5135-4886)
- Yilong Hu (ORCID: https://orcid.org/0009-0008-8078-0428)
- Gu Xu (ORCID: https://orcid.org/0000-0003-3936-3899)
- Xiaolin Qin (ORCID: https://orcid.org/0000-0001-5087-8178)
- Yangge Qian
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.gebnlp-1.33
- Primary Topic
- Ethics and Social Impacts of AI
- Type
- article
- Field-Weighted Citation Impact
- 0.00