Decoder-Only LLMs can be Masked Auto-Encoders
Dan Qiao, Yuan Gao, Zheming Yang, Di Yang, Ziheng Wu, Pengcheng Lu, Minghui Qiu, Juntao Li, Min Zhang. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 2025.
Authors
- D. Yang (ORCID: https://orcid.org/0009-0002-2675-4022)
- Ziheng Wu
- Yuan Gao (ORCID: https://orcid.org/0000-0002-2057-3397)
- Min Zhang (ORCID: https://orcid.org/0000-0002-3895-5510)
- Pengcheng Lu
- Juntao Li (ORCID: https://orcid.org/0000-0002-6286-7529)
- Dan Qiao (ORCID: https://orcid.org/0000-0003-2375-1512)
- Zheming Yang (ORCID: https://orcid.org/0000-0001-9957-5792)
- Minghui Qiu
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-short.57
- Primary Topic
- Model Reduction and Neural Networks
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation
- National Natural Science Foundation of China
- Government of Jiangsu Province
- Natural Science Foundation of Jiangsu Province
- Priority Academic Program Development of Jiangsu Higher Education Institutions