FoldMoE: Efficient Long Sequence MoE Training via Attention-MoE Pipelining
Guichao Zhu, Lintian Lei, Yuhao Qing, Yichao Fu, Fanxin Li, Dong Huang, Zekai Sun, Heming Cui. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Heming Cui (ORCID: https://orcid.org/0000-0001-7746-440X)
- Yichao Fu (ORCID: https://orcid.org/0009-0006-6727-1894)
- Fanxin Li (ORCID: https://orcid.org/0000-0003-2268-3036)
- Yuhao Qing (ORCID: https://orcid.org/0009-0009-1500-2192)
- Lei Liang (ORCID: https://orcid.org/0000-0002-5397-0284)
- Zekai Sun
- Dong Huang (ORCID: https://orcid.org/0009-0006-2442-3309)
- Guo-Yu Zhu
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.186
- Primary Topic
- Brain Tumor Detection and Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00