Bitnet.cpp: Efficient Edge Inference for Ternary LLMs
Jinheng Wang, Hansong Zhou, Ting Song, Shijie Cao, Yan Xia, Ting Cao, Jianyu Wei, Shuming Ma, Hongyu Wang, Furu Wei. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Furu Wei (ORCID: https://orcid.org/0000-0002-7810-5852)
- Hai Zhou (ORCID: https://orcid.org/0000-0002-0869-3038)
- Jianyu Wei (ORCID: https://orcid.org/0009-0009-0830-044X)
- Shijie Cao (ORCID: https://orcid.org/0009-0000-2001-3763)
- Hongyu Wang (ORCID: https://orcid.org/0000-0001-6165-5690)
- Ting Song (ORCID: https://orcid.org/0000-0001-6512-8484)
- Ting Cao (ORCID: https://orcid.org/0000-0002-9107-013X)
- Yan Xia (ORCID: https://orcid.org/0000-0002-9768-6293)
- Shuming Ma (ORCID: https://orcid.org/0000-0003-1091-1206)
- Jinheng Wang
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.457
- Citations
- 3
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 4.46