LLMAppHub: A Large Collection of LLM-based Applications for the Research Community
With the increasing adoption of large language models (LLMs), a growing number of applications leveraging these models have emerged. However, LLM-based applications face significant security challenges. The OWASP Top 10 for LLMs has identified critical vulnerabilities, including prompt injections, data leakage, and unauthorized code execution. While previous research has explored specific security issues, these studies often focus on a narrow range of problems and a small number of applications, leaving gaps in our understanding of security threats in real-world LLM-based applications. To facilitate research in this field, an automated tool was developed to systematically collect LLM applications and construct a dataset, particularly focusing on independent applications that leverage LLM APIs or frameworks. Our dataset includes 33,001 repositories, providing a broad and representative foundation for security analysis. Both our dataset and tool are publicly available to support further research and foster advancements in the security and development of LLM-based applications.
Authors
- Junxiao Han (ORCID: https://orcid.org/0000-0001-7630-8667)
- Shuiguang Deng (ORCID: https://orcid.org/0000-0001-5015-6095)
- Zhaoyang Wu (ORCID: https://orcid.org/0009-0005-3297-0364)
- Jianwei Yin (ORCID: https://orcid.org/0000-0003-4703-7348)
- Chen Zhi (ORCID: https://orcid.org/0000-0002-1273-2992)
Institutions
- Ningbo University (CN)
- Hangzhou City University
- City University of Macau (MO)
- Zhejiang University (CN)
Publication Details
- Published
- 2025-06-23
- DOI
- https://doi.org/10.1145/3696630.3731439
- Citations
- 1
- Primary Topic
- Semantic Web and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Zhejiang Province