Towards a Personalized LLM-Based Daily Edge Memory Aid
This paper introduces a personalized memory aid system that combines a high-performance cloud-based large language model (LLM) with a low-power edge device running a small language model (sLM) to enhance user productivity by processing and summarizing daily conversations in real-time. The system optimizes efficiency and user experience while ensuring privacy through localized data handling. By combining cloud and edge resources, the system provides scalable, real-time memory support without compromising data security. The research highlights the system's architecture, its role in protecting user data, and its potential to seamlessly integrate into daily life, offering a sustainable and efficient approach to personalized artificial intelligence applications.
Authors
- Joonho Lim (ORCID: https://orcid.org/0000-0002-4556-1536)
- Sungjoo Kang
- Soonhoi Ha (ORCID: https://orcid.org/0000-0001-7472-9142)
- Dongbeom Ko (ORCID: https://orcid.org/0000-0002-6488-7291)
- Hyeon Soo Kim (ORCID: https://orcid.org/0000-0003-3611-1493)
Institutions
- Electronics and Telecommunications Research Institute (KR)
- Chungnam National University (KR)
Publication Details
- Published
- 2024-10-16
- DOI
- https://doi.org/10.1109/ictc62082.2024.10827506
- Primary Topic
- Advanced Data Storage Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00