DESAMO: A Device for Elder-Friendly Smart Homes Powered by Embedded LLM with Audio Modality
We present DESAMO, an on-device smart home system for elderfriendly use powered by Audio LLM, that supports natural and private interactions.While conventional voice assistants rely on ASR-based pipelines or ASR-LLM cascades, often struggling with the unclear speech common among elderly users and unable to handle non-speech audio, DESAMO leverages an Audio LLM to process raw audio input directly, enabling a robust understanding of user intent and critical events, such as falls or calls for help. CCS Concepts Human-centered computing Sound-based input / output.
Authors
- Hwayeon Kim
- Youngwon Choi
- Donghyuk Jung (ORCID: https://orcid.org/0000-0002-9092-9803)
Institutions
- Gwangju Institute of Science and Technology (KR)
- Korea Food Research Institute (KR)
Publication Details
- Published
- 2025-09-27
- DOI
- https://doi.org/10.1145/3746058.3758344
- Primary Topic
- Context-Aware Activity Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Ministry of Culture, Sports and Tourism
- National IT Industry Promotion Agency
- Korea Creative Content Agency
- Ministry of Science and ICT, South Korea