ThermiKit: Edge-Optimized LWIR Analytics with Agent-Driven Interactions
Low-cost long-wave infrared (LWIR) cameras offer viable privacy-preserving perception for home environments, though deploying effective analytics on diverse, resource-limited devices remains challenging. We present ThermiKit, a plug-and-play thermal analytics stack with two key components: (1) an edge-optimized thermal sensing suite with a unified backbone and compact modules for detection, pose estimation, and tracking, adapted to common LWIR sensors through RGB→thermal transfer; and (2) a micro-MCP server that provides structured model outputs to large language models (LLMs) agents for natural-language interaction without transmitting raw images. Our evaluation uses both a new multi-camera parallel dataset and a long-term nursing-home deployment. The models deliver up to 49.34% mAP improvement over baseline performance while maintaining real-time operation on sub-1 TOPS devices, and the MCP-enabled agent correctly answers all logically formulated scene queries in our test set (10/10).
Authors
- Guoliang Xing (ORCID: https://orcid.org/0000-0003-1772-7751)
- Yunqi Guo (ORCID: https://orcid.org/0000-0002-1852-3825)
- Xie Zhi-yuan
- Lixing He (ORCID: https://orcid.org/0000-0002-2130-1385)
- Chunhao Huang
- R. X. Xie
- Lan Zeng
- Z. Huang (ORCID: https://orcid.org/0009-0003-5737-0088)
Institutions
- Chinese University of Hong Kong (HK)
- Mellanox Technologies (Israel) (IL)
Publication Details
- Published
- 2025-10-14
- DOI
- https://doi.org/10.1145/3737905.3769284
- Citations
- 1
- Primary Topic
- Data Stream Mining Techniques
- Type
- article
- Field-Weighted Citation Impact
- 2.48