EdgeCloudAI: Edge-Cloud Distributed Video Analytics
Recent advances in Visual Language Models (VLMs) have significantly enhanced video analytics. VLMs capture complex visual and textual connections. While Convolutional Neural Networks (CNNs) excel in spatial pattern recognition, VLMs provide a global context, making them ideal for tasks like complex incidents and anomaly detection. However, VLMs are much more computationally intensive, posing challenges for large-scale and real-time applications. This paper introduces EdgeCloudAI, a scalable system integrating VLMs and CNNs through edge-cloud computing. Edge-CloudAI performs initial video processing (e.g., CNN) on edge devices and offloads deeper analysis (e.g., VLM) to the cloud, optimizing resource use and reducing latency. We have deployed EdgeCloudAI on the NSF COSMOS testbed in NYC. In this demo, we will demonstrate EdgeCloudAI's performance in detecting user-defined incidents in real-time.
Authors
- Zoran Kostić (ORCID: https://orcid.org/0000-0002-3691-2840)
- Mahshid Ghasemi (ORCID: https://orcid.org/0000-0002-0331-553X)
- Gil Zussman (ORCID: https://orcid.org/0000-0002-1845-4460)
- Javad Ghaderi (ORCID: https://orcid.org/0000-0001-8038-550X)
Institutions
- City University of Seattle (US)
- Columbia University (US)
Publication Details
- Published
- 2024-12-04
- DOI
- https://doi.org/10.1145/3636534.3698857
- Citations
- 1
- Primary Topic
- Video Surveillance and Tracking Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.25
Funders
- National Science Foundation
- Army Research Office