Is Hardware Offload Enough? Energy, Timing, and Scheduling of a Video Analytics Pipeline on the Raspberry Pi 4
Single-board computers ship with hardware video codecs, and the usual advice for a video pipeline with deadlines is to use them. We test that advice on a Raspberry Pi 4 running a 720p decode-detect-overlay-encode pipeline with a person detector on every tenth frame. Moving decoding and encoding to the hardware codec raises sustained throughput from 18 to 30 frames/s. At equal work (15 frames/s) it cuts CPU time per frame by 52%, but outlet energy per frame, measured in one session, by only about 16%. Lower CPU time did not mean lower latency: in the way this application collects encoder output, each hardware-encoded packet was retrieved one or two frames after submission, so at 15 frames/s the median time from a frame's release to its encoded packet was 148 ms against 72 ms in software. With detection moved to a separate worker on one core at 15 frames/s, every hardware-mode frame-task and detection job met its CPU deadline under rate-monotonic priorities, with and without competing load, below an idealized response-time estimate; under the default Linux policy, competing load made every frame-task job late. Smaller findings concern slow CPU access to decoder buffers and the frequency governor.
Authors
- Yazeed Alzughaibi (ORCID: https://orcid.org/0009-0008-4048-777X)
Institutions
- King Abdulaziz University (SA)
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-11-12
- DOI
- https://doi.org/10.5281/zenodo.24166002
- Primary Topic
- Real-Time Systems Scheduling
- Type
- preprint