ReFINE: A Reactive and Fine-Grained Scheduling Framework For Concurrency on General Purpose GPUs

Concurrency can be an effective technique for maximizing system utilization in general purpose GPUs (GPGPUs), enabling lower priority, best-effort tasks to run alongside higher-priority, latency-sensitive tasks to fully exploit available GPU resources. However, existing GPGPU concurrency mechanisms are inadequate for such workloads, as they lack the necessary components to sufficiently prioritize latency-sensitive tasks and ensure they meet their turnaround time deadlines.