Can LLMs Replace Time-Tested System Policies? Perhaps

System policies—such as scheduling, caching, and resource allocation—play a critical role in determining performance and efficiency. Traditionally, these policies are implemented using handcrafted heuristics designed to perform reasonably well across general workloads. While tech giants invest substantial resources in customizing operating systems and other systems for their particular workloads, such optimization remains out of reach for most organizations and individuals.