JustGoal: With Only a Goal, the AI Baseline Is Above the Expert Kernels
A small number of GPU kernels often determines the efficiency of large language model training and inference. High-performance kernel development typically relies on expert knowledge through manual implementation, collaboration with general-purpose models, or specialized agents equipped with domain knowledge, evaluation methods, and search workflows. We investigate how much value this knowledge provides as foundation models become stronger. We introduce JustGoal, a goal-only baseline in which a general-purpose agent receives only the optimization objective and constraints, without kernel-specific infrastructure, knowledge bases, or predefined workflows, and builds its own evaluation loop. On NVIDIA B200 GPUs, JustGoal outperforms open-source libraries on 8 of 10 operators, achieving per-operator geometric mean speedups of 1.14x to 2.34x. It also surpasses the fastest publicly released specialized-agent kernel on 5 of 9 operators with available comparisons. In a controlled same-model comparison using Fable 5.1 on single shapes, the KDA-0.5 harness reaches 0.95x of JustGoal's performance, while single-mechanism ablations show no consistent benefit from domain knowledge or predefined workflows. These results indicate that specialized machinery should be justified by clear gains over a same-model, same-scope goal-only baseline and reevaluated whenever the foundation model changes.
Authors
- Yaojian Chen (ORCID: https://orcid.org/0000-0002-6363-134X)
- Shengye Xiang (ORCID: https://orcid.org/0009-0000-3447-7585)
- Xianglong Deng (ORCID: https://orcid.org/0009-0002-2058-5109)
- Yiyun Zheng
- Haojun Sun
- Zhen Li
- Zhui Zhu
- Leshan Li
- Shangzhan Li
- Dazhi Peng
- Zhiyuan Liu
- Xu Han
- Yuxuan Li
- Qingfeng He
- Yifei Shen
- Lin Gan
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-10-27
- DOI
- https://doi.org/10.48550/arxiv.2610.36434
- Primary Topic
- Parallel Computing and Optimization Techniques
- Type
- preprint