OptimAI: Optimization from Natural Language Using LLM-Powered AI Agents
Optimization plays a vital role in scientific research and practical applications. However, translating a concrete optimization problem described in natural language into a mathematical formulation and selecting a suitable solver require substantial domain expertise. We introduce OptimAI, a framework for solving optimization problems described in natural language by leveraging LLM-powered AI agents, and achieve superior performance over current state-of-the-art methods. Our framework is built upon the following key roles: (1) a formulator that translates natural language problem descriptions into mathematical formulations; (2) a planner that constructs a high-level solution strategy prior to execution; and (3) a coder and a code critic capable of interacting with the environment and reflecting to refine future actions. Ablation studies confirm that all roles are essential; removing the planner or code critic results in $5.8\times$ and $3.1\times$ drops in productivity, respectively. Furthermore, we introduce UCB-based debug scheduling to dynamically switch between alternative plans, yielding an additional $3.3\times$ productivity gain. Our design emphasizes multi-agent collaboration, and our experiments confirm that combining diverse models leads to performance gains. The best OptimAI configurations attain 88.1% accuracy on the NLP4LP dataset and 82.3% on the Optibench dataset, reducing error rates by 58% and 52%, respectively, over prior best results.
Authors
- Ling Liang (ORCID: https://orcid.org/0000-0002-8534-6494)
- Haizhao Yang (ORCID: https://orcid.org/0000-0002-8408-1754)
- Raghav Thind
Institutions
- University of Maryland, College Park (US)
Publication Details
- Journal
- Journal of Machine Learning
- Published
- 2026-09-29
- DOI
- https://doi.org/10.4208/jml.260208
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science Foundation
- Defense Advanced Research Projects Agency
- Office of Naval Research