ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling
ORLM: Pioneering Open-Source Framework for Automated Optimization Modeling A study titled "ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling" has been published, introducing the first open-source framework designed to automate optimization modeling using large language models (LLMs). This innovative approach addresses critical challenges in the field of operations research (OR), particularly the overreliance on closed-source LLMs like GPT-4, which raises privacy concerns and limits customization in industrial applications. The research team proposed OR-Instruct, a semiautomated data synthesis framework that generates high-quality training data tailored to specific optimization modeling requirements. They also introduced IndustryOR, the first benchmark for evaluating LLMs’ performance on real-world OR problems. By training several 7B-scale open-source LLMs with the synthesized data, the team achieved state-of-the-art results across multiple benchmarks, including NL4Opt, MAMO, and IndustryOR. This advancement not only enhances the accessibility and applicability of optimization modeling, but also paves the way for more efficient and privacy-conscious solutions in various industrial sectors. The ORLM framework exemplifies the potential of open-source initiatives in driving innovation and democratizing advanced analytical tools for operations research.
Authors
- Dongdong Ge (ORCID: https://orcid.org/0009-0006-9328-527X)
- Chenyu Huang
- Benyou Wang (ORCID: https://orcid.org/0000-0002-1501-9914)
- Ruiyuan Jiang (ORCID: https://orcid.org/0009-0000-0623-4148)
- Zizhuo Wang (ORCID: https://orcid.org/0000-0003-0828-7280)
- Xin Zheng (ORCID: https://orcid.org/0009-0003-6040-0655)
- Shixi Hu
- Zhengyang Tang
Institutions
- Duke University (US)
- Shanghai University of Finance and Economics (CN)
- Shanghai Jiao Tong University (CN)
- Shenzhen Research Institute of Big Data (CN)
- Chinese University of Hong Kong, Shenzhen (CN)
- Columbia University (US)
- Tsinghua University (CN)
Publication Details
- Journal
- Operations Research
- Published
- 2025-05-08
- DOI
- https://doi.org/10.1287/opre.2024.1233
- Citations
- 17
- Primary Topic
- Simulation Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 35.81