ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling

ORLM: Pioneering Open-Source Framework for Automated Optimization Modeling A study titled "ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling" has been published, introducing the first open-source framework designed to automate optimization modeling using large language models (LLMs). This innovative approach addresses critical challenges in the field of operations research (OR), particularly the overreliance on closed-source LLMs like GPT-4, which raises privacy concerns and limits customization in industrial applications. The research team proposed OR-Instruct, a semiautomated data synthesis framework that generates high-quality training data tailored to specific optimization modeling requirements. They also introduced IndustryOR, the first benchmark for evaluating LLMs’ performance on real-world OR problems. By training several 7B-scale open-source LLMs with the synthesized data, the team achieved state-of-the-art results across multiple benchmarks, including NL4Opt, MAMO, and IndustryOR. This advancement not only enhances the accessibility and applicability of optimization modeling, but also paves the way for more efficient and privacy-conscious solutions in various industrial sectors. The ORLM framework exemplifies the potential of open-source initiatives in driving innovation and democratizing advanced analytical tools for operations research.

Authors

Institutions

Publication Details

Journal
Operations Research
Published
2025-05-08
DOI
https://doi.org/10.1287/opre.2024.1233
Citations
17
Primary Topic
Simulation Techniques and Applications
Type
article
Field-Weighted Citation Impact
35.81
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling

Dongdong Ge, Chenyu Huang, Benyou Wang, Ruiyuan Jiang et al.
17 citations
Operations Research
Simulation Techniques and Applications
35.81
article

ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling

Dongdong Ge, Chenyu Huang, Benyou Wang, Ruiyuan Jiang, Zizhuo Wang, Xin Zheng, Shixi Hu, Zhengyang Tang
article en
17 citations

Abstract

ORLM: Pioneering Open-Source Framework for Automated Optimization Modeling A study titled "ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modeling" has been published, introducing the first open-source framework designed to automate optimization modeling using large language models (LLMs). This innovative approach addresses critical challenges in the field of operations research (OR), particularly the overreliance on closed-source LLMs like GPT-4, which raises privacy concerns and limits customization in industrial applications. The research team proposed OR-Instruct, a semiautomated data synthesis framework that generates high-quality training data tailored to specific optimization modeling requirements. They also introduced IndustryOR, the first benchmark for evaluating LLMs’ performance on real-world OR problems. By training several 7B-scale open-source LLMs with the synthesized data, the team achieved state-of-the-art results across multiple benchmarks, including NL4Opt, MAMO, and IndustryOR. This advancement not only enhances the accessibility and applicability of optimization modeling, but also paves the way for more efficient and privacy-conscious solutions in various industrial sectors. The ORLM framework exemplifies the potential of open-source initiatives in driving innovation and democratizing advanced analytical tools for operations research.

Operations ResearchVol. 73(6)
Duke University (US), Shanghai University of Finance and Economics (CN), Shanghai Jiao Tong University (CN), Shenzhen Research Institute of Big Data (CN), Chinese University of Hong Kong, Shenzhen (CN), Columbia University (US), Tsinghua University (CN)
Openalex Percentile: Top 0%
Simulation Techniques and Applications
35.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.