Heterogeneous multi-expert collaborative reinforcement learning for automated CAD program synthesis from engineering drawings

Automated synthesis of computer-aided design (CAD) models from engineering drawings is a fundamental challenge in intelligent manufacturing, demanding not only geometric fidelity but also executable and fully editable output representations that can be directly consumed by downstream computer-aided engineering and manufacturing tools. Existing reconstruction approaches predominantly yield static, non-editable meshes or boundary representations that are incompatible with the precision and parametric editability requirements of industrial workflows. Furthermore, contemporary methods that leverage text or image descriptions as inputs impose substantial annotation overhead, severely constraining their applicability at production scale. To address these limitations, we propose the Heterogeneous fMulti-Expert Collaborative Reinforcement Learning (HMEC-CAD) framework, a principled training paradigm for direct CAD program generation from orthographic projections. HMEC-CAD systematically exploits the complementary reasoning capabilities of heterogeneous expert models through two coordinated training stages: Multi-Expert Fine-Tuning (MEFT), which distills diverse chain-of-thought reasoning styles from multiple pre-trained experts, and Multi-Expert Reinforcement Learning (MERL), which promotes cross-expert knowledge transfer and addresses reward sparsity through a hard negative sample buffering mechanism. To support rigorous evaluation under industrial conditions, we further introduce CADExpert, a large-scale open benchmark comprising 17,299 instances, each consisting of orthographic projections with precise dimensional annotations, expert-generated reasoning traces, executable CADQuery programs, and rendered three-dimensional CAD models. Extensive experiments demonstrate that HMEC-CAD achieves superior geometric accuracy, code executability, and robustness relative to both zero-shot vision-language baselines and single-expert reinforcement learning counterparts.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-07-26
DOI
https://doi.org/10.1007/s44163-026-01731-0
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Heterogeneous multi-expert collaborative reinforcement learning for automated CAD program synthesis from engineering drawings

Weixin Lin, Xiangbiao Kong, Zehe Yin
Discover Artificial Intelligence
3D Shape Modeling and Analysis
article

Heterogeneous multi-expert collaborative reinforcement learning for automated CAD program synthesis from engineering drawings

Weixin Lin, Xiangbiao Kong, Zehe Yin
article en

Abstract

Automated synthesis of computer-aided design (CAD) models from engineering drawings is a fundamental challenge in intelligent manufacturing, demanding not only geometric fidelity but also executable and fully editable output representations that can be directly consumed by downstream computer-aided engineering and manufacturing tools. Existing reconstruction approaches predominantly yield static, non-editable meshes or boundary representations that are incompatible with the precision and parametric editability requirements of industrial workflows. Furthermore, contemporary methods that leverage text or image descriptions as inputs impose substantial annotation overhead, severely constraining their applicability at production scale. To address these limitations, we propose the Heterogeneous fMulti-Expert Collaborative Reinforcement Learning (HMEC-CAD) framework, a principled training paradigm for direct CAD program generation from orthographic projections. HMEC-CAD systematically exploits the complementary reasoning capabilities of heterogeneous expert models through two coordinated training stages: Multi-Expert Fine-Tuning (MEFT), which distills diverse chain-of-thought reasoning styles from multiple pre-trained experts, and Multi-Expert Reinforcement Learning (MERL), which promotes cross-expert knowledge transfer and addresses reward sparsity through a hard negative sample buffering mechanism. To support rigorous evaluation under industrial conditions, we further introduce CADExpert, a large-scale open benchmark comprising 17,299 instances, each consisting of orthographic projections with precise dimensional annotations, expert-generated reasoning traces, executable CADQuery programs, and rendered three-dimensional CAD models. Extensive experiments demonstrate that HMEC-CAD achieves superior geometric accuracy, code executability, and robustness relative to both zero-shot vision-language baselines and single-expert reinforcement learning counterparts.

Discover Artificial Intelligence
Dhurakij Pundit University (TH), Hainan University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 11%
3D Shape Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.