AI-BASED AUTOMATION OF DECISION LOGIC REPRESENTATION: BRIDGING GAP IN AUTOMATED DECISION MODELING VALIDATION

The study aims to resolve the "modeling bottleneck" in Business Process Management by developing an automated method for ensuring the correctness of Decision Model and Notation (DMN) tables generated by Large Language Models (LLMs). The primary goal is to determine whether shifting the AI's role from a pure generator to a validator within a closed-loop system can overcome the structural limitations inherent in stochastic models. The research employs a comparative experimental design using a "Mutation Testing" approach. We analyze two distinct workflows: (1) Static Generation, where test cases are fixed, and (2) Dynamic Paired Generation, where the LLM regenerates both the decision logic (DMN XML) and the validation criteria (Test Cases JSON) simultaneously upon failure. The methodology integrates concepts from "Struc-Bench" for structural analysis and utilizes a deterministic DMN engine (Camunda) for execution-based verification. The experiments demonstrate that "out-of-the-box" LLM generation fails in approximately 4.5% of cases due to semantic drift and structural hallucinations when validated against static benchmarks. However, the proposed "Dynamic Paired Generation" workflow achieved a 100% convergence rate across 200 cycles. The system successfully identified and corrected both syntactic errors (XML schema violations) and logical errors (Hit Policy violations) without human intervention. The study introduces the concept of "Dynamic Paired Generation" for neuro-symbolic systems. Unlike traditional "Chain-of-Thought" prompting, this approach leverages the mutual consistency between two independent structural representations (Logic and Examples) to filter out hallucinations, proving that dynamic validation is superior to static prompting for structured data tasks. The proposed framework provides a blueprint for "Self-Healing" decision management systems. It allows non-technical business analysts to convert natural language policies into executable, error-free DMN models, significantly reducing the time and cost of regulatory compliance and process automation.

Authors

Institutions

Publication Details

Journal
Computer Systems and Information Technologies
Published
2025-12-30
DOI
https://doi.org/10.31891/csit-2025-4-8
Primary Topic
Business Process Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-BASED AUTOMATION OF DECISION LOGIC REPRESENTATION: BRIDGING GAP IN AUTOMATED DECISION MODELING VALIDATION

Vladyslav Maliarenko
Computer Systems and Information Technologies
Business Process Modeling and Analysis
article

AI-BASED AUTOMATION OF DECISION LOGIC REPRESENTATION: BRIDGING GAP IN AUTOMATED DECISION MODELING VALIDATION

Vladyslav Maliarenko
article en

Abstract

The study aims to resolve the "modeling bottleneck" in Business Process Management by developing an automated method for ensuring the correctness of Decision Model and Notation (DMN) tables generated by Large Language Models (LLMs). The primary goal is to determine whether shifting the AI's role from a pure generator to a validator within a closed-loop system can overcome the structural limitations inherent in stochastic models. The research employs a comparative experimental design using a "Mutation Testing" approach. We analyze two distinct workflows: (1) Static Generation, where test cases are fixed, and (2) Dynamic Paired Generation, where the LLM regenerates both the decision logic (DMN XML) and the validation criteria (Test Cases JSON) simultaneously upon failure. The methodology integrates concepts from "Struc-Bench" for structural analysis and utilizes a deterministic DMN engine (Camunda) for execution-based verification. The experiments demonstrate that "out-of-the-box" LLM generation fails in approximately 4.5% of cases due to semantic drift and structural hallucinations when validated against static benchmarks. However, the proposed "Dynamic Paired Generation" workflow achieved a 100% convergence rate across 200 cycles. The system successfully identified and corrected both syntactic errors (XML schema violations) and logical errors (Hit Policy violations) without human intervention. The study introduces the concept of "Dynamic Paired Generation" for neuro-symbolic systems. Unlike traditional "Chain-of-Thought" prompting, this approach leverages the mutual consistency between two independent structural representations (Logic and Examples) to filter out hallucinations, proving that dynamic validation is superior to static prompting for structured data tasks. The proposed framework provides a blueprint for "Self-Healing" decision management systems. It allows non-technical business analysts to convert natural language policies into executable, error-free DMN models, significantly reducing the time and cost of regulatory compliance and process automation.

Computer Systems and Information Technologies(4)
National Technical University "Kharkiv Polytechnic Institute" (UA)
Peace, Justice and strong institutions
Openalex Percentile: Top 22%
Business Process Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.