A Context‐Aware Decision Support Framework for Scientific Experiment Configuration

ABSTRACT Introduction Defining an experimental configuration is a complex decision problem for early‐stage researchers, who must map goals, constraints, and requirements onto datasets, algorithms, and parameter settings that directly affect experimental outcomes. Existing scientific workflow engines improve execution and reproducibility; however, they rarely capture the decision rationale behind configuration choices, which is needed to inform future selections. Method We propose a context‐aware decision‐support framework that formalises experiment configuration as a structured and sequential decision problem. The framework combines three components: a semantic Knowledge Graph (KG) storing historical configurations, contextual attributes, and decision rationale; an MDP‐based Option Explorer that filters the KG under user‐defined constraints and ranks feasible configurations by expected cumulative reward; and a Graphical User Interface for specifying constraints, inspecting ranked alternatives, and providing structured feedback. Unlike existing workflow systems, the framework explicitly separates user‐defined context from automated reasoning, producing an interpretable ranked list rather than a single opaque recommendation. We evaluated the framework in a user study with 90 MSc‐ and PhD‐level researchers performing a model‐selection task, using a synthetic dataset of one million experimental configurations under three levels of contextual detail. Results Compared with manual search, the framework reduced decision time (up to 68%), reduced perceived difficulty (up to 36%), and increased user satisfaction (up to 43%) under the constrained condition. Conclusion By formalising the link between experimental context and probabilistic decision ranking, the framework improves reproducibility and scalability of decision support in scientific experimentation.

Authors

Institutions

Publication Details

Journal
Software Practice and Experience
Published
2026-05-27
DOI
https://doi.org/10.1002/spe.70085
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Context‐Aware Decision Support Framework for Scientific Experiment Configuration

Petar Kochovski, Kristina Veljković, Vlado Stankovski, Pouriya Miri
Software Practice and Experience
Scientific Computing and Data Management
article

A Context‐Aware Decision Support Framework for Scientific Experiment Configuration

Petar Kochovski, Kristina Veljković, Vlado Stankovski, Pouriya Miri
article en

Abstract

ABSTRACT Introduction Defining an experimental configuration is a complex decision problem for early‐stage researchers, who must map goals, constraints, and requirements onto datasets, algorithms, and parameter settings that directly affect experimental outcomes. Existing scientific workflow engines improve execution and reproducibility; however, they rarely capture the decision rationale behind configuration choices, which is needed to inform future selections. Method We propose a context‐aware decision‐support framework that formalises experiment configuration as a structured and sequential decision problem. The framework combines three components: a semantic Knowledge Graph (KG) storing historical configurations, contextual attributes, and decision rationale; an MDP‐based Option Explorer that filters the KG under user‐defined constraints and ranks feasible configurations by expected cumulative reward; and a Graphical User Interface for specifying constraints, inspecting ranked alternatives, and providing structured feedback. Unlike existing workflow systems, the framework explicitly separates user‐defined context from automated reasoning, producing an interpretable ranked list rather than a single opaque recommendation. We evaluated the framework in a user study with 90 MSc‐ and PhD‐level researchers performing a model‐selection task, using a synthetic dataset of one million experimental configurations under three levels of contextual detail. Results Compared with manual search, the framework reduced decision time (up to 68%), reduced perceived difficulty (up to 36%), and increased user satisfaction (up to 43%) under the constrained condition. Conclusion By formalising the link between experimental context and probabilistic decision ranking, the framework improves reproducibility and scalability of decision support in scientific experimentation.

Software Practice and Experience
University of Ljubljana (SI)
Javna Agencija za Raziskovalno Dejavnost RS, Horizon 2020 Framework Programme
Peace, Justice and strong institutions
Openalex Percentile: Top 3%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.