Developing a Research, Technology and Innovation Monitor for Policy Evaluation in the Public Sector

Dashboards have become central tools for supporting evidence-based policy evaluation, particularly in the public sector where complex data must be communicated to diverse stakeholders. Despite their growing importance, many existing implementations remain fragmented, domain-specific, or difficult for non-technical users to configure. This thesis addresses this gap by developing and evaluating a modular dashboard for Research, Technology, and Innovation (RTI) policy monitoring, designed to be adaptable across different policy contexts while remaining accessible to policymakers without technical expertise.The research follows a design science methodology. First, a Systematic Literature Review (SLR) was conducted across four major databases, yielding a consolidated set of design principles for dashboards. These principles include visual clarity, interactivity, contextual information, accessibility, and provenance. Second, these principles informed the design and implementation of a prototype dashboard built on a three-tier architecture with a flexible multidimensional database schema. The system incorporates a guided configuration wizard, enabling the integration of heterogeneous datasets without requiring backend knowledge, and supports interactive visualizations linking indicators, subareas, and goals. Third, the system was evaluated through a twofold approach: (1) informed argumentation, comparing the implemented dashboard against the design principles derived from the SLR, and (2) semi-structured interviews with three expert participants involved in RTI policy evaluation.The results demonstrate that the prototype effectively operationalizes principles of visual clarity, configurability, and systemic representation. The configuration wizard was particularly praised for transforming complex setup processes into accessible workflows. However, important gaps remain: accessibility features, provenance display, export/versioning, and systematic goal-indicator mapping require further development. The interviews confirmed the policy relevance of the system while underscoring the importance of explanatory support and decision alignment. The thesis contributes both academically, by synthesizing dashboard design principles and demonstrating their applicability in the public sector, and practically, by delivering a functioning, extensible RTI dashboard prototype. Future work should prioritize accessibility, provenance, and advanced decision-support capabilities to fully realize the system’s potential as a policy tool.

Institutions

Publication Details

Journal
reposiTUm (TU Wien)
Published
2025-10-01
DOI
https://doi.org/10.34726/hss.2025.131446
Primary Topic
Probiotics and Fermented Foods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Developing a Research, Technology and Innovation Monitor for Policy Evaluation in the Public Sector

reposiTUm (TU Wien)
Probiotics and Fermented Foods
article

Developing a Research, Technology and Innovation Monitor for Policy Evaluation in the Public Sector

article en

Abstract

Dashboards have become central tools for supporting evidence-based policy evaluation, particularly in the public sector where complex data must be communicated to diverse stakeholders. Despite their growing importance, many existing implementations remain fragmented, domain-specific, or difficult for non-technical users to configure. This thesis addresses this gap by developing and evaluating a modular dashboard for Research, Technology, and Innovation (RTI) policy monitoring, designed to be adaptable across different policy contexts while remaining accessible to policymakers without technical expertise.The research follows a design science methodology. First, a Systematic Literature Review (SLR) was conducted across four major databases, yielding a consolidated set of design principles for dashboards. These principles include visual clarity, interactivity, contextual information, accessibility, and provenance. Second, these principles informed the design and implementation of a prototype dashboard built on a three-tier architecture with a flexible multidimensional database schema. The system incorporates a guided configuration wizard, enabling the integration of heterogeneous datasets without requiring backend knowledge, and supports interactive visualizations linking indicators, subareas, and goals. Third, the system was evaluated through a twofold approach: (1) informed argumentation, comparing the implemented dashboard against the design principles derived from the SLR, and (2) semi-structured interviews with three expert participants involved in RTI policy evaluation.The results demonstrate that the prototype effectively operationalizes principles of visual clarity, configurability, and systemic representation. The configuration wizard was particularly praised for transforming complex setup processes into accessible workflows. However, important gaps remain: accessibility features, provenance display, export/versioning, and systematic goal-indicator mapping require further development. The interviews confirmed the policy relevance of the system while underscoring the importance of explanatory support and decision alignment. The thesis contributes both academically, by synthesizing dashboard design principles and demonstrating their applicability in the public sector, and practically, by delivering a functioning, extensible RTI dashboard prototype. Future work should prioritize accessibility, provenance, and advanced decision-support capabilities to fully realize the system’s potential as a policy tool.

reposiTUm (TU Wien)
TU Wien (AT)
Industry, innovation and infrastructure
Openalex Percentile: Top 43%
Probiotics and Fermented Foods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.