Data Science Roadmapping for AI Alignment: Insights From a Multivocal Literature Review and a Retrospective Case Study

Many organizations struggle to keep their artificial intelligence (AI) systems aligned with operational data and computing resources in today's volatile landscape. Data Science Roadmapping (DSR) embeds data layers into planning scenarios and enables a human-centric process. While DSR is effective for creating data science roadmaps, it lacks a clear implementation framework. This research advances DSR as a continuous AI alignment platform through three phases: (1) a multivocal literature review (MLR) of academic and grey sources identifies gaps and tools; (2) synthesis of these findings adapts DSR for ongoing AI alignment; (3) a retrospective case study evaluates the adapted process. Initial results show the effectiveness of agile modifications to the DSR framework and the integration of a real-time platform for roadmap implementation and monitoring. Case study participants strongly supported a dedicated roadmapping operations team, especially to manage communication, detect AI deviations, and ensure compliance. This underscores how the operationalization of roadmapping can strengthen data and AI governance.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Engineering Management
Published
2025-01-01
DOI
https://doi.org/10.1109/tem.2025.3615542
Primary Topic
Intellectual Property and Patents
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data Science Roadmapping for AI Alignment: Insights From a Multivocal Literature Review and a Retrospective Case Study

Tuğrul Daim, Atilla Kılınç, Mert Onuralp Gökalp, Ebru Gökalp et al.
IEEE Transactions on Engineering Management
Intellectual Property and Patents
article

Data Science Roadmapping for AI Alignment: Insights From a Multivocal Literature Review and a Retrospective Case Study

Tuğrul Daim, Atilla Kılınç, Mert Onuralp Gökalp, Ebru Gökalp, Kerem Kayabay
article en

Abstract

Many organizations struggle to keep their artificial intelligence (AI) systems aligned with operational data and computing resources in today's volatile landscape. Data Science Roadmapping (DSR) embeds data layers into planning scenarios and enables a human-centric process. While DSR is effective for creating data science roadmaps, it lacks a clear implementation framework. This research advances DSR as a continuous AI alignment platform through three phases: (1) a multivocal literature review (MLR) of academic and grey sources identifies gaps and tools; (2) synthesis of these findings adapts DSR for ongoing AI alignment; (3) a retrospective case study evaluates the adapted process. Initial results show the effectiveness of agile modifications to the DSR framework and the integration of a real-time platform for roadmap implementation and monitoring. Case study participants strongly supported a dedicated roadmapping operations team, especially to manage communication, detect AI deviations, and ensure compliance. This underscores how the operationalization of roadmapping can strengthen data and AI governance.

IEEE Transactions on Engineering ManagementVol. 72
University of Stuttgart (DE), Portland State University (US), Goodyear (United States) (US), Istanbul Technical University (TR), Hacettepe University (TR)
Openalex Percentile: Top 65%
Intellectual Property and Patents
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.