Reference Process for Integrating Data Science Workflows and Governance in Big Data Systems

This article presents a structured workflow for the development of data-based analysis in the public sector, from the identification of the institutional challenges to evidence-based decision-making. The proposed process organizes the steps around three main profiles - public manager, administrator and data scientist - and integrates data governance practices, LGPD compliance and reproducible analytical processes. The technical method for adding new analytics to the institutional platform is also detailed, involving the preparation of scripts, the use of machine learning models and the publication of analytical products with automated visualizations. The proposal contributes to standardization, transparency and efficiency in the adoption of analytical intelligence by public bodies, promoting evidence-based decisions.

Authors

Institutions

Publication Details

Published
2025-09-17
DOI
https://doi.org/10.5753/ise.2025.14901
Primary Topic
Big Data and Business Intelligence
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reference Process for Integrating Data Science Workflows and Governance in Big Data Systems

Ismayle de Sousa Santos, Rossana M. C. Andrade, Miguel Castro, Pedro Oliveira et al.
Big Data and Business Intelligence
article

Reference Process for Integrating Data Science Workflows and Governance in Big Data Systems

Ismayle de Sousa Santos, Rossana M. C. Andrade, Miguel Castro, Pedro Oliveira, Victória T. Oliveira
article en

Abstract

This article presents a structured workflow for the development of data-based analysis in the public sector, from the identification of the institutional challenges to evidence-based decision-making. The proposed process organizes the steps around three main profiles - public manager, administrator and data scientist - and integrates data governance practices, LGPD compliance and reproducible analytical processes. The technical method for adding new analytics to the institutional platform is also detailed, involving the preparation of scripts, the use of machine learning models and the publication of analytical products with automated visualizations. The proposal contributes to standardization, transparency and efficiency in the adoption of analytical intelligence by public bodies, promoting evidence-based decisions.

United Food and Commercial Workers (US)
Conselho Nacional de Desenvolvimento Científico e Tecnológico, Fundação Cearense de Apoio ao Desenvolvimento Científico e Tecnológico
Openalex Percentile: Top 59%
Big Data and Business Intelligence
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.