Building a Business Intelligence Pipeline for GitHub Issue Analytics: Talend ETL, a MySQL Star Schema and Power BI

GitHub issues carry operational data about software quality, but they arrive as paginated, semi-structured JSON that is hard to analyze directly. This paper describes an end-to-end business intelligence pipeline that extracts issues from the GitHub REST API with Talend Open Studio, transforms them, and loads them into a MySQL data warehouse modeled as a star schema (one bug fact table and four dimensions: developer, project, status and priority). Dashboards in Power BI or Tableau support questions on status distribution, monthly trends, bugs per project and priority mix. We document three concrete integration failures and their fixes: a phantom column in the JSON-extraction schema, ISO 8601 date parsing, and MySQL authentication and SSL errors. The ETL was validated on a proof-of-concept load of 59 issues; the dashboards were designed against the warehouse schema, and the large-volume charts shown in the project report are illustrative rather than results of that load. We therefore present the work as a validated pipeline design and a template, not as an empirical study of bug data. Preprint, not peer reviewed.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-04
DOI
https://doi.org/10.5281/zenodo.23964012
Primary Topic
Big Data and Business Intelligence
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Building a Business Intelligence Pipeline for GitHub Issue Analytics: Talend ETL, a MySQL Star Schema and Power BI

YASMINE DAOUDI
Zenodo (CERN European Organization for Nuclear Research)
Big Data and Business Intelligence
preprint

Building a Business Intelligence Pipeline for GitHub Issue Analytics: Talend ETL, a MySQL Star Schema and Power BI

YASMINE DAOUDI
preprint en

Abstract

GitHub issues carry operational data about software quality, but they arrive as paginated, semi-structured JSON that is hard to analyze directly. This paper describes an end-to-end business intelligence pipeline that extracts issues from the GitHub REST API with Talend Open Studio, transforms them, and loads them into a MySQL data warehouse modeled as a star schema (one bug fact table and four dimensions: developer, project, status and priority). Dashboards in Power BI or Tableau support questions on status distribution, monthly trends, bugs per project and priority mix. We document three concrete integration failures and their fixes: a phantom column in the JSON-extraction schema, ISO 8601 date parsing, and MySQL authentication and SSL errors. The ETL was validated on a proof-of-concept load of 59 issues; the dashboards were designed against the warehouse schema, and the large-volume charts shown in the project report are illustrative rather than results of that load. We therefore present the work as a validated pipeline design and a template, not as an empirical study of bug data. Preprint, not peer reviewed.

Zenodo (CERN European Organization for Nuclear Research)
Université Ibn-Tofail (MA)
Big Data and Business Intelligence
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon