A Bias-Aware Deep Learning Framework for Hierarchical Microcredential Classification

The growing demand for microcredentials in education and workforce development necessitates scalable, accurate, and fair assessment systems for both soft and hard skills based on students' lived experience narratives. Existing approaches struggle with the complexities of hierarchical credentialing and the mitigation of algorithmic bias related to gender and ethnicity. In this paper, we propose a novel deep learning framework that integrates hierarchical classification based on dynamic thresholding with a dual deep Q network dueling (DDQN dueling) for bias mitigation. Our method improves predictive performance at all three levels of microcredential classification, achieving an increase in 7\% sensitivity and an improvement in 6\% specificity over baseline models. Furthermore, our framework significantly improves fairness by reducing gender and ethnicity bias, as measured by equalized odds, by over 20\% compared to conventional approaches. Extensive evaluations on a dataset of 3,000 student narratives demonstrate a 12\% improvement in the F1 score and a 5\% increase in AUROC relative to existing methods. These results underscore the effectiveness of our approach in advancing both hierarchical classification accuracy and fairness in real-world educational applications.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-07-12
DOI
https://doi.org/10.5281/zenodo.15870150
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Bias-Aware Deep Learning Framework for Hierarchical Microcredential Classification

Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
article

A Bias-Aware Deep Learning Framework for Hierarchical Microcredential Classification

article en

Abstract

The growing demand for microcredentials in education and workforce development necessitates scalable, accurate, and fair assessment systems for both soft and hard skills based on students' lived experience narratives. Existing approaches struggle with the complexities of hierarchical credentialing and the mitigation of algorithmic bias related to gender and ethnicity. In this paper, we propose a novel deep learning framework that integrates hierarchical classification based on dynamic thresholding with a dual deep Q network dueling (DDQN dueling) for bias mitigation. Our method improves predictive performance at all three levels of microcredential classification, achieving an increase in 7\% sensitivity and an improvement in 6\% specificity over baseline models. Furthermore, our framework significantly improves fairness by reducing gender and ethnicity bias, as measured by equalized odds, by over 20\% compared to conventional approaches. Extensive evaluations on a dataset of 3,000 student narratives demonstrate a 12\% improvement in the F1 score and a 5\% increase in AUROC relative to existing methods. These results underscore the effectiveness of our approach in advancing both hierarchical classification accuracy and fairness in real-world educational applications.

Zenodo (CERN European Organization for Nuclear Research)
Gender equality
Openalex Percentile: Top 56%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.