Replacing standard confusion matrix with overestimates and underestimates for ordinal classification problems

In multiclass classification problems, the standard confusion matrix is typically replaced by a series of confusion matrices, each corresponding to a specific class (or decision variable in MCDM literature). The ordinal classification problems differ from multiclass classification, but they share the same performance metrics as used in multiclass classification. We argue that ordinal classification has unique characteristics that set it apart from other classification. In ordinal classification, the concepts of false positive and false negatives are replaced by overestimates and underestimates. We suggest using different mathematical operators to measure the extent of overestimates and underestimates. The proposed metrics, designed for ordinal classifiers,<br/>not only introduce a new evaluation framework but also represent a significant advancement in the performance assessment of ordinal classification algorithms.

Authors

Institutions

Publication Details

Journal
University of Southern Denmark Research Portal (University of Southern Denmark)
Published
2024-09-01
Primary Topic
Statistical and Computational Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Replacing standard confusion matrix with overestimates and underestimates for ordinal classification problems

Sajid Siraj, E. W. Abel
University of Southern Denmark Research Portal (University of Southern Denmark)
Statistical and Computational Modeling
article

Replacing standard confusion matrix with overestimates and underestimates for ordinal classification problems

Sajid Siraj, E. W. Abel
article en

Abstract

In multiclass classification problems, the standard confusion matrix is typically replaced by a series of confusion matrices, each corresponding to a specific class (or decision variable in MCDM literature). The ordinal classification problems differ from multiclass classification, but they share the same performance metrics as used in multiclass classification. We argue that ordinal classification has unique characteristics that set it apart from other classification. In ordinal classification, the concepts of false positive and false negatives are replaced by overestimates and underestimates. We suggest using different mathematical operators to measure the extent of overestimates and underestimates. The proposed metrics, designed for ordinal classifiers,<br/>not only introduce a new evaluation framework but also represent a significant advancement in the performance assessment of ordinal classification algorithms.

University of Southern Denmark Research Portal (University of Southern Denmark)
University of Leeds (GB), Department of Education (ES), Institutt for Grafiske Medier (NO)
Openalex Percentile: Top 72%
Statistical and Computational Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Replacing standard confusion matrix with overestimates and underestimates for ordinal classification problems — Sajid Siraj, E. W. Abel · University of Southern Denmark Research Portal (University of Southern Denmark) (2024) | TGRS Research Map | TGRS