Evaluating the Performance of Large Language Models in Classifying Numerical Data

In recent years, large language models (LLMs) such as BERT, DistilBERT, RoBERTa, and XLNet have revolutionized natural language processing (NLP) tasks due to their powerful representation capabilities. This research investigates the efficacy of these LLMs in the novel domain of numerical data classification by transforming numerical data into textual formats. The study involves converting numerical data points into descriptive strings and leveraging the advanced text processing capabilities of LLMs to classify them into predefined categories. We conduct a comparative analysis of BERT, DistilBERT, RoBERTa, and XLNet, evaluating their performance using standard metrics such as accuracy, precision, recall, and F1-score. Our experimental results demonstrate the potential of these models in accurately classifying numerical data, highlighting the strengths and limitations of each model. This research opens new avenues for applying LLMs beyond traditional NLP tasks, providing insights into their applicability for structured data classification.

Authors

Institutions

Publication Details

Published
2024-10-16
DOI
https://doi.org/10.1109/ictc62082.2024.10827495
Citations
2
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating the Performance of Large Language Models in Classifying Numerical Data

Yong‐Woon Kim, Divya Mary Biji
2 citations
Topic Modeling
0.69
article

Evaluating the Performance of Large Language Models in Classifying Numerical Data

Yong‐Woon Kim, Divya Mary Biji
article en
2 citations

Abstract

In recent years, large language models (LLMs) such as BERT, DistilBERT, RoBERTa, and XLNet have revolutionized natural language processing (NLP) tasks due to their powerful representation capabilities. This research investigates the efficacy of these LLMs in the novel domain of numerical data classification by transforming numerical data into textual formats. The study involves converting numerical data points into descriptive strings and leveraging the advanced text processing capabilities of LLMs to classify them into predefined categories. We conduct a comparative analysis of BERT, DistilBERT, RoBERTa, and XLNet, evaluating their performance using standard metrics such as accuracy, precision, recall, and F1-score. Our experimental results demonstrate the potential of these models in accurately classifying numerical data, highlighting the strengths and limitations of each model. This research opens new avenues for applying LLMs beyond traditional NLP tasks, providing insights into their applicability for structured data classification.

Christ University (IN)
Openalex Percentile: Top 22%
Topic Modeling
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.