A comprehensive analysis of evaluating robustness and generalization ability of models in AES

Abstract Large language models are capable of impressive performance in standard benchmark testing, but are often fragile when deployed in real-world scenarios and cannot be deployed in many scenarios directly, such as navigation and autonomous driving. When some adversarial samples require continuous learning of new data distributions, the robustness and generalization abilities of the model require detailed evaluations and further mining. Therefore, it is very necessary to use tools to evaluate the robustness and generalization ability of the model before deploying models in real-world scenarios. The robustness and generalization capabilities of models were extensively assessed before their implementation in Automatic essay Scoring. This was achieved through a comprehensive series of experiments aimed at validating the efficacy of various models. Our findings underscored the significance of different models and their impact, providing valuable insights for practitioners seeking to forecast the performance of deployed models across diverse distributions.

Authors

Institutions

Publication Details

Journal
Journal of Physics Conference Series
Published
2024-08-01
DOI
https://doi.org/10.1088/1742-6596/2813/1/012022
Citations
1
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A comprehensive analysis of evaluating robustness and generalization ability of models in AES

Ruijie Liu, Jianshe Zhou, Jie Liu, Xiaoyi Wang
1 citations
Journal of Physics Conference Series
Adversarial Robustness in Machine Learning
0.35
article

A comprehensive analysis of evaluating robustness and generalization ability of models in AES

Ruijie Liu, Jianshe Zhou, Jie Liu, Xiaoyi Wang
article en
1 citations

Abstract

Abstract Large language models are capable of impressive performance in standard benchmark testing, but are often fragile when deployed in real-world scenarios and cannot be deployed in many scenarios directly, such as navigation and autonomous driving. When some adversarial samples require continuous learning of new data distributions, the robustness and generalization abilities of the model require detailed evaluations and further mining. Therefore, it is very necessary to use tools to evaluate the robustness and generalization ability of the model before deploying models in real-world scenarios. The robustness and generalization capabilities of models were extensively assessed before their implementation in Automatic essay Scoring. This was achieved through a comprehensive series of experiments aimed at validating the efficacy of various models. Our findings underscored the significance of different models and their impact, providing valuable insights for practitioners seeking to forecast the performance of deployed models across diverse distributions.

Journal of Physics Conference SeriesVol. 2813(1)
North China University of Technology (CN), Capital Normal University (CN)
Openalex Percentile: Top 35%
Adversarial Robustness in Machine Learning
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A comprehensive analysis of evaluating robustness and generalization ability of models in AES — Ruijie Liu, Jianshe Zhou, et al. · Journal of Physics Conference Series (2024) | TGRS Research Map | TGRS