A comprehensive analysis of evaluating robustness and generalization ability of models in AES
Abstract Large language models are capable of impressive performance in standard benchmark testing, but are often fragile when deployed in real-world scenarios and cannot be deployed in many scenarios directly, such as navigation and autonomous driving. When some adversarial samples require continuous learning of new data distributions, the robustness and generalization abilities of the model require detailed evaluations and further mining. Therefore, it is very necessary to use tools to evaluate the robustness and generalization ability of the model before deploying models in real-world scenarios. The robustness and generalization capabilities of models were extensively assessed before their implementation in Automatic essay Scoring. This was achieved through a comprehensive series of experiments aimed at validating the efficacy of various models. Our findings underscored the significance of different models and their impact, providing valuable insights for practitioners seeking to forecast the performance of deployed models across diverse distributions.
Authors
- Ruijie Liu
- Jianshe Zhou (ORCID: https://orcid.org/0000-0002-1109-3375)
- Jie Liu (ORCID: https://orcid.org/0009-0006-5054-4550)
- Xiaoyi Wang
Institutions
- North China University of Technology (CN)
- Capital Normal University (CN)
Publication Details
- Journal
- Journal of Physics Conference Series
- Published
- 2024-08-01
- DOI
- https://doi.org/10.1088/1742-6596/2813/1/012022
- Citations
- 1
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.35