Objective Metrics for Evaluating Large Language Models Using External Data Sources
Evaluating the performance of Large Language Models (LLMs) is a critical yet challenging task, particularly when aiming to avoid subjective assessments. This paper proposes a framework for leveraging subjective metrics derived from the class textual materials across different semesters to assess LLM outputs across various tasks. By utilizing well-defined benchmarks, factual datasets, and structured evaluation pipelines, the approach ensures consistent, reproducible, and bias-minimized measurements. The framework emphasizes automation and transparency in scoring, reducing reliance on human interpretation while ensuring alignment with real-world applications. This method addresses the limitations of subjective evaluation methods, providing a scalable solution for performance assessment in educational, scientific, and other high-stakes domains.
Authors
- Edward F. Gehringer (ORCID: https://orcid.org/0000-0002-5217-2643)
- Haoze Du (ORCID: https://orcid.org/0000-0002-5298-9047)
- Chen Li (ORCID: https://orcid.org/0000-0002-3782-0737)
Publication Details
- Journal
- ArXiv.org
- Published
- 2025-07-12
- DOI
- https://doi.org/10.5281/zenodo.15870300
- Primary Topic
- Computational and Text Analysis Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00