Comprehensive Framework for Quality Assurance of Generative AI Text
This paper presents a comprehensive framework for the quality assurance (QA) of text outputs generated by artificial intelligence (AI) models. The framework incorporates multiple metrics to evaluate the generated text, including grammar and spelling correctness, relevance to the prompt, and linguistic diversity. The proposed method employs the Python library language for grammatical error detection, TF-IDF vectorization coupled with cosine similarity for relevance assessment, and NLTK for measuring lexical diversity. By integrating these metrics, the framework provides a robust mechanism to ensure the generated text meets the desired quality standards. This approach is demonstrated through a sample implementation in Python, which can be easily extended and customized for various applications in generative AI.
Authors
- Nadia Mahmood Hussien (ORCID: https://orcid.org/0000-0002-2061-2149)
- Saba Abdulbaqi Salman (ORCID: https://orcid.org/0000-0002-1259-8252)
- Yasmin Makki Mohialden (ORCID: https://orcid.org/0000-0003-2401-0505)
Institutions
- Mustansiriyah University (IQ)
- Iraqi University (IQ)
Publication Details
- Journal
- Alkadhim journal for computer science.
- Published
- 2025-03-25
- DOI
- https://doi.org/10.61710/kjcs.v3i1.84
- Primary Topic
- Semantic Web and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00