๐ฅ๐ฒ๐น๐ถ๐ฎ๐ฏ๐น๐ฒ ๐๐๐ฎ๐น๐๐ฎ๐๐ถ๐ผ๐ป & ๐๐ฟ๐ถ๐ณ๐ ๐๐ฒ๐๐ฒ๐ฐ๐๐ถ๐ผ๐ป ๐ณ๐ผ๐ฟ ๐๐ฎ๐ฟ๐ด๐ฒ ๐๐ฎ๐ป๐ด๐๐ฎ๐ด๐ฒ ๐ ๐ผ๐ฑ๐ฒ๐น๐
As LLMs become increasingly integrated into real-world applications, we face urgent questions: โข Can we trust their output over time? โข How do we measure hallucination without ground truth? โข Can we detect silent degradation across model versions like GPT-4, Claude, Mixtral? This project proposes an end-to-end research and evaluation framework that simulates: โข ๐ฌ Prompt-level hallucination scoring โข ๐ Drift visualization across model versions โข โ๏ธ Latency vs. accuracy tradeoffs for real-world inference ๐งช Fully implemented in Python & Streamlit with realistic dummy data ๐ Modular pipeline + figures + scoring functions ๐ GitHub repository: ๐ https://github.com/epaunova/phd-thesis-evaluation-llm ๐ ๐ช๐ต๐ ๐๐ต๐ถ๐ ๐บ๐ฎ๐๐๐ฒ๐ฟ๐: As a Data Scientist and AI Researcher, I believe we need reliable, transparent, and production-oriented evaluation methods โ especially as GenAI systems scale across industries. This project is part of my long-term academic and applied research path in LLM safety, alignment, and interpretability. LLM, Drift Detection, Model Evaluation, AI Alignment, Data Science, PhD Thesis
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2025-07-30
- DOI
- https://doi.org/10.5281/zenodo.16615347
- Primary Topic
- Data Stream Mining Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00