AI Quiz: Intelligent MCQ Generation and Assessment Chatbot

Automated applicant assessments have matured for a number of reasons but critically because the demand for fair and efficient hiring processes is increasing. “AI QUIZ - an Intelligent MCQ Generation and Assessment ChatBot” aims to change the recruiting process by using LLMs to generate and evaluate MCQs with minimal human intervention. A large amount of human effort goes into the design, administration and grading of test questions for conventional recruiting exams, causing inefficiencies and inconsistencies. To address these problems, the proposed work introduces a systematic workflow including data preparation, tokenization, fine-tuning, question generation, and quality evaluation of the auto-generated physics MCQs and tackles it by optimizing the LLaMA 2 (7B) model coupled with QLoRA to generate diversified and scientifically correct MCQs. It is also now supplemented with a body of $\mathbf{1 6, 0 0 0}$ physics MCQs upon which the model is trained, ensuring the generation of quality questions in adherence to the assessment standards of a particular profession. The AI-powered evaluation method enhances scalability and reduces human bias by providing real-time assessments. Moreover, the perplexity computation module guarantees that the difficulty level of the generated questions remains appropriate for evaluating candidates. The proposed “AI QUIZ - an Intelligent MCQ Generation and Assessment ChatBot” offers an impressive 2.23 perplexity score compared to other models in the literature, highlighting its quality and completeness. This project bring cost-effective, scalable and intelligent solution in hiring, through AI-based evaluation methods by also simplifying the job interview process. The frontend is built using Streamlit framework which reduces the efforts for recruiters and allows businesses to assess candidates faster. The high quality of a balanced dataset helps to eliminate biases in the application process and makes the process more equitable and reliable and thus, a great addition for companies who are looking to leverage their hiring strategy.