CampusBuddy: A Multimodal NLP-Powered Chatbot for Malayalam Voice and Text-Based College Queries

CampusBuddy is a chatbot powered by AI that helps Malayalam speakers talk and write to each other. The system uses Natural Language Processing technologies like OpenAI’s GPT-4o Mini for conversational intelligence, Whisper for recognizing Malayalam speech accurately, and Silero TTS for making speech sound real. The chatbot makes it easy and natural for students and staff to ask academic and administrative questions, and it is designed especially for Malayalam-speaking users in schools. The system operates using the following order: the system receives Malayalam speech input, utilises Whisper to convert it into English text, relies on Retrieval-Augmented Generation (RAG) with OpenAI’s model and ChromaDB to ensure the responses are relevant to the context, and finally is translated back into Malayalam and output as speech or text.CampusBuddy is built on Streamlit for scalability and supports multimodal interactions, giving users both voice and text outputs to make it easier to use.