Brainer: A Multilingual, Voice-Driven AI Note-Taking System with Semantic Recall

Digital note-taking tools have long served as simple storage bins for text. This paper introduces Brainer, our approach to building a more intelligent system that actively helps users manage their knowledge. Brainer provides a voice-first interface that accurately transcribes both English and Hindi in real- time. It uses an AI pipeline to automatically summarize notes and add smart tags. Most importantly, it features a semantic recall function, letting users find notes by meaning, not just keywords. We built Brainer on a scalable cloud architecture to show how today’s AI services can be combined to create a truly intuitive knowledge tool. This paper covers our architecture, the AI pipeline, the challenges we faced with multilingual support, and a full performance evaluation. index Terms—note-taking, artificial intelligence, voice recognition, natural language processing, semantic search, multilingual systems, AWS, GPT-4