Sign Language Detection for Deaf and Hard of Hearing (DHH) Community

Deaf and hearing communities face communication barriers that this paper addresses with a novel, real-time sign language recognition system with integrated sentence generation. The system leverages You Only Look Once version 8 (YOLOv8) for efficient hand sign detection within video streams, achieving an impressive accuracy of 96%. A Convolutional Neural Network (CNN) acts as a powerful decoder, deciphering the meaning behind the signs. This research goes beyond recognition by employing advanced techniques to translate the recognized signs into grammatically correct sentences, enabling a more natural flow of communication. The effectiveness of the system is rigorously evaluated, demonstrating its potential to revolutionize communication accessibility and inclusivity for sign language users. This groundbreaking technology, with its ability to generate sentences from signs, has the potential to break down barriers and foster a more connected world for all