Bridging the Socioeconomic Gap in Education: A Hybrid AI and Human Annotation Approach

Students' academic performance is influenced by various demographic factors, with socioeconomic class being a prominently researched and debated factor.Computer Science research traditionally prioritizes computationally definable problems, yet challenges such as the scarcity of high-quality labeled data and ethical concerns surrounding the mining of personal information can pose barriers to exploring topics like the impact of socioeconomic status (SES) on students' education.Overcoming these barriers may involve automating the collection and annotation of high-quality language data from diverse social groups through human collaboration.Therefore, our focus is on gathering unstructured narratives from Internet forums written by students with low-SES using machine learning models and human insights.We developed a hybrid data collection model that semi-automatically retrieved narratives from the Reddit website and created a dataset five times larger than the seed dataset.Additionally, we compared the performance of traditional ML models with recent large language models (LLMs) in classifying narratives written by low-SES students, and analyzed the collected data to extract valuable insights into the socioeconomic challenges these students encounter and the solutions they pursue.