Fine-Tuning distilBERT for Enhanced Sentiment Classification

This research examines the fine-tuning of the DistilBERT model for sentiment classification using the IMDB dataset of 50,000 movie reviews. Sentiment analysis is vital in natural language processing (NLP), providing insights into emotions and opinions within textual data. We compare the fine-tuned DistilBERT and LLaMA 3 models, focusing on their ability to classify reviews as positive or negative. Through few-shot training on the dataset, our findings reveal that while LLaMA 3 8B excels in capturing complex sentiments, DistilBERT-base-uncased offers a more efficient solution for simpler tasks. The results underscore the effectiveness of fine-tuning. This paper contributes to optimizing sentiment analysis models and suggests future research directions, including hybrid models and advanced training techniques for improved performance across diverse contexts.