Leveraging Human Expertise and AI for Engineering Regulatory Data Expansion: A Case Study With ChatGPT

In recent years, the integration of Large Language Models (LLMs) like ChatGPT into various tasks has revolutionized the process of generating training data for machine learning models. This paper presents a novel approach that leverages both human expertise and AI collaboration to expand small datasets, particularly in cases where data scarcity limits the performance of models requiring fine-tuning. The study documents methodologies used to scale data generation efforts by combining human input with advanced AI, focuses on prompt engineering to optimize outputs. The objective is to generate comprehensive datasets from a limited number of regulatory articles related to regulating the practice of engineering professions, ensuring accuracy and contextual relevance. The methodology involved processing articles individually, transitioning to batch processing, and iterating with continuous feedback. The results underscore the importance of human-AI synergy in achieving high-quality outputs, where the human element ensures accuracy, and the AI accelerates the data generation process. The findings demonstrate that prompt engineering plays a critical role in guiding AI to generate reliable data. Finally, the research emphasizes the potential of this approach to improve the efficiency and scalability of data generation for model fine-tuning, offering insights into the effective use of human-AI collaboration in broader contexts.