Hyperparameter Optimization of Object Detection Networks Based on Large Language Models

Abstract: Since the emergence of deep learning, the configuration of hyperparameters has been one of the most significant problems that people have paid attention to. However, traditional hyperparameter optimization techniques typically have drawbacks such as expensive calculation consumption and lengthy training time. With the development of large language models (LLMs), particularly models such as generative pre-trained transformer (GPT), it is achievable to utilize the models’ analysis ability to guide parameter space search. This paper investigates the use of LLMs for hyperparameter optimization in machine learning problems. To evaluate the effectiveness of this strategy, four object detection models, including YOLOv5, YOLOv8, Faster R-CNN, and R-FCN, were used to conduct experiments. At the same time, we compared the distinctions between this approach and traditional ways. The experimental results indicate that combining LLMs with the hyperparameter optimization process can perform comparably or better than conventional methods.