Deep Learning Mixed Hyper-Parameter Optimization Based on Improved Cuckoo Search Algorithm

Deep learning algorithm is an effective data mining method and has been used in many fields to solve practical problems. However, the deep learning algorithms often contain some hyper-parameters which may be continuous, integer, or mixed, and are often given based on experience but largely affect the effectiveness of activity recognition. In order to adapt to different hyper-parameter optimization problems, our improved Cuckoo Search(CS) algorithm is proposed to optimize the mixed hyper-parameters in deep learning algorithm. The algorithm optimizes the hyper-parameters in the deep learning model robustly, and intelligently selects the combination of integer type and continuous hyper-parameters that make the model optimal. Then, the mixed hyper-parameter in Convolutional Neural Network (CNN), Long-Short-Term Memory(LSTM) and CNN-LSTM are optimized based on the methodology on the smart home activity recognition datasets. Results show that the methodology can improve the performance of the deep learning model and whether we are experienced or not, we can get a better deep learning model using our method.