Enhanced DNS Cybersecurity: Optimization of XGBoost Using Automated Hyperparameter Tuning via Optuna

This paper presents an application of using Optuna for hyperparameter optimization in a context of improving the performance of an XGBoost model. The starting point from the baseline XGBoost model was an accuracy of around 88.89%. With Optuna-assisted automated and efficient search of the optimal combinations of some hyperparameters-like learning rate, maximum depth, no. of trees, subsampling, column subsampling, min_child_weight-the final accuracy improved considerably to around 93%. Of course, this big improvement underscores how much valuable hyperparameter tuning plays in the improvement of performance in machine learning models. The results establish the ability of Optuna to efficiently find the optimal parameter settings, leading to improved model generalization and predictive accuracy. Beyond improving the robustness of the models, the fine-tuning process enables the construction of a more solid foundation to deploy machine learning models in real-world applications where the high accuracy is obligatory. This research therefore adds to an expanding literature on automatic hyperpa-rameter optimization and the value of tools such as Optuna in optimizing complex models such as XGBoost.

Authors

Institutions

Publication Details

Published
2024-12-04
DOI
https://doi.org/10.1109/icmnwc63764.2024.10872404
Primary Topic
Embedded Systems and FPGA Design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhanced DNS Cybersecurity: Optimization of XGBoost Using Automated Hyperparameter Tuning via Optuna

Nithish Kumar R, Dhanyatha Shree C.A
Embedded Systems and FPGA Design
article

Enhanced DNS Cybersecurity: Optimization of XGBoost Using Automated Hyperparameter Tuning via Optuna

Nithish Kumar R, Dhanyatha Shree C.A
article en

Abstract

This paper presents an application of using Optuna for hyperparameter optimization in a context of improving the performance of an XGBoost model. The starting point from the baseline XGBoost model was an accuracy of around 88.89%. With Optuna-assisted automated and efficient search of the optimal combinations of some hyperparameters-like learning rate, maximum depth, no. of trees, subsampling, column subsampling, min_child_weight-the final accuracy improved considerably to around 93%. Of course, this big improvement underscores how much valuable hyperparameter tuning plays in the improvement of performance in machine learning models. The results establish the ability of Optuna to efficiently find the optimal parameter settings, leading to improved model generalization and predictive accuracy. Beyond improving the robustness of the models, the fine-tuning process enables the construction of a more solid foundation to deploy machine learning models in real-world applications where the high accuracy is obligatory. This research therefore adds to an expanding literature on automatic hyperpa-rameter optimization and the value of tools such as Optuna in optimizing complex models such as XGBoost.

Amrita Vishwa Vidyapeetham (IN)
Openalex Percentile: Top 66%
Embedded Systems and FPGA Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.