Diabetes Detection Using Extreme Gradient Boosting (XGBoost) with Hyperparameter Tuning

Diabetes, XGBoost, SMOTE, Hyperparameter Tuning, GridSearchCV, RandomSearchCV

Authors

  • Devi Aprilya Dinanthi Informatics Study Program, Faculty of Engineering, Universitas Muhammadiyah Malang, Indonesia, Indonesia
  • Elisa Ramadanti Informatics Study Program, Faculty of Engineering, Universitas Muhammadiyah Malang, Indonesia, Indonesia
  • Christian Sri Kusuma Aditya Informatics Study Program, Faculty of Engineering, Universitas Muhammadiyah Malang, Indonesia, Indonesia
  • Didih Rizki Chandranegara Informatics Study Program, Faculty of Engineering, Universitas Muhammadiyah Malang, Indonesia, Indonesia
November 9, 2024
November 9, 2024

Downloads

Diabetes is a serious condition that can lead to fatal complications and death due to metabolic disorders caused by a lack of insulin production in the body. This study aims to find the best classification performance on diabetes dataset using Extreme Gradient Boosting (XGBoost) method. The dataset used has 768 rows and 9 columns, with target values of 0 and 1. In this study, resampling is applied to overcome data imbalance using SMOTE, and hyperparameter optimization is performed using GridSearchCV and RandomSearchCV. Model evaluation was performed using confusion matrix as well as metrics such as accuracy, precision, recall, and F1-score. The test results show that the use of GridSearchCV and RandomSearchCV for hyperparameter tuning provides good results. The application of data resampling also managed to improve the  overall model performance, especially in the XGBoost method that has been optimized using GridSearchCV, which  achieved  the highest accuracy of 85%, while XGBoost with RandomSearchCV optimization showed 83% accuracy performance.

How to Cite

Dinanthi, D. A., Ramadanti, E., Aditya, C. S. K., & Chandranegara, D. R. (2024). Diabetes Detection Using Extreme Gradient Boosting (XGBoost) with Hyperparameter Tuning. Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics, 6(2). https://doi.org/10.35882/qr3hw926

Similar Articles

1-10 of 22

You may also start an advanced similarity search for this article.