MODELING TO PREDICT THE PATIENTS’ POSTOPERATIVE WOMAC SCORE BY FEATURES ENGINEERING AND GRADIENT BOOST TREE
DOI:
https://doi.org/10.55766/sujst-2023-03-e02049Keywords:
Deep Learning, Generalized Linear Model, Gradient Boost Tree, Knee Osteoarthritis, Support Vector Machine, WOMAC scoreAbstract
This research studies factors and creates a model to predict the patients’ postoperative WOMAC score after total knee replacement. First, the influencing factors were found by feature engineering, using several techniques such as Generalized Linear Models, Support Vector Machines, Deep Learning, and Gradient Boost Trees. Afterwards, the model was created by the Gradient Boost Tree technique which groups different attributes from feature engineering. Models were compared to find the model with the best predictability. RapidMiner Studio software version 9.9 was used in this work. The results demonstrate that the model created by the Gradient Boost Tree technique with attributes originating from feature engineering on the Gradient Boost Tree performs most efficiently with root mean square error (RMSE), mean absolute deviation (MAD) and square error (SE) of \mathbf{5}.\mathbf{311}\pm\mathbf{0}.\mathbf{538}, \mathbf{3}.\mathbf{550}\pm\mathbf{0}.\mathbf{376}, and \mathbf{28}.\mathbf{472}\pm\mathbf{5}.\mathbf{811} respectively.
References
Bentéjac, C., Csörgő, A., and Martínez-Muñoz, G. (2020). A comparative analysis of gradient boosting algorithms. Artificial Intelligence Review., 54(3):1937-1967. https://doi.org/10.1007/s10462-020-09896-5
Botchkarev, A. (2018). Evaluating Performance of Regression Machine Learning Models Using Multiple Error Metrics in Azure Machine Learning Studio. SSRN Electronic Journal. Available at from: https://ssrn.com/abstract=3177507 or http://dx.doi.org/10.2139/ssrn.3177507
Deng, N., Tian, Y., and Zhang, C. (2013). Support Vector Machines Optimization Based Theory, Algorithms, and Extensions. 1st ed. Chapman and Hall/CRC.New York, USA, 363p.
Department of Medical Services. (2018). Service development osteoarthritis care in the national health insurance system. Available from : heeps://dhes.moph.go.th/wp-content/uploads/2019/11/4.1.35.1/บริการพอกเข่าผป.ข้อเข่าเสื่อม.pdf. Accessed date: Oct 28, 2018.
Department of Older Persons. (2020). Situation of the Thai Elderly. Available from: http://www.dop.go.th/th/know/1. Accessed date: Feb 26, 2020.
Kanter, J.M., and Veeramachaneni, K. (2015). Deep feature synthesis: Towards automating data science endeavors. IEEE International Conference on Data Science and Advanced Analytics (DSAA), Paris, France, pp. 1-10. https://doi.org/10.1109/DSAA.2015.7344858
Kokkotis, C., Moustakidis, S., Papageorgiou, E., Giakas, G., and Tsaopoulos, D.E. (2020). Machine learning in knee osteoarthritis: A review. Osteoarthritis and Cartilage Open, 2(3):100069. https://doi.org/10.1016/j.ocarto.2020.100069
Koutsoukas, A., Monaghan, K.J., Li, X., and Huan, J. (2017). Deep-learning: investigating deep neural networks hyper-parameters and comparison of performance to shallow methods for modeling bioactivity data. Journal of Cheminformatics., 9(42). https://doi.org/10.1186/s13321-017-0226-y
Natekin, A., and Knoll, A. (2013). Gradient boosting machines, a tutorial. Frontiers in Neurorobotics, 7:21. https://doi.org/10.3389/fnbot.2013.00021
Philipp P., Anne-Laure, B., and Bernd B. (2019). Tunability: Importance of Hyperparameters of Machine Learning Algorithms. Journal of Machine Learning Research, 20:32.
Tiulpin, A., Klein, S., Bierma-Zeinstra, S.M.A., Thevenot, J., Rahtu, E., Meurs, J. Van., Oei, E.H.G., and Saarakkala, S. (2019). Multimodal Machine Learning-based Knee Osteoarthritis Progression Prediction from Plain Radiographs and Clinical Data. Scientific Reports., 9(1). https://doi.org/10.1038/s41598-019-56527-3
Yuan, K.C., Tsai, L.W., Lee, K.H., Cheng, Y.W., Hsu, S.C., Lo, Y.S., and Chen, R.J. (2020). The development an artificial intelligence algorithm for early sepsis diagnosis in the intensive care unit. International Journal of Medical Informatics, 141:104176. https://doi.org/10.1016/j.ijmedinf.2020.104176
Zheng, A., and Casari, A. (2018). Feature Engineering for Machine Learning. 1st ed. O’Reilly Media. USA, 218p.
