A ROBUST PSO-LSTM FRAMEWORK FOR PREDICTING ACADEMIC PERFORMANCE WITH EXPERIMENTAL VALIDATION
DOI:
https://doi.org/10.55766/sujst12036Keywords:
Academic performance prediction, Imbalanced data, PSO-LSTM, SMOTEAbstract
Accurately predicting students' academic performance is crucial for identifying students with learning difficulties and tailoring educational interventions effectively. This study proposed a PSO-LSTM framework that combines Particle Swarm Optimization (PSO) with Long Short-Term Memory (LSTM) to improve prediction accuracy by optimizing LSTM hyperparameters. The model was evaluated on a dataset of 722 students from the Computer Science program at Wenzhou Business College, covering six academic years (2018–2024). Two experimental scenarios were designed: semester-based GPA prediction and year-based CGPA prediction. The results indicated that PSO-LSTM outperformed traditional machine learning models (Decision Tree, Random Forest, SVM, KNN) and standard deep learning models (ANN, LSTM) in both experimental settings. In predicting the cumulative grade point average (CGPA), the model's accuracy increased from 87.59% in DSTU5 to 95.17% in DSTU7, and further to 96.55% after applying SMOTE. This method effectively alleviates bias caused by class imbalance, particularly by improving recall for identifying the minority (at-risk) class, thereby significantly enhancing fairness and robustness (e.g., DSTU5 increased by 8.0%). These findings highlight PSO-LSTM as a highly effective framework for predicting academic performance, with strong potential for early intervention strategies and personalized learning recommendations.
References
Ahmed, E. (2024). Student performance prediction using machine learning algorithms. Applied Computational Intelligence and Soft Computing, 2024(1), 4067721. https://doi.org/10.1155/2024/4067721
Al-Azazi, F. A., & Ghurab, M. (2023). ANN-LSTM: A deep learning model for early student performance prediction in MOOC. Heliyon, 9(4), e15382. https://doi.org/10.1016/j.heliyon.2023.e15382
Almasri, A., Celebi, E., & Alkhawaldeh, R. S. (2019). EMT: Ensemble meta-based tree model for predicting student performance. Scientific Programming, 2019(1), 3610248. https://doi.org/10.1155/2019/3610248
Alnasyan, B., Basheri, M., & Alassafi, M. (2024). The power of deep learning techniques for predicting student performance in virtual learning environments: A systematic literature review. Computers and Education: Artificial Intelligence, 7, 100231. https://doi.org/10.1016/j.caeai.2024.100231
Alsariera, Y. A., Baashar, Y., Alkawsi, G., Mustafa, A., Alkahtani, A. A., & Ali, N. (2022). Assessment and evaluation of different machine learning algorithms for predicting student performance. Computational Intelligence and Neuroscience, 2022(1), 4151487. https://doi.org/10.1155/2022/4151487
Alwarthan, S. A., Aslam, N., & Khan, I. U. (2022). Predicting student academic performance at higher education using data mining: A systematic review. Applied Computational Intelligence and Soft Computing, 2022(1), 8924028. https://doi.org/10.1155/2022/8924028
Amdee, N. (2024). A comparative study of the applicability of regression models in predicting student academic performance. Naresuan University Engineering Journal, 19(1), 39-49. https://ph01.tci-thaijo.org/index.php/nuej/article/view/255799
Baashar, Y., Alkawsi, G., Mustafa, A., Alkahtani, A. A., Alsariera, Y. A., Ali, A. Q., Hashim, W., & Tiong, S. K. (2022). Toward predicting student’s academic performance using artificial neural networks (ANNs). Applied Sciences, 12(3), 1289. https://doi.org/10.3390/app12031289
Cabo, C. (2021). Use of machine learning to identify predictors of student performance in writing viable computer programs with repetition loops and methods. In 2021 IEEE Frontiers in Education Conference (FIE) (pp. 1-9). IEEE. https://doi.org/10.1109/FIE49875.2021.9637302
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321-357. https://doi.org/10.1613/jair.953
Cu, N. G., Nghiem, T. L., Ngo, T. H., Nguyen, M. T. L., & Phung, H. Q. (2024). Increment of academic performance prediction of at-risk student by dealing with data imbalance problem. Applied Computational Intelligence and Soft Computing, 2024(1), 4795606. https://doi.org/10.1155/2024/4795606
Farissi, A., Dahlan, H. M., & Samsuryadi. (2020). Genetic algorithm-based feature selection with ensemble methods for student academic performance prediction. Journal of Physics: Conference Series, 1500(1), 012110. https://doi.org/10.1088/1742-6596/1500/1/012110
Greff, K., Srivastava, R. K., Koutník, J., Steunebrink, B. R., & Schmidhuber, J. (2016). LSTM: A search space odyssey. IEEE Transactions on Neural Networks and Learning Systems, 28(10), 2222-2232. https://doi.org/10.1109/TNNLS.2016.2582924
Hassan, S. U., Waheed, H., Aljohani, N. R., Ali, M., Ventura, S., & Herrera, F. (2019). Virtual learning environment to predict withdrawal by leveraging deep learning. International Journal of Intelligent Systems, 34(8), 1935-1952. https://doi.org/10.1002/int.22129
Kukkar, A., Mohana, R., Sharma, A., & Nayyar, A. (2023). Prediction of student academic performance based on their emotional wellbeing and interaction on various e-learning platforms. Education and Information Technologies, 28(8), 9655-9684. https://doi.org/10.1007/s10639-022-11573-9
Kumar, G., Singh, U. P., & Jain, S. (2022). An adaptive particle swarm optimization-based hybrid long short-term memory model for stock price time series forecasting. Soft Computing, 26(22), 12115-12135. https://doi.org/10.1007/s00500-022-07451-8
Lindemann, B., Müller, T., Vietz, H., Jazdi, N., & Weyrich, M. (2021). A survey on long short-term memory networks for time series prediction. Procedia CIRP, 99, 650-655. https://doi.org/10.1016/j.procir.2021.03.088
Nabil, A., Seyam, M., & Abou-Elfetouh, A. (2021). Prediction of students’ academic performance based on courses’ grades using deep neural networks. IEEE Access, 9, 140731-140746. https://doi.org/10.1109/ACCESS.2021.3119596
Nachouki, M., & Abou Naaj, M. (2022). Predicting student performance to improve academic advising using the random forest algorithm. International Journal of Distance Education Technologies, 20(1), 1-17. https://doi.org/10.4018/IJDET.296702
Onyema, E. M., Almuzaini, K. K., Onu, F. U., Verma, D., Gregory, U. S., Puttaramaiah, M., & Afriyie, R. K. (2022). Prospects and challenges of using machine learning for academic forecasting. Computational Intelligence and Neuroscience, 2022(1), 5624475. https://doi.org/10.1155/2022/5624475
Ruma, J. F., Adnan, M. S. G., Dewan, A., & Rahman, R. M. (2023). Particle swarm optimization-based LSTM networks for water level forecasting: A case study on Bangladesh river network. Results in Engineering, 17, 100951. https://doi.org/10.1016/j.rineng.2023.100951
Salem, H., Mead, M., & El-Taweel, G. (2024). Particle swarm optimization-based hyperparameters tuning of machine learning models for big COVID-19 data analysis. Journal of Computer and Communications, 12(3), 160-183. https://doi.org/10.4236/jcc.2024.123010
Sandoval-Palis, I., Naranjo, D., Gilar-Corbi, R., & Pozo-Rico, T. (2020). Neural network model for predicting student failure in the academic leveling course of Escuela Politécnica Nacional. Frontiers in Psychology, 11, 515531. https://doi.org/10.3389/fpsyg.2020.515531
Scott, M., & Plested, J. (2019). GAN-SMOTE: A generative adversarial network approach to synthetic minority oversampling for one-hot encoded data. In Proceedings of the 26th International Conference on Neural Information Processing (ICONIP 2019) (Vol. 15, No. 2, pp. 29-35).
Shafiq, D. A., Marjani, M., Habeeb, R. A. A., & Asirvatham, D. (2022). Student retention using educational data mining and predictive analytics: A systematic literature review. IEEE Access, 10, 72480-72503. https://doi.org/10.1109/ACCESS.2022.3188767
Sharma, A., Singh, P. K., & Chandra, R. (2022). SMOTified-GAN for class imbalanced pattern classification problems. IEEE Access, 10, 30655-30665. https://doi.org/10.1109/ACCESS.2022.3158977
Venkatachalam, B., & Sivanraju, K. (2024). Enhanced student performance prediction using data augmentation with ensemble generative adversarial network. Indian Journal of Science and Technology, 17(44), 4619-4632. https://doi.org/10.17485/IJST/v17i44.2833
Wu, N., Zhang, L., Gao, Y., Zhang, M., Sun, X., & Feng, J. (2019). CLMS-Net: Dropout prediction in MOOCs with deep learning. In Proceedings of the ACM Turing Celebration Conference-China (pp. 1-6). Association for Computing Machinery. https://doi.org/10.1145/3321408.3322848
Yağcı, M. (2022). Educational data mining: Prediction of students’ academic performance using machine learning algorithms. Smart Learning Environments, 9(1), 11. https://doi.org/10.1186/s40561-022-00192-z
Yu, T., & Zhu, H. (2020). Hyper-parameter optimization: A review of algorithms and applications. arXiv. https://doi.org/10.48550/arXiv.2003.05689
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2026 Wenting Cui, Adisak Sangsongfa, Noppadol Amdee
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
