Common LMS Log Indicators for Predicting Student Success: A Systematic Literature Review

Authors

  • Rugaya Tuanaya Universitas Negeri Yogyakarta
  • Erna Andriyanti Universitas Negeri Yogyakarta
  • Edi Istiyono Universitas Negeri Yogyakarta

DOI:

https://doi.org/10.59247/ijase.v3i1.175

Keywords:

Learning Management System, Predictive Learning Analytics, Student Engagement Indicators, Educational Machine Learning

Abstract

This systematic review synthesizes research on common Learning Management System (LMS) log indicators used to predict student success, addressing challenges of variability and interpretability in leveraging digital behavioral data to forecast academic outcomes. Following PRISMA guidelines, a literature search and screening process using Google Scholar as the primary data source, identified 125 empirical studies for narrative synthesis; no formal meta-analysis was performed, so the ranges reported below reflect the spread of individually reported study findings rather than pooled or averaged effect sizes. The reviewed studies indicate that behavioral indicators such as timeliness of assignment submissions, submission frequency, and regularity of study intervals are repeatedly associated with academic performance, with individual studies reporting correlations as high as r=0.60–0.88, although predictive strength varies considerably by educational context. Tree-based learning models such as Random Forest and Gradient Boosting frequently offer a favorable balance between accuracy (75–96% across studies) and interpretability, while deep learning architectures such as LSTM and GRU are reported to achieve higher accuracy (89–97% in some studies) in capturing non-linear temporal patterns, though these figures are not directly comparable across studies because they were obtained using different evaluation metrics, datasets, and validation procedures. Weekly data aggregation and early engagement metrics (weeks 1–3) are associated with improved timely identification of at-risk students in several studies. Cognitive engagement metrics (e.g., content completion, quiz attempts) are reported to outperform simple frequency indicators in a number of studies, and interpretability techniques such as SHAP values suggest that modifiable behavioral features tend to carry more predictive weight than fixed demographic data. These findings underscore the significant potential of LMS log analysis in understanding student learning behavior. However, the results also highlight methodological differences between studies and limitations in the applicability of the results to other contexts. Therefore, a standardized framework is needed to translate LMS data into applicable, transparent, and equitable educational interventions.

References

Q. Wang and A. Mousavi, "Which log variables significantly predict academic achievement? A systematic review and meta-analysis," Br. J. Educ. Technol., vol. 54, no. 1, pp. 142–191, 2023, https://doi.org/10.1111/bjet.13282.

C. J. Arizmendi et al., "Predicting student outcomes using digital logs of learning behaviors: Review, current standards, and suggestions for future work," Behav. Res. Methods, vol. 55, no. 6, pp. 3026–3054, 2023, https://doi.org/10.3758/s13428-022-01939-9.

A. Pérez-Suay et al., "Learning about student performance from Moodle logs in a higher education context," in Proc. XII Int. Conf. Virtual Campus (JICV), pp. 1–4, 2022, https://doi.org/10.1109/JICV56113.2022.9934413.

Y. Guo et al., "Identifying critical LMS features for predicting at-risk students," arXiv preprint arXiv:2204.13700, 2022, https://doi.org/10.48550/arXiv.2204.13700.

E. Buraimoh, R. Ajoodha, and K. Padayachee, "Prediction of student success using student engagement with learning management system," in Interdisciplinary Research in Technology and Management, pp. 577–583, 2021, https://doi.org/10.1201/9781003202240-91.

M. Mužinić, A. Sikavica, P. Zelić, A. Grubišić, and I. Šarić-Grgić, "Predictive modeling of student performance in Moodle LMS using learning analytics," in Proc. 2024 Int. Conf. Softw., Telecommun. Comput. Netw. (SoftCOM), pp. 1–7, 2024, https://doi.org/10.23919/SoftCOM62040.2024.10721846.

Á. Hernández-García, C. Cuenca-Enrique, L. Del-Río-Carazo, and S. Iglesias-Pradas, "Exploring the relationship between LMS interactions and academic performance: A learning cycle approach," Comput. Hum. Behav., vol. 155, 2024, https://doi.org/10.1016/j.chb.2024.108183.

X. Tan, J. She, S. Chen, S. Ohno, and H. Kameda, "Analysis of student learning behavior based on Moodle log data," in Proc. 14th Int. Conf. Hum. Syst. Interact. (HSI), pp. 1–4, 2021, https://doi.org/10.1109/HSI52170.2021.9538680.

L. A. B. Macarini, C. Cechinel, M. F. B. Machado, V. F. C. Ramos, and R. Munoz, "Predicting students’ success in blended learning: Evaluating different interactions inside learning management systems," Appl. Sci., vol. 9, no. 24, 2019, https://doi.org/10.3390/app9245523.

J. Jovanović, M. Saqr, S. Joksimović, and D. Gašević, "Students matter the most in learning analytics: The effects of internal and instructional conditions in predicting academic success," Comput. Educ., vol. 172, 2021, https://doi.org/10.1016/j.compedu.2021.104251.

P. Parjan, Y. Anistyasari, Ekohariadi, and S. C. Hidayati, "Predicting academic achievement through engagement analysis with sparse logistic regression," in Proc. Int. Semin. Intell. Technol. Its Appl. (ISITIA), pp. 483–487, 2024, https://doi.org/10.1109/ISITIA63062.2024.10667991.

R. V. Esin, T. A. Kustitskaya, and M. V. Noskov, "Predicting academic performance in a course by universal features of LMS Moodle digital footprint," Inform. Obraz., vol. 38, no. 3, pp. 31–41, 2023, https://doi.org/10.32517/0234-0453-2023-38-3-31-41.

M. Vaarma and H. Li, "Predicting student dropouts with machine learning: An empirical study in Finnish higher education," Technol. Soc., vol. 76, 2024, https://doi.org/10.1016/j.techsoc.2024.102474.

E. Nimy, M. Mosia, and C. Chibaya, "Identifying at-risk students for early intervention: A probabilistic machine learning approach," Appl. Sci., vol. 13, no. 6, 2023, https://doi.org/10.3390/app13063869.

Y. Liu, S. Fan, S. Xu, A. Sajjanhar, S. Yeom, and Y. Wei, "Predicting student performance using clickstream data and machine learning," Educ. Sci., vol. 13, no. 1, 2023, https://doi.org/10.3390/educsci13010017.

J. P. Buerck et al., "Predicting non-traditional student learning outcomes using data analytics: A pilot research study," J. Comput. Sci. Coll., vol. 28, no. 5, pp. 260–265, 2013, https://dl.acm.org/doi/abs/10.5555/2458569.2458623.

S. F. Noorani, M. Karimi, and Z. Gholijafari, "Using ensemble machine learning and feature engineering to increase the accuracy of predicting learners’ performance in an online educational environment," Interdiscip. J. Virtual Learn. Med. Sci., vol. 15, no. 4, pp. 369–387, 2024, https://doi.org/10.30476/ijvlms.2024.101157.1279.

İ. Koyuncu, A. F. Kilic, and D. Orhan Goksun, "Classification of students’ achievement via machine learning by using system logs in learning management system," Turk. Online J. Distance Educ., vol. 23, no. 3, pp. 18–30, 2022, https://doi.org/10.17718/tojde.1137114.

J. W. You, "Identifying significant indicators using LMS data to predict course achievement in online learning," Internet High. Educ., vol. 29, pp. 23–30, 2016, https://doi.org/10.1016/j.iheduc.2015.11.003.

T. Li, L. M. Cruz Castro, K. Douglas, and C. G. Brinton, "Relationship between learning engagement metrics and learning outcomes in online engineering course," in Proc. IEEE Frontiers Educ. Conf. (FIE), pp. 1–5, 2021, https://doi.org/10.1109/FIE49875.2021.9637234.

S. Damuluri, K. Islam, P. Ahmadi, and N. S. Qureshi, "Analyzing navigational data and predicting student grades using support vector machine," Emerg. Sci. J., vol. 4, no. 4, pp. 243–252, 2020, https://doi.org/10.28991/esj-2020-01227.

K. Buckley, K. A. Fairman, E. K. Pogge, and E. C. Raney, "Use of learning management system data to predict student success in a pharmacy capstone course," Am. J. Pharm. Educ., vol. 86, no. 4, 2022, https://doi.org/10.5688/ajpe8594.

J. K. Rogers, T. C. Mercado, and R. Cheng, "Predicting student performance using Moodle data and machine learning with feature importance," Indones. J. Electr. Eng. Comput. Sci., vol. 37, no. 1, pp. 223–231, 2025, https://doi.org/10.11591/ijeecs.v37.i1.pp223-231.

P. Shao, M. Chen, Z. Pan, and M. Liu, "Investigate pre-service teachers’ learning behaviors and their relationship with academic performance through LMS log data," J. Appl. Instr. Des., vol. 13, no. 2, 2024, https://doi.org/10.59668/1269.15628.

L. Bognár and T. Fauszt, "Different learning predictors and their effects for Moodle machine learning models," in Proc. 11th IEEE Int. Conf. Cogn. Infocommun. (CogInfoCom), pp. 405–410, 2020, https://doi.org/10.1109/CogInfoCom50765.2020.9237894.

R. Santos and R. Henriques, "Predicting student performance from Moodle logs in higher education: A course-agnostic approach," in Proc. Educ. New Dev. (END 2023), vol. 2, pp. 77–81, 2023, https://doi.org/10.36315/2023v2end016.

L. P. Macfadyen and S. Dawson, "Mining LMS data to develop an early warning system for educators: A proof of concept," Comput. Educ., vol. 54, no. 2, pp. 588–599, 2010, https://doi.org/10.1016/j.compedu.2009.09.008.

M. L. Bernacki, M. M. Chavez, and P. M. Uesbeck, "Predicting achievement and providing support before STEM majors begin to fail," Comput. Educ., vol. 158, 2020, https://doi.org/10.1016/j.compedu.2020.103999.

E. Młynarska, D. Greene, and P. Cunningham, "Indicators of good student performance in Moodle activity data," arXiv preprint arXiv:1601.02975, 2016, https://doi.org/10.48550/arXiv.1601.02975.

C. Imhof, I.-S. Comsa, M. Hlosta, B. Parsaeifard, I. Moser, and P. Bergamin, "Prediction of dilatory behavior in eLearning: A comparison of multiple machine learning models," IEEE Trans. Learn. Technol., vol. 16, no. 5, pp. 648–663, 2023, https://doi.org/10.1109/TLT.2022.3221495.

S. Brdnik, V. Podgorelec, and T. Heričko, "Utilizing interaction metrics in a virtual learning environment for early prediction of students’ academic performance," in Proc. Workshop Softw. Qual., Anal., Monit., Improv., Appl. (SQAMIA 2022), vol. 3237, 2022, https://ceur-ws.org/Vol-3237/paper-brd.pdf.

M. Khan, S. Naz, Y. Khan, M. Zafar, M. A. Khan, and G. Pau, "Utilizing machine learning models to predict student performance from LMS activity logs," IEEE Access, vol. 11, pp. 86953–86962, 2023, https://doi.org/10.1109/ACCESS.2023.3305276.

T. Yu and I.-H. Jo, "Educational technology approach toward learning analytics: Relationship between student online behavior and learning performance in higher education," in Proc. 4th Int. Conf. Learn. Analytics Knowl. (LAK), pp. 269–270, 2014, https://doi.org/10.1145/2567574.2567594.

H. Karalar, C. Kapucu, and H. Gürüler, "Predicting students at risk of academic failure using ensemble model during pandemic in a distance learning system," Int. J. Educ. Technol. High. Educ., vol. 18, 2021, https://doi.org/10.1186/s41239-021-00300-y.

R. Conijn, C. Snijders, A. Kleingeld, and U. Matzat, "Predicting student performance from LMS data: A comparison of 17 blended courses using Moodle LMS," IEEE Trans. Learn. Technol., vol. 10, no. 1, pp. 17–29, 2017, https://doi.org/10.1109/TLT.2016.2616312.

N. A. Mozahem, "Using learning management system activity data to predict student performance in face-to-face courses," Int. J. Mobile Blended Learn., vol. 12, no. 3, pp. 20–31, 2020, https://doi.org/10.4018/IJMBL.2020070102.

I.-H. Jo, Y. Park, J. Kim, and J. Song, "Analysis of online behavior and prediction of learning performance in blended learning environments," Educ. Technol. Int., vol. 15, no. 2, pp. 71-88, 2014, https://doi.org/10.23095/ETI.2014.15.2.071.

S. Gaftandzhieva et al., "Exploring online activities to predict the final grade of students," Mathematics, vol. 10, no. 20, 2022, https://doi.org/10.3390/math10203758.

R. J. Waddington, S. Nam, S. Lonn, and S. D. Teasley, "Improving early warning systems with categorized course resource usage," J. Learn. Analytics, vol. 3, no. 3, pp. 263–290, 2016, https://doi.org/10.18608/jla.2016.33.13.

N. Z. Zacharis, "A multivariate approach to predicting student outcomes in web-enabled blended learning courses," Internet High. Educ., vol. 27, pp. 44–53, 2015, https://doi.org/10.1016/j.iheduc.2015.05.002.

I. Mwalumbwe and J. S. Mtebe, "Using learning analytics to predict students’ performance in Moodle learning management systems: A case of Mbeya University of Science and Technology," Electron. J. Inf. Syst. Dev. Ctries., vol. 79, no. 1, pp. 1–13, 2017, https://doi.org/10.1002/j.1681-4835.2017.tb00577.x.

H. A. Althibyani, "Predicting student success in MOOCs: A comprehensive analysis using machine learning models," PeerJ Comput. Sci., vol. 10, 2024, https://doi.org/10.7717/peerj-cs.2221.

L. J. Johnston, J. E. Griffin, I. Manolopoulou, and T. Jendoubi, "Uncovering student engagement patterns in Moodle with interpretable machine learning," arXiv preprint arXiv:2412.11826, 2024, https://doi.org/10.48550/arXiv.2412.11826.

V. Paajanen, "LMS log activity as a predictor of learning success on an undergraduate flipped classroom course of cellular biology," in Proc. Finnish Learn. Analytics Artif. Intell. Educ. Conf. (FLAIEC 2022), vol. 3383, 2022, https://ceur-ws.org/Vol-3383/FLAIEC22_paper_3090.pdf.

A. Al-Azawei and M. A. A. Al-Masoudy, "Predicting learners’ performance in virtual learning environment (VLE) based on demographic, behavioral, and engagement antecedents," Int. J. Emerg. Technol. Learn. (iJET), vol. 15, no. 9, pp. 60–75, 2020, https://doi.org/10.3991/ijet.v15i09.12691.

E. Drousiotis, L. Shi, and S. Maskell, "Early predictor for student success based on behavioural and demographical indicators," in Intelligent Tutoring Systems, pp. 161–172, 2021, https://doi.org/10.1007/978-3-030-80421-3_19.

M. M. Tamada, R. Giusti, and J. F. de M. Netto, "Predicting students at risk of dropout in technical course using LMS logs," Electronics, vol. 11, no. 3, 2022, https://doi.org/10.3390/electronics11030468.

N. Ademi, S. Loshkovska, and S. Kalajdziski, "Prediction of student success through analysis of Moodle logs: Case study," in ICT Innovations 2019: Big Data Processing and Mining (Communications in Computer and Information Science), pp. 27–40, 2019, https://doi.org/10.1007/978-3-030-33110-8_3.

R. Dhanalakshmi, B. Namasivayam, S. Revathy, and S. Balasubramani, "Analyzing student performance and interaction in online learning environments using LMS log data," in Proc. 7th Int. Conf. Electron., Commun. Aerosp. Technol. (ICECA), pp. 1036–1042, 2023, https://doi.org/10.1109/ICECA58529.2023.10395561.

R. L. Moore and J. Shin, "Using learner engagement patterns for predictive modeling in a MicroMasters program," Distance Educ., vol. 46, no. 4, pp. 648–668, 2025, https://doi.org/10.1080/01587919.2024.2441252.

A. S. Aljaloud et al., "A deep learning model to predict student learning outcomes in LMS using CNN and LSTM," IEEE Access, vol. 10, pp. 85255–85265, 2022, https://doi.org/10.1109/ACCESS.2022.3196784.

A. Al-Sulami, M. Almasre, and N. Al-Malki, "Predicting at-risk students’ performance based on LMS activity using deep learning," Int. J. Adv. Comput. Sci. Appl., vol. 14, no. 6, 2023, https://doi.org/10.14569/IJACSA.2023.01406129.

S. Nyamane, A. O. Jadhav, and R. Ajoodha, "Predicting academic success in blended learning environments: A probabilistic Bayesian approach leveraging student trajectory data," SSRN preprint, 2023, https://doi.org/10.2139/ssrn.4650227.

D. Duch, M. May, and S. George, "Enhancing predictive analytics for students’ performance in Moodle: Insights from an empirical study," J. Data Sci. Intell. Syst., vol. 4, no. 1, pp. 84–96, 2024, https://doi.org/10.47852/bonviewJDSIS42023777.

M. Ardianti, O. D. Nurhayati, and B. Warsito, "Model prediksi kinerja siswa berdasarkan data log LMS menggunakan ensemble machine learning" (in Indonesian), J. Sains dan Teknol. Undiksha, vol. 12, no. 3, 2024, https://doi.org/10.23887/jstundiksha.v12i3.59816.

P. Kumari, P. K. Jain, and R. Pamula, "An efficient use of ensemble methods to predict students’ academic performance," in Proc. 4th Int. Conf. Recent Adv. Inf. Technol. (RAIT), pp. 1–6, 2018, https://doi.org/10.1109/RAIT.2018.8389056.

M. Liz-Domínguez, M. Llamas-Nistal, M. Caeiro-Rodríguez, and F. A. Mikic-Fonte, "Early predictions of course outcomes in a flipped classroom context," in Proc. 2023 IEEE Global Eng. Educ. Conf. (EDUCON), pp. 1–5, 2023, https://doi.org/10.1109/EDUCON54358.2023.10125172.

A. Alhassan, B. Zafar, and A. Mueen, "Predicting students’ academic performance based on their assessment grades and online activity data," Int. J. Adv. Comput. Sci. Appl., vol. 11, no. 4, 2020, https://doi.org/10.14569/IJACSA.2020.0110425.

E. Wakelam, A. Jefferies, N. Davey, and Y. Sun, "The potential for student performance prediction in small cohorts with minimal available attributes," Br. J. Educ. Technol., vol. 51, no. 2, pp. 347–370, 2020, https://doi.org/10.1111/bjet.12836.

S. Pongpaichet, S. Jankapor, S. Janchai, and T. Tongsanit, "Early detection of at-risk students using machine learning," in Proc. Int. Conf. Inf. Commun. Technol. Converg. (ICTC), pp. 283–287, 2020, https://doi.org/10.1109/ICTC49870.2020.9289185.

A. K. Dileep, A. Bansal, and J. Cunningham, "Early detection of at-risk students in a calculus course," in Proc. IEEE 46th Annu. Comput., Softw., Appl. Conf. (COMPSAC), pp. 187–194, 2022, https://doi.org/10.1109/COMPSAC54236.2022.00034.

A. Pérez-Suay, V. Laparra, S. Van Vaerenbergh, and A. B. Pascual-Venteo, "Learning about student performance from Moodle logs in a higher education context with Gaussian processes," IEEE Rev. Iberoam. Tecnol. Aprendizaje, vol. 19, pp. 169–175, 2024, https://doi.org/10.1109/RITA.2024.3465035.

Downloads

Published

2026-10-01

How to Cite

Tuanaya, R., Andriyanti, E., & Istiyono, E. (2026). Common LMS Log Indicators for Predicting Student Success: A Systematic Literature Review. Indonesian Journal of Applied Science and Engineering, 3(1), 40–54. https://doi.org/10.59247/ijase.v3i1.175

Issue

Section

Articles