Mapping the Evolution of Educational Evaluation and E-Learning Research in Indonesia Post-COVID-19: A Bibliometric Analysis (2020–2024)
DOI:
https://doi.org/10.59247/ijase.v4i1.154Keywords:
E-learning, Evaluation Model, Learning Assessment, Educational Technology, Post-COVID EducationAbstract
The rapid shift to online and technology-mediated learning during the COVID-19 pandemic significantly transformed Indonesia’s educational practices and intensified attention to how learning processes and outcomes are evaluated. This study maps the evolution of educational evaluation and e-learning research in Indonesia after the pandemic by examining publication trends, thematic patterns, and intellectual structures from 2020 to 2024. A total of 133 publications published between 2020 and 2024 were retrieved from Scopus using a structured search query construction procedure and analyzed through Biblioshiny. The analysis included annual scientific production, average citation trends, cumulative growth modelling, keyword co-occurrence mapping, thematic mapping, and conceptual structure analysis. Data quality was strengthened through duplicate checking, keyword standardization, metadata consistency checks, and verification of Indonesian institutional affiliations. The findings reveal five major clusters: e-learning as a central theme connecting evaluation and digital pedagogy; learning assessment and student performance; educational technology and AI-supported learning tools; learning systems and platform-based instructional models; and emerging topics such as digital literacy, local wisdom, metaverse-related learning, and instrument development. These results indicate a post-pandemic shift toward technology-supported evaluation practices while also exposing gaps in validated digital assessment instruments, longitudinal evaluation, AI-integrated assessment frameworks, and equity-sensitive studies across diverse Indonesian educational contexts.
References
M. Fitrah et al., “Are Teachers Ready to Adopt Deep Learning Pedagogy? The Role of Technology and 21st-Century Competencies Amid Educational Policy Reform,” Education Sciences, vol. 15, no. 10, Oct. 2025, https://doi.org/10.3390/educsci15101344.
A. Cahyadi, Hendryadi, S. Widyastuti, and Suryani, “COVID-19, emergency remote teaching evaluation: the case of Indonesia,” Education and Information Technologies, vol. 27, no. 2, pp. 2165–2179, Aug. 2021, https://doi.org/10.1007/s10639-021-10680-3.
D. Mulyaman and C. Catherine, “Comparative Analysis on South Korea and Indonesia’s Outcome-Based Education (OBE) Resilience Amidst The COVID-19 Pandemic,” Humaniora: Journal of Indonesia Culture and Society, vol. 13, no. 3, pp. 265–275, Nov. 2022, https://doi.org/10.21512/humaniora.v13i3.7734.
M. D. H. Rahiem, “The emergency remote learning experience of university students in Indonesia amidst the COVID-19 crisis,” International Journal of Learning, Teaching and Educational Research, vol. 19, no. 6, pp. 1–26, Jun. 2020, https://doi.org/10.26803/ijlter.19.6.1.
P. Priyanto and N. P. M. Suhandi, “Indonesian Higher Education Institutions Competitiveness and Digital Transformation Initiatives,” JPI (Jurnal Pendidikan Indonesia), vol. 11, no. 1, pp. 86–95, Feb. 2022, https://doi.org/10.23887/jpi-undiksha.v11i1.34263.
OECD. Shaping Digital Education: Enabling Factors for Quality, Equity and Efficiency. OECD Publishing, 2023, https://doi.org/10.1787/bac4dc9f-en.
M. F. Alquraan, S. Alazzam, and D. Farhat, “Assessing the structural relationships between the CIPP model components in teacher education program,” Asian Education and Development Studies, vol. 14, no. 1, pp. 103–114, Jan. 2025, https://doi.org/10.1108/AEDS-09-2024-0217.
A. Bingölbali, A. Aslan, V. Batdi, and E. Cinkara, “Mixed-meta Method Concerning the Effect of Blended Learning Practices on Students’ Academic Achievement in Higher Education Settings,” Sage Open, vol. 15, no. 2, Apr. 2025, https://doi.org/10.1177/21582440251336646.
T. T. Wu, H. Y. Lee, P. H. Li, C. N. Huang, and Y. M. Huang, “Promoting Self-Regulation Progress and Knowledge Construction in Blended Learning via ChatGPT-Based Learning Aid,” Journal of Educational Computing Research, vol. 61, no. 8, pp. 3–31, Jan. 2024, https://doi.org/10.1177/07356331231191125.
M. Bond, S. Bedenlier, V. I. Marín, and M. Händel, “Emergency remote teaching in higher education: mapping the first global online semester,” International Journal of Educational Technology in Higher Education, vol. 18, no. 1, p. 50, Dec. 2021, https://doi.org/10.1186/s41239-021-00282-x.
M. V. Carbonari et al., “The Impact and Implementation of Academic Interventions During COVID-19: Evidence from the Road to Recovery Project,” AERA Open, vol. 10, Jan. 2024, https://doi.org/10.1177/23328584241281286.
N. A. Dela Cruz, A. J. Adona, R. Molato-Gayares, and A. Park, “Learning loss and recovery from the COVID-19 pandemic: A systematic review of evidence,” Int. J. Educ. Dev., vol. 115, May 2025, https://doi.org/10.1016/j.ijedudev.2025.103271.
L. Boeskens and K. Meyer, “Policies for the digital transformation of school education: Evidence from the Policy Survey on School Education in the Digital Age,” OECD Education Working Papers, Mar. 2025, https://doi.org/10.1787/464dab4d-en.
D. T. Figueroa, C. Rawkins, E. Qing, and H. M. de Sousa. Education Policy Outlook 2024: Reshaping Teaching into a Thriving Profession from ABCs to AI. OECD Publishing, 2024, https://doi.org/10.1787/dd5140e4-en.
A. Santoso, H. Retnawati, M. Nikma Rosyada, E. Apino, I. Rafi, and A. Dauletkulova, “Factors Influencing the Success of Students’ Learning through Online Learning/Distance Education : A Bibliometric Analysis of Scopus Database,” Jurnal Kependidikan : Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran, dan Pembelajaran, vol. 10, no. 1, pp. 286–299, Mar. 2024, https://doi.org/10.33394/jk.v10i1.10856.
K. Aviory, H. Retnawati, and S. Sudiyatno, “Factors affecting mathematics achievement: Online learning, self-efficacy, and self-regulated learning,” Journal of Pedagogical Research, vol. 9, no. 3, pp. 276–290, Jun. 2025, https://doi.org/10.33902/JPR.202534085.
D. M. Zulqadri, A. Mustadi, and H. Retnawati, “Digital Safety During Online Learning: What We Do to Protect Our Student?,” Jurnal Iqra’ : Kajian Ilmu Pendidikan, vol. 7, no. 1, pp. 178–191, Jun. 2022, https://doi.org/10.25217/ji.v7i1.1746.
R. A. Fauzani, A. Senen, and H. Retnawati, “Challenges for Elementary School Teachers in Attitude Assessment During Online Learning,” Journal of Education Research and Evaluation, vol. 5, no. 3, pp. 362–372, Jun. 2021, https://ejournal.undiksha.ac.id/index.php/JERE/article/view/33226.
M. Aria and C. Cuccurullo, “bibliometrix: An R-tool for comprehensive science mapping analysis,” J. Informetr., vol. 11, no. 4, pp. 959–975, Nov. 2017, https://doi.org/10.1016/j.joi.2017.08.007.
N. Donthu, S. Kumar, D. Mukherjee, N. Pandey, and W. M. Lim, “How to conduct a bibliometric analysis: An overview and guidelines,” J. Bus. Res., vol. 133, pp. 285–296, Sep. 2021, https://doi.org/10.1016/j.jbusres.2021.04.070.
L. Lundberg and L. L. Se, “Bibliometric mining of research directions and trends for big data,” Journal of Big Data, vol. 10, no. 1, pp. 112-, Jul. 2023, https://doi.org/10.1186/s40537-023-00793-6.
A. D. Oktarina, S. Hamdi, A. Wijaya, Z. Zafrullah, and S. Rashid, “Research Trends on the Implementation of Digital Literacy in Education: A Bibliometric Analysis of the Scopus Database,” Indonesian Journal on Learning and Advanced Education (IJOLAE), vol. 7, no. 3, pp. 481–502, Sep. 2025, https://doi.org/10.23917/ijolae.v7i3.11087.
N. E. Sudakova, T. N. Savina, A. R. Masalimova, M. N. Mikhaylovsky, L. G. Karandeeva, and S. P. Zhdanov, “Online Formative Assessment in Higher Education: Bibliometric Analysis,” Educ. Sci. (Basel)., vol. 12, no. 3, Mar. 2022, https://doi.org/10.3390/educsci12030209.
F. Siddiq, A. D. Olofsson, J. O. Lindberg, and L. Tomczyk, “Special issue: What will be the new normal? Digital competence and 21st-century skills: critical and emergent issues in education,” Education and Information Technologies, vol. 29, no. 6, pp. 7697–7705, Aug. 2023, https://doi.org/10.1007/s10639-023-12067-y.
D. Permadi and E. H. Tiarto, “Bibliometric Analysis: Physics Online Learning in Indonesia (2020-2021),” Online Learning In Educational Research (OLER), vol. 2, no. 1, pp. 11–18, Jun. 2022, https://doi.org/10.58524/oler.v2i1.94.
D. A. Parry, “Computing Research in South Africa: A Scientometric Investigation,” South African Computer Journal, vol. 31, no. 1, pp. 51–79, Jul. 2019, https://doi.org/10.18489/sacj.v31i1.674.
G. Solorzano and V. Plevris, “Computational intelligence methods in simulation and modeling of structures: A state-of-the-art review using bibliometric maps,” Front. Built Environ., vol. 8, p. 1049616, Oct. 2022, https://doi.org/10.3389/fbuil.2022.1049616.
P. Chatterjee, A. Saha, S. Kadry, and G. Demir. Bibliometric Analyses in Data-Driven Decision-Making. Wiley, 2025, https://doi.org/10.1002/9781394302581.
M. Budler, I. Župič, and P. Trkman, “The development of business model research: A bibliometric review,” J. Bus. Res., vol. 135, pp. 480–495, Oct. 2021, https://doi.org/10.1016/j.jbusres.2021.06.045.
R. Maucuer and A. Renaud, “Business Model Research: A Bibliometric Analysis of Origins and Trends,” Management, vol. 22, no. 2, pp. 176–215, 2019, https://doi.org/10.3917/mana.222.0176.
S. Ding, “Insights into bibliometric analyses,” JBI Evid. Synth., vol. 23, no. 4, pp. 564–565, Apr. 2025, https://doi.org/10.11124/JBIES-24-00522.
J. A. Moral-Muñoz, E. Herrera-Viedma, A. Santisteban-Espejo, and M. J. Cobo, “Software tools for conducting bibliometric analysis in science: An up-to-date review,” Profesional de la Informacion, vol. 29, no. 1, pp. 1699–2407, Jan. 2020, https://doi.org/10.3145/epi.2020.ene.03.
B. D. Ghorbani, Bibliometrix: Science Mapping Analysis with R Biblioshiny Based on Web of Science in Applied Linguistics. Springer Nature, 2024, https://doi.org/10.1007/978-3-031-51726-6_8.
L. Karadağ and T. M. İ. Özberk, “Academic Mapping of Digital Marketing and Tourism Marketing: A Bibliometric Analysis,” Romaya Journal, vol. 5, no. 1, pp. 21–36, Apr. 2025, https://doi.org/10.5281/zenodo.15258006.
H. T. Luong, “Foundations and trends in the darknet-related criminals in the last 10 years: a systematic literature review and bibliometric analysis,” Security Journal, vol. 37, no. 3, pp. 535–574, May 2023, https://doi.org/10.1057/s41284-023-00383-4.
A. P. Costa, E. D. Moresi, I. Pinho, and M. Halaweh, “Integrating Bibliometrics and Qualitative Content Analysis for Conducting a Literature Review,” 2023 24th International Arab Conference on Information Technology, ACIT 2023, 2023, https://doi.org/10.1109/ACIT58888.2023.10453680.
B. Borsi, Z. Vida, and S. Soós, “Keyword standardization and restructuring: the impact on analysing network-based science maps in innovation management research,” Scientometrics, vol. 130, no. 2, pp. 593–617, Feb. 2025, https://doi.org/10.1007/s11192-025-05232-2.
L. Bredahl, “The Current and Evolving Landscape of Bibliometric Tools and Technologies,” ALA TechSource, vol. 58, no. 8, 2022, https://doi.org/10.5860/ltr.58n8.
G. Miller and E. Spiegel, “Guidelines for Research Data Integrity (GRDI),” Scientific Data 2025 12:1, vol. 12, no. 1, pp. 95-, Jan. 2025, https://doi.org/10.1038/s41597-024-04312-x.
R. L. Ravn, “The Effects of the COVID-19 Pandemic on School-to-School Transitions. A Study of Lower Secondary School Graduates,” Soc. Policy Adm., vol. 59, no. 5, pp. 762–778, Sep. 2025, https://doi.org/10.1111/spol.13092.
S. Mammola, E. Piano, A. Doretto, E. Caprio, and D. Chamberlain, “Measuring the influence of non-scientific features on citations,” Scientometrics, vol. 127, no. 7, pp. 4123–4137, Jun. 2022, https://doi.org/10.1007/s11192-022-04421-7.
P. Dorta-González and E. Gómez-Déniz, “A Two-Stage Model for Factors Influencing Citation Counts,” Publications, vol. 13, no. 2, Jun. 2025, https://doi.org/10.3390/publications13020029.
T. Liskiewicz, G. Liskiewicz, and J. Paczesny, “Factors affecting the citations of papers in tribology journals,” Scientometrics, vol. 126, no. 4, pp. 3321–3336, Feb. 2021, https://doi.org/10.1007/s11192-021-03870-w.
J. Simangunsong and H. Mustikaningsih, “An evaluation of the implementation of study-from-home policy in senior high school during Covid-19 pandemic,” REID (Research and Evaluation in Education), vol. 8, no. 1, pp. 67–77, Jun. 2022, https://doi.org/10.21831/reid.v8i1.36734.
R. Meylani and A. Prof, “A Comparative Analysis of Traditional and Modern Approaches to Assessment and Evaluation in Education,” The Western Anatolia Journal of Educational Sciences (WAJES), vol. 15, no. 1, pp. 520–555, Apr. 2024, https://doi.org/10.51460/baebd.1386737.
K. Kabassi, “Comparing Multi-Criteria Decision Making Models for Evaluating Environmental Education Programs,” Sustainability, vol. 13, no. 20, Oct. 2021, https://doi.org/10.3390/su132011220.
A. C. Graham and S. McAleer, “An overview of realist evaluation for simulation-based education,” Adv. Simul. (Lond)., vol. 3, no. 1, Dec. 2018, https://doi.org/10.1186/s41077-018-0073-6.
M. Coldwell and B. Maxwell, “Using evidence-informed logic models to bridge methods in educational evaluation,” Review of Education, vol. 6, no. 3, pp. 267–300, Oct. 2018, https://doi.org/10.1002/rev3.3151.
E. S. Boadu and I. Ile, “Evaluation innovation in Africa: Towards indigenously responsive evaluation (IRE) philosophies, methods and practices in Ghana,” African Journal of Science, Technology, Innovation and Development, vol. 15, no. 5, pp. 624–636, Jul. 2023, https://doi.org/10.1080/20421338.2023.2173864.
