Quantifying learning losses due to COVID-19 in Ecuador: A fixed-effects analysis of standardized test scores for elementary and middle school

Juan Elias Ponce Jarrín; Ruthy Vanessa Intriago Armijos

doi:10.24965/gapp.11346

Authors

Juan Elias Ponce Jarrín Facultad Latinoamericana de Ciencias Sociales, FLACSO (Ecuador – Ecuador) https://orcid.org/0000-0002-1699-9934
Ruthy Vanessa Intriago Armijos Facultad Latinoamericana de Ciencias Sociales, FLACSO (Ecuador – Ecuador) https://orcid.org/0000-0003-4804-0194

DOI:

https://doi.org/10.24965/gapp.11346

Keywords:

education, COVID-19, learning loss, academic performance, fixed-effects model

Abstract

Objectives: The COVID-19 crisis has led to extensive school closures, affecting education worldwide. This study investigates the impact of these closures on academic achievement in Ecuador, particularly for 4th-, 7th-, 10th-, and 12th-grade students. Methodology: A score-equating process was conducted to standardize test scores across different school years. The study spans four years and employs a fixed-effects regression model to analyze learning achievements. Results: The results indicate a significant adverse impact of the pandemic on academic achievements across all grades. On average, students’ academic achievements in 2022 were substantially lower than those in the pre-pandemic years, suggesting a near-complete loss of learning. Conclusions: These findings underscore the profound negative effects of the COVID-19 pandemic on education in Ecuador and emphasize the urgent need for effective interventions to address learning loss and mitigate long-term consequences.

Downloads

Download data is not yet available.

Author Biographies

Juan Elias Ponce Jarrín, Facultad Latinoamericana de Ciencias Sociales, FLACSO (Ecuador – Ecuador)

PhD. en Estudios del Desarrollo por el Institute of Social Studies de la Haya de la Universidad Erasmus. Exdirector de FLACSO Ecuador (2012-2020), profesor investigador del Departamento de Desarrollo, Ambiente y Territorio de esta universidad. Es experto en economía de la educación, pobreza y desigualdad, economía laboral y evaluación de impacto. Ha participado en algunas evaluaciones de impacto de programas sociales en Ecuador: Bono de Desarrollo Humano, Redes Amigas, Hilando el Desarrollo. Ha trabajado en proyectos de investigación a nivel latinoamericano.

Ruthy Vanessa Intriago Armijos, Facultad Latinoamericana de Ciencias Sociales, FLACSO (Ecuador – Ecuador)

Máster en Economía del Desarrollo por la Facultad Latinoamericana de Ciencias Sociales (FLACSO) Ecuador. Ha ocupado importantes cargos en el Ministerio de Educación de Ecuador, donde ha dirigido investigaciones y políticas educativas. Su experiencia abarca la coordinación de proyectos sociales y el análisis de políticas públicas, con énfasis en la evaluación de programas educativos. Actualmente, es candidata a doctora en Economía del Desarrollo por FLACSO Ecuador y está especializada en estudios económicos y sociales. Ha publicado en revistas académicas y contribuido a libros sobre educación y desarrollo en América Latina.

References

Aguaded, I., Vizcaíno-Verdú, A., García-Prieto, V. & De-Casas-Moreno, P. (2023). The impact of post-pandemic learning loss on education development: A systematic review. Review of Communication Research, (11), 172-189.

Alasino, E., Ramírez, M. J., Romero, M., Schady, N. & Uribe, D. (2024). Learning losses during the COVID-19 pandemic: Evidence from Mexico. Economics of Education Review, (98), article 102492. https://doi.org/10.1016/j.econedurev.2023.102492

Angrist, N., de Barros, A., Bhula, R., Chakera, S., Cummiskey, C., DeStefano, J., Floretta, J., Kaffenberger, M., Piper, B. & Stern, J. (2021). Building back better to avert a learning catastrophe: Estimating learning loss from COVID-19 school shutdowns in Africa and facilitating short-term and long-term learning recovery. International Journal of Educational Development, (84), article 102397. https://doi.org/10.1016/j.ijedudev.2021.102397

Ardington, C., Wills, G. & Kotze, J. (2021). COVID-19 learning losses: Early grade reading in South Africa. International Journal of Educational Development, (86), article 102480. https://doi.org/10.1016/j.ijedudev.2021.102480

Azevedo, J. P., Hasan, A., Goldemberg, D., Geven, K. & Iqbal, S. A. (2021). Simulating the potential impacts of COVID-19 school closures on schooling and learning outcomes: A set of global estimates. The World Bank Research Observer, 36(1). https://doi.org/10.1093/wbro/lkab003

Baez, J., de la Fuente, A. & Santos, I. V. (2010). Do Natural Disasters Affect Human Capital? An Assessment Based on Existing Empirical Evidence [IZA Discussion Paper n.º 5164]. IZA. http://dx.doi.org/10.2139/ssrn.1672172

Bartholo, T. L., Koslinski, M. C., Tymms, P. & Castro, D. L. (2023). Learning loss and learning inequality during the COVID-19 pandemic. Ensaio: Avaliação e Políticas Públicas Em Educação, (31), article e0223776. https://doi.org/10.1590/S0104-40362022003003776

Bertoletti, A., Cannistrà, M., Soncin, M. & Agasisti, T. (2023). The heterogeneity of COVID-19 learning loss across Italian primary and middle schools. Economics of Education Review, (95), article 102435. https://doi.org/10.1016/j.econedurev.2023.102435

Blaskó, Z., da Costa, P. & Schnepf, S. V. (2022). Learning losses and educational inequalities in Europe: Mapping the potential consequences of the COVID-19 crisis. Journal of European Social Policy, 32(4), 361-375. https://doi.org/10.1177/09589287221091687

Contini, D., Di Tommaso, M. L., Muratori, C., Piazzalunga, D. & Schiavon, L. (2022). Who lost the most? Mathematics achievement during the COVID-19 pandemic. The BE Journal of Economic Analysis & Policy, 22(2), 399-408. https://doi.org/10.1515/bejeap-2021-0447

De Medeiros Miranda, E. & Baum, D. R. (2024). COVID-19 learning loss and recovery in Brazil: Assessing gaps across social groups. Education Policy Analysis Archives, (32). https://doi.org/10.14507/epaa.32.8082

Engzell, P., Frey, A. & Verhagen, M. D. (2021). Learning loss due to school closures during the COVID-19 pandemic. Proceedings of the National Academy of Sciences of the United States of America, 118(17), artículo e2022376118. https://doi.org/10.1073/pnas.2022376118

Gore, J., Fray, L., Miller, A., Harris, J. & Taggart, W. (2021). The impact of COVID-19 on student learning in New South Wales primary schools: An empirical study. The Australian Educational Researcher, (48), 605-637. https://doi.org/10.1007/s13384-021-00436-w

Guariso, A. & Nyqvist, M. B. (2023). The impact of the COVID-19 pandemic on children’s learning and wellbeing: Evidence from India. Journal of Development Economics, (164), article 103133. https://doi.org/10.1016/j.jdeveco.2023.103133

Hammerstein, S., König, C., Dreisörner, T. & Frey, A. (2021). Effects of COVID-19 –related school closures on student achievement– a systematic review. Frontiers in psychology, (12), article 746289. https://doi.org/10.3389/fpsyg.2021.746289

Intriago, R. (2021). Revisión de mecanismos de adaptación de los sistemas educativos a nivel regional e internacional a la emergencia sanitaria y estudio sobre la adaptación de la gestión docente en el contexto de la crisis sanitaria generada por al COVID-19. Ministerio de Educación de Ecuador. https://educacion.gob.ec/wp-content/uploads/downloads/2022/02/Nota-tecnica-estudio-sistemas-educativos-practicas-docentes-en-emergencia-sanitaria.pdf

Jakubowski, M., Gajderowicz, T. & Patrinos, H. A. (2023). Global learning loss in student achievement: First estimates using comparable reading scores. Economics Letters, (232), article 111313. https://doi.org/10.1016/j.econlet.2023.111313

Kilenthong, W. T., Boonsanong, K., Duangchaiyoosook, S., Jantorn, W. & Khruapradit, V. (2023). Learning losses from school closure due to the COVID-19 pandemic for Thai kindergartners. Economics of Education Review, (96), article 102455. https://doi.org/10.1016/j.econedurev.2023.102455

Kuzmanic, D., Meneses, F., Valenzuela, J. P., Rodríguez, P. & Claro, S. (2024). Inequalities in learning loss during the COVID-19 pandemic in Chile: the significance of school effectiveness. School Effectiveness and School Improvement, 35(2), 95-115. https://doi.org/10.1080/09243453.2024.2328016

Lichand, G., Doria, C. A., Leal-Neto, O. & Cossi Fernandes, J. P. (2022). The impacts of remote learning in secondary education during the pandemic in Brazil. Nature Human Behaviour, (6), 1079-1086. https://doi.org/10.1038/s41562-022-01350-6

Lustig, N., Martínez Pabon, V., Neidhöfer, G. & Tommasi, M. (2023). Short and Long-Run Distributional Impacts of COVID-19 in Latin America. Economía LACEA Journal, 22(1), 96-116. https://doi.org/10.31389/eco.3

Maldonado, J. E. & De Witte, K. (2020). The effect of school closures on standardised student test outcomes [discussion paper series DPS20.17]. FEB Research Report Department of Economics. https://lirias.kuleuven.be/3189074

Monroy-Gómez-Franco, L., Vélez-Grajales, R. & López-Calva, L. F. (2022). The potential effects of the COVID-19 pandemic on learnings. International journal of educational development, (91), article 102581. https://doi.org/10.1016/j.ijedudev.2022.102581

Moscoviz, L. & Evans, D. K. (2022). Learning loss and student dropouts during the COVID-19 pandemic: A review of the evidence two years after schools shut down [Working Papers 609]. Center for Global Development. https://www.cgdev.org/publication/learning-loss-and-student-dropouts-during-covid-19-pandemic-review-evidence-two-years

Pacheco, D. (2024). Exploring the Impacts of Network Improvement Communities During Times of Crisis [doctoral dissertation]. Fordham University.

Patrinos, H. A., Vegas, E. & Carter-Rau, R. (2022). An Analysis of COVID-19 Student Learning Loss [Policy Research Working Paper n.º 10033]. World Bank Group. https://hdl.handle.net/10986/37400

Reimers, F. M. (2022). Learning from a pandemic: The impact of COVID-19 on education around the world. In F. M. Reimers (ed.), Primary and secondary education during COVID-19: Disruptions to educational opportunity during a pandemic (pp. 1-37). Springer. https://doi.org/10.1007/978-3-030-81500-4

Relyea, J. E., Rich, P., Kim, J. S. & Gilbert, J. B. (2023). The COVID-19 impact on reading achievement growth of Grade 3-5 students in a U. S. urban school district: variation across student characteristics and instructional modalities. Reading and Writing, (36), 317-346. https://doi.org/10.1007/s11145-022-10387-y

Schult, J., Mahler, N., Fauth, B. & Lindner, M. A. (2022). Did students learn less during the COVID-19 pandemic? Reading and mathematics competencies before and after the first pandemic wave. School Effectiveness and School Improvement, 33(4), 544-563. https://doi.org/10.1080/09243453.2022.2061014

Schuurman, T. M., Henrichs, L. F., Schuurman, N. K., Polderdijk, S. & Hornstra, L. (2023). Learning loss in vulnerable student populations after the first COVID-19 school closure in the Netherlands. Scandinavian Journal of Educational Research, 67(2), 309-326. https://doi.org/10.1080/00313831.2021.2006307

Singh, A., Romero, M. & Muralidharan, K. (2023). COVID-19 Learning Loss and Recovery: Panel Data Evidence from India. Journal of Human Resources, 59(5). https://doi.org/10.3368/jhr.0723-13025R2

Tang, K. H. D. (2023). Impacts of COVID-19 on primary, secondary and tertiary education: a comprehensive review and recommendations for educational practices. Educational Research for Policy and Practice, 22(1), 23-61. https://doi.org/10.1007/s10671-022-09319-y

Tomasik, M. J., Helbling, L. A. & Moser, U. (2021). Educational gains of in-person vs. distance learning in primary and secondary schools: A natural experiment during the COVID-19 pandemic school closures in Switzerland. International Journal of Psychology, 56(4), 566-576. https://doi.org/10.1002/ijop.12728

Uğraş, M., Zengin, E., Papadakis, S. & Kalogiannakis, M. (2023). Early childhood learning losses during COVID-19: Systematic review. Sustainability, 15(7), article 6199. https://doi.org/10.3390/su15076199

UNESCO (2020). How many students are at risk of not returning to school? https://unesdoc.unesco.org/ark:/48223/pf0000373992

Wolf, S., Aurino, E., Suntheimer, N. M., Avornyo, E. A., Tsinigo, E., Jordan, J., Samanhiya, S., Aber, J. L. & Behrman, J. R. (2022). Remote learning engagement and learning outcomes during school closures in Ghana. International Journal of Educational Research, (115), article 102055. https://doi.org/10.1016/j.ijer.2022.102055