Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

No evidence of a major learning slide 14 months into the COVID-19 pandemic in Denmark

No evidence of a major learning slide 14 months into the COVID-19 pandemic in Denmark EUROPEAN SOCIETIES https://doi.org/10.1080/14616696.2022.2129085 No evidence of a major learning slide 14 months into the COVID-19 pandemic in Denmark Jesper Fels Birkelund and Kristian Bernt Karlson Department of Sociology, University of Copenhagen, Copenhagen, Denmark ABSTRACT We study the effects of the COVID-19 pandemic on children’sacademic performance in Denmark 14 months into the pandemic using nationwide and exceptionally rich data on reading test scores and family background (N ≈ 200,000 per year). We find no evidence of a major learning loss. While pupils in grade 8 experienced a three percentile points loss in reading performance, pupils in grades 2 and 4 experienced a learning gain of about five percentile points, possibly resulting from school closures being significantly longer among older (22 weeks) than younger children (eight weeks). Importantly and in contrast to pre-registered expectations, we find little evidence of widening learning gaps by family background. Further analyses point to that all of these patterns were already in place a few months into pandemic, suggesting that learning gaps did not widen during subsequent, longer school closures. We also find some indication that boys and low-performing pupils suffered more from school closures than girls and high-performing pupils, but these differences are minor. We discuss which political measures may have been instrumental for overcoming the COVID-19 learning slide in Denmark. ARTICLE HISTORY Received 1 June 2022; Accepted 22 September 2022 Edited by Patrick Präg KEYWORDS COVID-19; school closures; learning; reading; social inequality Introduction The prolonged nature of the COVID-19 pandemic with several months of school closures has left policymakers and educators concerned about potential long-term consequences for children’s learning. Although research shows evidence of a short-term learning loss (Hammerstein et al. 2021; Zierer 2021), less is known about the consequences for learning CONTACT Jesper Fels Birkelund jfb@soc.ku.dk Department of Sociology, University of Copen- hagen, Oester Farimagsgade 5, Building 16, Copenhagen DK-1353, Denmark Supplemental data for this article can be accessed online at 10.1080/14616696.2022.2129085. © 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http:// creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 2 J. F. BIRKELUND AND K. B. KARLSON and how they differ by family background more than one year into the pan- demic. The few studies that have examined the impact on learning beyond the first year of the pandemic generally report persistent, although not increasing learning deficits (Betthäuser et al. 2022). We contribute to this literature by examining whether school closures in Denmark have led to a learning loss among children about 14 months into the pandemic. Distance learning has been criticized for being less effective than the face-to-face instruction that it has replaced during the pandemic, and the learning transition has in many places been hampered by lack of stable internet connectivity and availability of necessary digital tools (Domina et al. 2021; Grätz and Lipps 2021; Grewenig et al. 2021). A further concern has been that prolonged periods of social isolation may have worsened student engagement in school (Loades et al. 2020). Indeed, early studies on the effects of school closures in spring 2020 docu- ment a substantial learning loss. In a study on the Netherlands, Engzell et al.(2021) draw on longitudinal test score data on 350,000 pupils aged 8–11 and find an average learning loss of 3 percentile points, correspond- ing to eight weeks of lost learning, the same number of weeks that schools were closed. This result implies that ‘students made little or no progress while learning from home’ (Engzell et al. 2021, p. 1). Other studies relying on longitudinal data on standardized tests find learning losses of similar magnitude in China (Clark et al. 2021), Italy (Contini et al. 2021), and the United States (Kuhfeld et al. 2020; Pier et al. 2021). Studies relying on cross-sectional comparisons generally find similar results (Blainey et al. 2020; Kogan and Lavertu 2021; Maldonado and De Witte 2022; Rose et al. 2021; Schult et al. 2022), although some find little or mixed evidence of a learning loss (Gore et al. 2021; Depping et al. 2021). However, cross-sectional data do not allow for proper analysis of biases from cohort effects or non-participation, both of which may have been substantial during the pandemic (Werner and Woessmann 2021). Studies with access to individual-level data on family background gen- erally find a social gradient in the learning loss (Engzell 2021;Pier et al. 2021), although Contini et al.(2021) find a social gradient for high-per- forming students only. For instance, Engzell et al.(2021) find the learning loss to be 50% larger among children whose parents do not have upper sec- ondary schooling compared to children with at least one parent who does. These results echo what we know from the well-established social science literature on the ‘summer learning loss’: disadvantaged children are those who suffer most from the learning break during the summer months when there is no formal schooling (Cooper et al. 1996; Downey et al. 2004; EUROPEAN SOCIETIES 3 Alexander et al. 2007; von Hippel et al. 2018). As the structured learning environment of schools is replaced by home schooling, parents’ resources are expected to play a very significant role for how children are able to keep up. Perhaps most importantly for the COVID-19 situation, advantaged parents are likely to have the economic and cultural resources to not only provide stimulating and structured learning environments but also to de-code and translate instructions sent from teachers (Goudeau et al. 2021;Lareau 2000; Lareau and Calarco 2012). Beyond these early findings, we know very little about the lasting effects of school closures. Yet, such knowledge is important, as there is no reason to expect that the initial learning loss can be extrapolated lin- early to the substantially longer closure experiences that have followed in most countries (Werner and Woessmann 2021). In contrast, as schools and teachers have had time to develop active online teaching methods and students have had the opportunity to adapt to them, weekly losses are likely to have been reduced (i.e. pupils’ learning progression would approach their pre-pandemic one). Preliminary findings from Belgium and the Netherlands indicate that the learning loss may indeed have halted during subsequent school closures (Gambi and De Witte 2021; Haelermans et al. 2021). Moreover, a number of studies suggest that stu- dents’ performance in online-learning environments has generally increased during the pandemic (Meeter 2021; Spitzer and Musslick 2021; Tomasik et al. 2021; van der Velde 2021). From March 2020 throughout May 2021, Denmark experienced two lengthy periods of nationwide school closures in response to the COVID-19 pandemic, which lasted for a total of 22 school weeks or more than half a school year – slightly more than the OECD average (OECD 2021). Denmark thus provides an interesting context for study- ing the effects of school closures by being a country with relatively long-lasting closures, while having otherwise good preconditions for handling the educational disruption. The transition to distance learning was made relatively smooth by the reliable digital infrastructure with Denmark being one of the absolute top-scorers in digital skills, broad- band connectivity, and digital public services in Europe (European Com- mission 2020). Schools were better prepared for the second and longer school closure (Qvortrup et al. 2021) and received financial help from a political settlement, which allocated 35 million Euros towards extra teaching and student well-being efforts in the first half of 2021. The Danish response thus presents a potential best-case scenario for limiting the negative impact of school closures on students’ learning. 4 J. F. BIRKELUND AND K. B. KARLSON Our study evaluates the effects of school closures prompted by the COVID-19 pandemic on children’s academic performance more than one year into the pandemic. For this purpose, we use nationwide standar- dized reading test data on Danish public school pupils with very little attrition and very detailed and highly reliable information on family background. Controlling for cohort differences in family background and prior performance, we compare test scores from mid-2021 to what would be expected from test score trajectories in the years prior to the pandemic (i.e. 2017–2019). To examine family background gaps in the learning loss, we use a difference-in-differences approach to compare the average development in reading performance for individual pupils between school years (e.g. between grades 4 and 6) before and after the pandemic and for different social groups defined by gender, ethnicity, family type, prior performance, and parental education, income, and/or employment. These approaches and the underlying research hypotheses were pre-registered (see Supplementary material S1). The empirical results show no evidence of any major learning slide in Denmark. Only among the oldest pupils in grade 8 (age 14) do we find a decrease in reading performance of about 3 percentile points. The youngest pupils, particularly those in grades 2 and 4 (aged 8 and 10), even show a learning gain of about 5 percentile points. However, these pupils are also those least affected by school closures with only about eight weeks of dis- tance learning compared to 22 weeksamong pupils in grades 6 and 8. Impor- tantly, we find only little evidence of widening learning gaps by socioeconomic origin. Still, in grade 8 we see a tendency for gaps by parental income and employment to widen slightly. Nonetheless, these patterns were already in place after the initial lockdown in spring 2020, suggesting that learning gaps did not widen during the subsequent year in which most of the total lockdown period occurred. Finally, we find some indication that boys and low-performing pupils suffered more from school closures than girls and high-performing pupils, but these differences are relatively small. We conclude the paper with a discussion of which measures to coun- teract learning losses in Denmark may explain the findings we report. Materials and methods Study setting Danish schools were closed down twice in response to the COVID-19 pandemic. The first school closure started 16 March 2020 and lasted EUROPEAN SOCIETIES 5 for eight school weeks. The second school closure was initiated in response to rising infection rates on 21 December 2020 and was signifi- cantly longer than the first shutdown, lasting for 14 school weeks. Only the oldest pupils in grades 6–8 were exposed to the full 22 school weeks of distance learning, which amounts to half of the total number of school weeks between 16 March 2020 and 6 May 2021. Younger pupils in grades 0–4 were allowed back in school early on both occasions and were exposed to distance learning for a total of eight school weeks. In addition to these nationwide school closures, there have been numerous local school closures in areas with high infection rates, meaning that 22 (8) weeks of distance learning is the minimum period of exposure. A teacher survey from the first school closure in spring 2020 shows that the vast majority of older pupils’ lessons were successfully replaced by live classroom teaching using video conferencing software such as Skype or Microsoft Teams (The Danish Evaluation Institute 2021). Among the younger pupils, however, particularly those in grades 1–3, this type of online classroom teaching was rare, whereas it was used by about half of teachers in grades 4–6. Younger pupils instead regularly received written instructions from teachers about which distributed assignments they should work on at home, if possible with help from parents. Older pupils in grades 5–9 were surveyed during both school clo- sures and experienced that distance teaching had become more struc- tured and varied and teachers more accessible in the second school closure (Qvortrup et al. 2021). However, pupils also experienced school work during the lockdown as lonely, repetitive, and less instructive than normal classroom teaching in which pupils usually are asked to work together in pairs or groups (The Danish Evaluation Institute 2021). Still, about one-third of pupils reported to have been more motiv- ated to study during lockdown with fewer disturbances and more oppor- tunity to concentrate as primary explanations. Data The analysis was conducted using Danish national test score data made available by The National Agency for IT and Learning (Styrelsen for IT og Læring) under the Ministry of Children and Education. The dataset contains results from standardized tests in reading conducted yearly between 2015 and 2021 among all Danish public school pupils in grades 2, 4, 6, and 8 (i.e. ages 8, 10, 12, and 14). Given that we work with administrative data, our sample covers the vast majority of 6 J. F. BIRKELUND AND K. B. KARLSON schoolchildren in a given grade in a given year, meaning that we have available total population data (N ≈ 200,000 per year). To ensure compar- ability of student cohorts, we exclude test score data from 2020 in the main analysis, as 2020 stands out as being the only test year where not the full student population was tested; instead, a nine-percent random sample of schools was issued. In an additional analysis, we examine the impact on learning in 2020 by studying this subsample of schools. We link the national test score data to the population-wide adminis- trative registers at Statistics Denmark via personal identification numbers. From these registers, we obtain complete and highly reliable information on gender, ethnic origin, family type, number of siblings, and parental education, employment, and income. Test scores Our main dependent variable is the Danish national test scores in reading. The test is conducted each year among all Danish public school pupils in grades 2, 4, 6, and 8. It is carried out at school using an online, self-scoring, and adaptive program that taps into three cogni- tive domains of language comprehension, decoding, and reading com- prehension. Reading test questions involve, for example, word-to- picture matching, word splitting, or reading a text and answering content-related questions. The adaptive nature of the test means that the difficulty level of questions continuously adapts to the test subject’s demonstrated ability level with the online test system drawing questions from the same large national item bank ensuring that test scores are com- parable across schools and test years within school grades (Beuchert and Nandrup 2018). Test scores are, however, not comparable across school grades, meaning that we cannot measure an individual’s reading pro- gression between, for example, grades 4–6. Still, we can measure pro- gression in an individual’s relative reading rank and thus also any gaps in the relative progression of social groups defined by gender, ethnicity, or parents’ socioeconomic resources. In all previous years (2015–2019), the majority of pupils has been tested in the month of April. However, in 2021 the majority took the In the adaptive testing, the pupil answers questions of varying difficulty based on a continuous assess- ment of the pupil’s latent ability in the domain. The final score is derived using Rasch scaling, called the estimated pupil ability level, and is presented on a logit scale ranging from −7 through 7 (Beuchert and Nandrup 2018: 5). In contrast to linear testing, pupils are not answering all questions in the test, but only those at the pupil’s approximate skill level. EUROPEAN SOCIETIES 7 test in May, when schools began re-opening (see Supplementary material S2). Thus the test taking is separated by about four school weeks, amounting to a potential 1.5 percentage points learning gain according to the World Bank benchmark for yearly learning progress (Azevedo et al. 2021; Engzell et al. 2021), which could affect the estimated learning loss. We deal with this data feature in two ways. First, we present esti- mates for which we control for month of test, which is possible due to sufficient variation in month of test in all years. Second, we bound our estimates in light of this potential bias. Both auxiliary analyses show that timing of the test does not alter any of the key conclusions we present. The Danish national test data also include a yearly standardized math test in grades 3, 6, and 8. However, data is only available for years 2016– 2021 for grade 3 and years 2018–2021 for grades 6 and 8. Because of the limited measurement period, we only use the math test data to check the robustness of our main results based on the reading test data. Independent variables Independent variables include parental education, employment, and income as well as gender, ethnic origin, family type, and number of sib- lings (see Supplementary material S2). Our measure of parental edu- cation distinguishes between at least one parent holding a college degree (∼48%) and both parents with less than a college degree (∼52%). Our measure of parental employment distinguishes between both parents being employed (∼82%) and at least one parent being unemployed (∼18%), defined as receiving unemployment benefits, cash assistance, or disability pension. Parental income is measured as parents’ total disposable income from wage employment, self-employ- ment, and public transfers after tax, coded into quartiles. Our measure of ethnic origin distinguishes between children of Danish origin (∼89%), children of immigrants (∼8%), and immigrants (∼4%). Our measure of family type distinguishes between intact (two-parent) families (∼68%) and families in which parents live separately (∼32%). Analytical approach We analyze the impact of the COVID-19 pandemic on children’s learning using two statistical approaches. These approaches and the underlying research hypotheses were pre-registered (see Supplementary material 8 J. F. BIRKELUND AND K. B. KARLSON S1). In the first approach, we estimate the overall learning loss using a linear regression model with the following specification: read = a + dT + uyear + 1 (1) is is is is where read is the reading test score for individual i in school s, T is is is an indicator for the treatment year 2021 and year is a linear trend of the is remaining years of testing. In this specification, reading test scores are standardized to percentile ranks within each grade level over the period 2017–2021 (excl. 2020). The parameter of interest, δ, thus captures the degree to which the 2021 test scores deviate (in terms of percentile points) from what would be expected from the progression in test scores in the years leading up to the pandemic (i.e. 2017–2019) (Engzell et al. 2021). A causal interpretation of the estimate is based on the assumption that in the absence of the pandemic the development of test scores would have followed the same trend as in previous years. To ensure that results are not confounded by changes in student com- position across years, we also include weights for test absenteeism (which only concerns about 4% of the tests in 2021; see Supplementary material S2), control variables for a range of family background characteristics, and school fixed effects: read = a + dT + uyear + bX + g + 1 (2) is is is is is where X is a vector that includes gender, ethnic origin, family type, is number of siblings, and parental education, employment, and income, and g are school fixed effects. We estimate Equations (1) and (2) separ- ately for each grade level (i.e. grades 2, 4, 6, and 8). We also conduct a range of robustness tests (further described in the results section), includ- ing controlling for a lagged measure of reading test performance two years prior to the measurement year to level out any cohort differences in performance. In the second approach, we examine whether the learning loss varies by family background characteristics using a difference-in-differences approach (Engzell et al. 2021). We use the panel structure of the data to analyze the progression of individual students: Dread = is grade g grade g−2 read − read , where g is grades 4, 6, or 8. In this specification is is reading test scores are standardized to percentile ranks within each grade level and year. The average progression of students is thus by definition A replication package with the full syntax is available at the Open Science Framework (DOI: 10.17605/ OSF.IO/JBKWV). EUROPEAN SOCIETIES 9 zero. Nonetheless, the progression of different social groups in the data may differ and we can thus gauge whether the gap in the relative positions between social groups has increased, remained stable, or reduced as a result of the pandemic. Thus, we estimate a number of difference-in- differences models that take the following form: Dread = a + dT + uyear + bZ + pT ∗Z + wyear ∗Z + g is is is is is is is is + 1 (3) is where Z is one of the covariates gender, ethnic origin, family type, is prior performance, parental education, parental employment, or parental income, which are entered into the model one at a time. π is the par- ameter of interest: it captures the difference in relative learning pro- gression by each of the groups captured in Z . Importantly, we also is include interaction terms between year and Z to capture any potential is is differences in pre-trends by social groups defined by the covariates. In a separate analysis, we ensure that pre-trends are sufficiently parallel between social groups, which is an important prerequisite for the causal interpretation of π (see Supplementary material S8). One advan- tage of the difference-in-differences approach is that it ensures that results are not confounded by random fluctuations in student perform- ance over time. Another advantage of this approach is that it is not biased by the month of test taking, given that we are only concerned with gaps in relative ranks or positions, not absolute learning gaps. Results Overall learning development In Figure 1, we show the development in reading test scores by standar- dizing test scores to percentile ranks within each grade level over the entire period 2015–2021 (excl. 2020). To assess the magnitude of the change in reading test scores, we compare test scores in 2021 to what would be expected from test score trajectories three years prior to the pandemic (i.e. 2017–2019), also adding controls for cohort differences in family background and school fixed effects. Figure 2 shows the esti- mated learning losses by grade level and different model specifications. The estimates denoted ‘all controls’ in Figure 2 show a learning gain of In this model, we consider covariates to be time-constant characteristics, which we measure in grade g. As pre-trends are relatively constant in all grade levels, it is of little significance for the results whether we rely on three-year or five-year pre-trend specifications. 10 J. F. BIRKELUND AND K. B. KARLSON Figure 1. Development in reading test scores by grade level. Note: Error bars indicate 95% confidence intervals. 4.8 percentile points in grade 2, 5.1 percentile points in grade 4, and 3.0 percentile points in grade 6. In grade 8, we find a learning loss of 2.8 per- centile points. In a supplementary analysis of math test scores, we find a similar pattern (see Supplementary material S4): a learning gain of 1.2 percentile points in grade 3, no development in performance in grade 6, and a learn- ing loss of 1.0 percentile points in grade 8. Although the impact of school closures thus appears to be smaller for math test scores than reading test scores, the pattern of learning loss in grade 8 and learning gains in lower grades is similar. In an additional supplementary analysis, we consider reading test scores in 2020 (see Supplementary material S5). In this year, the national tests were only conducted on a nine-percent random sample of schools. For reasons of comparability, in this analysis, we restrict our sample to these randomly sampled schools, also back in time. Reading tests were conducted mainly in May and June 2020 when schools re-opened after being closed on March 16. We find no significant development in reading test scores in grades 2, 4, or 6, suggesting that the learning gain experienced by younger pupils materialized in the period after the initial school closure in spring 2020. However, we find a learning loss of 3.5 percentile points in grade 8. Although these estimates are EUROPEAN SOCIETIES 11 Figure 2. Estimates of the 2021 learning development in reading by grade level. Note: Error bars indicate 95% confidence intervals. associated with a degree of uncertainty as a result of the smaller sample size and later month test taking, they point to that the learning loss among pupils in grade 8 was already formed after the initial school closure and did not increase substantially in the subsequent period with much longer school closures. Learning gaps by family background To examine family background gaps in learning progress, we compare the average development in reading performance for individual pupils between school years before and after the pandemic and for different sociodemographic groups using the difference-in-differences approach. Table 1 reports the results. Although we find no differences in learning progress with regard to ethnic origin, family type, or parental education, we observe some differences with regard to parental income, parental employment, gender, and prior performance. In grade 8, we find that the learning loss is greater among pupils with parents who are unem- ployed or belong to the bottom income quartile. The difference in the learning loss between having parents in the top and bottom income quar- tile is about 2 percentile points, which is a moderately sized difference given that these groups were already separated by more than 20 percentile 12 J. F. BIRKELUND AND K. B. KARLSON Table 1. Differences in the 2021 learning development in reading by sociodemographic groups. Grade (2-)4 Grade (4-)6 Grade (6-)8 Pooled Gender (ref: Girl) Boy −1.64*** −1.70*** −0.11 −1.17*** (0.50) (0.46) (0.52) (0.28) Ethnicity (ref: Danish origin) Children of immigrants 0.47 −0.82 −1.11 −0.63 (0.91) (0.91) (1.06) (0.56) Immigrants 0.70 0.87 1.53 1.13 (1.43) (1.40) (1.75) (0.88) Parental education (ref: College) Less than college 0.81 −0.15 −1.00 −0.08 (0.50) (0.46) (0.52) (0.28) Parental income (ref: Top quartile) Third quartile 1.58* −0.35 −1.02 0.10 (0.67) (0.61) (0.69) (0.38) Second quartile 2.61*** −0.19 −1.32 0.41 (0.69) (0.63) (0.70) (0.39) Bottom quartile 1.16 −0.63 −2.10** −0.47 (0.70) (0.65) (0.75) (0.40) Parental employment (ref: Both parents employed) At least one parent unemployed 0.59 −0.23 −2.28** −0.62 (0.68) (0.62) (0.71) (0.39) Family type (ref: Intact family) Non-intact family −0.07 −0.64 −0.22 −0.30 (0.55) (0.49) (0.55) (0.30) Prior performance (ref: Top quartile) Third quartile −0.72 −0.65 0.47 −0.32 (0.63) (0.58) (0.65) (0.36) Second quartile −0.62 0.33 0.20 −0.04 (0.64) (0.59) (0.67) (0.37) Bottom quartile −1.33* −1.30* −1.64* −1.41*** (0.61) (0.56) (0.64) (0.35) Note: Standard errors in parenthesis. *p < .05, **p < .01, ***p < .001. points in reading performance at the baseline in 2019 (see Supplementary material S2). In grade 4, the picture is almost the opposite, as pupils whose parents belong to the top income quartile tend to lose ground, par- ticularly to pupils whose parents belong to the second and third income quartile, suggesting that learning gaps by socioeconomic background narrowed slightly during the pandemic. In an additional analysis, we find a very similar pattern emerging already in mid-2020, suggesting that the pattern is a result of the first school closure in 2020 and did not develop considerably afterwards (see Supplementary material S5). In grades 4 and 6, we also find that boys lose about 2 percentile points in reading performance relative to girls, suggesting that the gender gap increased in 2021, as boys also trailed behind girls in reading perform- ance at the baseline in 2019. Finally, for all grade levels, we find that pupils in the bottom quartile of prior performance lost 1–2 percentile EUROPEAN SOCIETIES 13 points in reading performance relative to top-readers, suggesting a slightly increasing polarization in reading performance. Robustness tests We find that our estimates of the learning development during the COVID-19 pandemic are robust to a range of sensitivity tests. First, results are virtually unaffected by controlling for a two-year lagged measure of reading performance, suggesting that results are not affected by cohort differences in performance (see Figure 2). Second, we exploit that our data include siblings that have taken the national tests at the same grade levels but in different years. Results are robust to controlling for sibling fixed effects, further ensuring that results are not confounded by cohort differences in family background composition. Third, results are robust to excluding schools that did not participate in the national tests in each of the years 2017, 2018, 2019, 2021, which applies to only 5% of schools in 2021. Fourth, we control for month of test to take into consideration that the test in 2021 was postponed by about four school weeks on average. Results are robust to this control. Moreover, even if we factor in a four-week difference, amounting to a potential 1.5 percentage points learning gain (Azevedo et al. 2021; Engzell et al. 2021), it would not affect the overall pattern of results we report: younger children would experience a slightly smaller learning gain; older children would experience a slightly larger learning loss. Fifth, results are generally robust to changing the three-year pre-trend to a two-year pre-trend, thus comparing test scores in 2021 to the pro- jected development from 2018 to 2019. However, completely leaving out a pre-trend (comparing test scores in 2021 and 2019) changes the results markedly for grades 4 and 6, in both instances reducing the esti- mate of the learning gain. This result is due to the slightly downwards trend in reading test scores for these two grade levels between 2015 and 2019 as can be seen from Figure 1. Thus, not taking pre-trends into account will lead to underestimating the learning gain for these grade levels (Engzell et al. 2021). Sixth, we conduct a placebo analysis, meaning that we exclude the actual treatment year (2021) and, by turn, assign treatment to each of the pre-treatment years (2015–2019). Sup- plementary material S6 shows that placebo effects are very small with all 52 placebo estimates being lower than 1.5 percentile points in magni- tude and most being lower than 0.5 percentile point, documenting that the development in reading test scores was relatively stable prior to the 14 J. F. BIRKELUND AND K. B. KARLSON pandemic. Seventh, we ensure that within-individual correlations in reading test scores are similar in 2021 compared to previous years to vali- date that test scores are indeed comparable across time. Supplementary material S7 shows that these correlations hover around 0.70 in all grade levels and years, indicating that even though the adaptive tests are not exactly the same across time, they consistently measure the same underlying construct each year. Discussion In this study, we document the effects of school closures prompted by the COVID-19 pandemic on children’s reading performance in mid-2021 – more than one year into the pandemic in Denmark – and find little evi- dence of a major learning slide. Still, among older pupils in grade 8, we find a decrease in reading performance of about 3 percentile points, corre- sponding to seven weeks of lost learning using the World Bank benchmark for yearly learning progress (Azevedo et al. 2021; Engzell et al. 2021). This provides some evidence that long school closures may have a detrimental effect on children’s learning, as pupils in grade 8 were exposed to 22 school weeks of distance learning compared to only eight weeks among pupils in grades 2 and 4 among whom we do not observe any learning loss. Contrary to this pattern, we do not observe a learning loss among pupils in grade 6, who were similarly exposed to distance learning as were pupils in grade 8. A German time-use study points to that decreases in daily learning time during the pandemic were larger among older chil- dren and that secondary school pupils replaced learning time with detri- mental activities such as social media and gaming (Grewenig et al. 2021). One explanation for the difference in results between pupils in grades 6 and 8 may thus be that lower secondary school pupils (grade 8) were given more autonomy by parents and teachers during home schooling with negative externalities for their learning. Still, we are unable to further examine this puzzling result with the available data. Our finding of no major learning slide means that Denmark stands out in international comparison (Betthäuser et al. 2022). Is the finding due to our 14 months perspective, national responses, or the way we measure learning? We propose that particularly the first two explanations each carry some weight. First, we find that the learning loss among pupils in grade 8 materialized already two months into the pandemic in mid- 2020. Between 2020 and 2021, we observe a stable or positive develop- ment in learning for all grade levels. This finding lends some support EUROPEAN SOCIETIES 15 to the explanation that schools, teachers, and pupils were better prepared for and have adjusted to the online learning format in the second round of school closures (Qvortrup et al. 2021). Second, to explain the remarkable learning gain we observe among younger pupils in Denmark, some national response must be emphasized beyond the fact that these pupils were exposed to shorter durations of dis- tance learning. To minimize the spread of the virus and also to increase student well-being, the youngest children were taught by few, familiar teachers when they returned to school (The Danish Evaluation Institute 2021). This setup often resulted in most or all subjects being covered by the Danish teacher, who may have favored reading over other subjects. During the time when older students were still being taught from home, most teachers also reported to have made use of the additional space to divide classrooms into smaller groups, bringing extra teacher resources or substitute teachers into play (The Danish Evaluation Insti- tute 2021). This extra provision of resources may have contributed posi- tively to younger students’ learning development. Third, the negative influence of school disruptions may generally be smaller for reading than other subjects that are more dependent on formal instruction, for example, math. A systematic review and meta- analysis find that the impact of the COVID-19 pandemic is larger for math than reading (Betthäuser et al. 2022). Nonetheless, our supplemen- tary analysis of math test scores shows a similar pattern of results to reading with a minor learning gain among younger pupils and a minor learning loss among older pupils, suggesting that choice of outcome measure does not explain our findings. Beyond overall trends, we find little evidence of widening learning gaps by socioeconomic origin during the pandemic for pupils in grades 2, 4, and 6. Still, we see a tendency for gaps by parental income and employment status to widen somewhat for pupils in grade 8. These pat- terns were already visible after the school closure in spring 2020, suggesting that learning gaps did not grow during subsequent school clo- sures. This result is surprising given that so much of the teaching burden was shifted to parents during school closures as parents in the absence of teachers were expected to help their children plan and structure their school days. However, although evidence points to well-educated parents being more fitto fill out this supportive role (Andrew et al. 2020; Bol 2020; Jæger and Blaabæk 2020), a recent study on Denmark did not find any influence on inequality in children’s reading activity during the pandemic (Reimer et al. 2021). Inequality in home advantage 16 J. F. BIRKELUND AND K. B. KARLSON may to some extent have been counteracted by emergency care arrange- ments in schools for children with special social or educational needs. About 5% of Danish schoolchildren made use of this scheme (Christen- sen 2021). After the first school closure, a political settlement also set aside 10 million Euros so that municipalities could apply for funding to organize summer schools, study cafés, or other initiatives targeting socially and academically disadvantaged students. These national inter- ventions, along with those directed at younger pupils, might explain why we even observe slight reductions in socioeconomic gaps among pupils in grade 2. We also find some evidence that the reading performance of low-per- forming pupils suffered more from school closures than that of high-per- forming pupils. This finding may be explained by the fact that pupils who already did well in school were the ones who benefitted the most from setting their own pace when learning from home (The Danish Evaluation Institute 2021). Nonetheless, these relative group differences are com- paratively smaller than the overall gains in reading performance that we observe among pupils in the lower grades, suggesting that the polar- izing effects of the pandemic are inconsequential. Similarly, while boys appear to be have been hampered more by the pandemic in their learning progression than girls, thus slightly increasing the gender gap in reading skills, the gender polarization is inconsequential in light of the overall gains achieved by pupils in the lower grades. In conclusion, our study shows that school closures following the COVID-19 pandemic have not resulted in any major, long-run learning slide in Denmark. Moreover, we do not see any substantial differences among children from different family backgrounds, pointing to that school closures have been largely socially neutral. While we cannot pin- point the factors responsible for reducing the severity, the evidence points to that national responses seen in Denmark have mitigated a potentially large and socially skewed learning loss. Acknowledgements We thank participants at the 2021 Meeting on Quantitative Educational Research in Denmark. Disclosure statement No potential conflict of interest was reported by the author(s). EUROPEAN SOCIETIES 17 Funding This work was supported by the Spar Nord Foundation under Grant [62635]. Notes on contributors Jesper Fels Birkelund holds a postdoc position at the Department of Sociology, Uni- versity of Copenhagen. His research centers on educational inequalities. Recent work appears in Social Forces, European Sociological Review, and British Journal of Sociology. Kristian Bernt Karlson is an Associate Professor of Sociology at the University of Copenhagen. He currently serves as an Associate Editor at Research in Social Stra- tification and Mobility. His work revolves around educational stratification, social mobility and quantitative methods. Recent work appears in Sociological Methods & Research, Sociological Science, and British Journal of Sociology. Ethics statement This study complies with the General Data Protection Regulation (Regu- lation (EU) 2016/679), the regulations of the Danish Data Protection Agency, the regulations of Statistics Denmark, the Danish Compulsory School Act (Bekendtgørelse af lov om folkeskolen), and The European Code of Conduct for Research Integrity for storing and processing data and conducting research involving Danish citizens, including minors. Because The Faculty of Social Sciences’ Research Ethics Committee (IRB) at the University of Copenhagen (https://socialsciences.ku.dk/research/ ethic-committee/) only conducts ethical reviews for funding bodies specifi- cally requiring an ethical review, this committee cannot conduct an ethical review for the current study (given that it is not required by the funding body nor by Danish law). Moreover, following the General Data Protection Regulation (Regulation (EU) 2016/679), the regulations of the Danish Data Protection Agency, and the regulations of Statistics Denmark, participant consent is not required for analyzing and reporting on administrative reg- ister data on Danish citizens, including minors. As our study relies only on administrative register data, and we have stored and processed them according to the regulations, we have not obtained participant consent. Data availability statement Administrative register data are maintained by Statistics Denmark and can only be accessed remotely from within Danish universities and research institutions. If a researcher at a university or other research institution outside Denmark wishes to 18 J. F. BIRKELUND AND K. B. KARLSON use these data, this may be accomplished by visiting a Danish research institution or by cooperating with researchers or research assistants working in Denmark. National test score data can be coupled with register data via a separate application to The National Agency for IT and Learning under the Ministry of Children and Education. ORCID Jesper Fels Birkelund http://orcid.org/0000-0002-2375-9832 Kristian Bernt Karlson http://orcid.org/0000-0002-5886-2127 References Alexander, K. L., Entwisle, D. R. and Olson, L. S. (2007) ‘Lasting consequences of the summer learning gap’, American Sociological Review 72(2): 167-80. Andrew, A., Cattan, S., Costa Dias, M., Farquharson, C., Kraftman, L., Krutikova, S., Phimister, A. and Sevilla, A. (2020) ‘Inequalities in children’s experiences of home learning during the COVID-19 lockdown in England’, Fiscal Studies 41(3): 653-83. Azevedo, J. P., Hasan, A., Goldemberg, D., Geven, K. and Iqbal, S. A. (2021) ‘Simulating the potential impacts of COVID-19 school closures on schooling and learning outcomes: a set of global estimates’, The World Bank Research Observer 36(1): 1-40. Betthäuser, B. A., Bach-Mortensen, A. and Engzell, P. (2022) ‘A systematic review and meta-analysis of the impact of the COVID-19 pandemic on learning’, SocArXiv Working Paper. doi:10.31235/osf.io/g2wuy. Beuchert, L. V. and Nandrup, A. B. (2018) ‘The Danish National Tests at a Glance’, Nationaløkonomisk Tidsskrift 2018(2): 1-37. Blainey, K., Hiorns, C. and Hannay, T. (2020) The impact of lockdown on children’s education: a nationwide analysis. RS Assessment from Hodder Education. Available from: https://www.risingstars-uk.com/media/Rising-Stars/Assessment/ Whitepapers/RS_Assessment_white_paper_1.pdf. Bol, T. (2020) ‘Inequality in homeschooling during the Corona crisis in the Netherlands. First results from the LISS Panel’, SocArXiv Working Paper. doi:10. 31235/osf.io/hf32q. Christensen, E. B. (2021) Kommunerne yder stor indsats over for udsatte skoleelever [The municipalities make great efforts towards disadvantaged pupils]. The National Association of Municipalities. Available from: https://www.kl.dk/ forsidenyheder/2021/februar/kommunerne-yder-stor-indsats-over-for-udsatte- skoleelever. Clark, A. E., Nong, H., Zhu, H. and Zhu, R. (2021) ‘Compensating for academic loss: online learning and student performance during the COVID-19 pandemic’, China Economic Review 68: 101629. Contini, D., Di Tommaso, M. L., Muratori, C., Piazzalunga, D. and Schiavon, L. (2021) The COVID-19 Pandemic and School Closure: Learning Loss in EUROPEAN SOCIETIES 19 Mathematics in Primary Education, Bonn: IZA Institute of Labor Economics. IZA Discussion Paper 14785. Cooper, H., Nye, B., Charlton, K., Lindsay, J. and Greathouse, S. (1996) ‘The effects of summer vacation on achievement test scores: A narrative and meta-analytic review’, Review of Educational Research 66(3): 227-68. The Danish Evaluation Institute (2021) Grundskolers erfaringer med nødundervisning under Covid-19 pandemien [Primary schools’ experiences with emergency edu- cation during the Covid-19 pandemic]. Danmarks Evalueringsinstitut. Available from: https://www.eva.dk/grundskole/grundskolers-erfaringer-noedundervisni ng-under-covid-19-pandemien. Depping, D., Lücken, M., Musekamp, F. and Thonke, F. (2021) ‘kompetenzstände Hamburger Schüler*innen vor und während der Corona-Pandemie’,inD. Fickermann and B. Edelstein (eds.), Schule während der Corona-Pandemie. Neue Ergebnisse und Überblick über ein dynamisches Forschungsfeld, Münster: Waxmann, pp. 51-79. Domina, T., Renzulli, L., Murray, B., Garza, A. N. and Perez, L. (2021) ‘Remote or removed: predicting successful engagement with online learning during COVID-19’, Socius 7: 2378023120988200. Downey, D. B., Von Hippel, P. T. and Broh, B. A. (2004) ‘Are schools the great equal- izer? cognitive inequality during the summer months and the school year’, American Sociological Review 69(5): 613-35. Engzell, P., Frey, A. and Verhagen, M. D. (2021) ‘Learning loss due to school closures during the COVID-19 pandemic’, Proceedings of the National Academy of Sciences 118(17): e2022376118. European Commission (2020) Digital economy and society index (DESI) 2020. Thematic Chapters. Available from: https://digital-strategy.ec.europa.eu/en/ policies/desi. Gambi, L. and De Witte, K. (2021) The resiliency of school outcomes after the COVID- 19 pandemic. Standardised test scores and inequality one year after long term school closures. KU Leuven Discussion Paper Series DPS21.12. Available from: https:// feb.kuleuven.be/research/economics/ces/documents/DPS/DPS2021/dps%202112. pdf. Gore, J., Fray, L., Miller, A., Harris, J. and Taggart, W. (2021) ‘The impact of COVID- 19 on student learning in New South Wales primary schools: an empirical study’, The Australian Educational Researcher 48: 605-37. Goudeau, S., Sanrey, C., Stanczak, A., Manstead, A. and Darnon, C. (2021) ‘Why lockdown and distance learning during the COVID-19 pandemic are likely to increase the social class achievement gap’, Nature Human Behaviour 5: 1273-81. Grätz, M. and Lipps, O. (2021) ‘Large loss in studying time during the closure of schools in Switzerland in 2020’, Research in Social Stratification and Mobility 71: 100554. Grewenig, E., Lergetporer, P., Werner, K., Woessmann, L. and Zierow, L. (2021) ‘COVID-19 and educational inequality: How school closures affect low-and high-achieving students’, European Economic Review 140: 103920. Haelermans, C., van der Velden, R., Aarts, B., Bijlsma, I., Jacobs, M., Smeets, C., van Vugt, L. and van Wetten, S. (2021) Balans na anderhalf jaar: Vertraging leergroei 20 J. F. BIRKELUND AND K. B. KARLSON het grootst voor rekenen-wiskunde. NCO Factsheet No. 8. Available from: https:// www.nationaalcohortonderzoek.nl/sites/nco/files/media-files/factsheet08_nco_ algemeen_0.pdf. Hammerstein, S., König, C., Dreisörner, T. and Frey, A. (2021) ‘Effects of COVID- 19-related school closures on student achievement – a systematic Review’, Frontiers in Psychology 12: 746289. Jæger, M. M. and Blaabæk, E. H. (2020) ’Inequality in learning opportunities during Covid-19: evidence from library takeout’, Research in Social Stratification and Mobility 68: 100524. Kogan, V. and Lavertu, S. (2021) The COVID-19 pandemic and student achievement on Ohio’s third-grade English language arts assessment. Online Report. Available from: http://glenn.osu.edu/educational-governance/reports/reports-attributes/ ODE_ThirdGradeELA_KL_1-27-2021.pdf. Kuhfeld, M., Ruzek, E., Johnson, A., Tarasawa, B. and Lewis, K. (2020) Technical appendix for: learning during COVID-19: initial findings on students’ reading and math achievement and growth. NWEA. Available from: https://www.nwea. org/research/publication/technical-appendix-for-learning-during-covid-19- initial-findings-on-students-reading-and-math-achievement-and-growth. Lareau, A. (2000) Home Advantage: Social Class and Parental Intervention in Elementary Education, Lanham: Rowman & Littlefield Publishers. Lareau, A. and Calarco, J. M. (2012) ‘Class, cultural capital, and institutions: the case of families and Schools’, in S. Fiske and H. R. Markus (eds.), Facing Social Class: How Societal Rank Influences Interaction, New York: Russel Sage Foundation, pp. 61-86. Loades, M. E., Chatburn, E., Higson-Sweeney, N., Reynolds, S., Shafran, R., Brigden, A., Linney, C., McManus, M. N., Borwick, C. and Crawley, E. (2020) ‘Rapid sys- tematic review: the impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19’, Journal of the American Academy of Child & Adolescent Psychiatry 59(11): 1218-39. Maldonado, J. E. and De Witte, K. (2022) ‘The effect of school closures on standar- dised student test outcomes’, British Educational Research Journal 48(1): 49-94. Meeter, M. (2021) ‘Primary school mathematics during the COVID-19 pandemic: No evidence of learning gaps in adaptive practicing results’, Trends in Neuroscience and Education 25: 100163. OECD (2021) The State of Global Education: 18 Months Into the Pandemic, Paris: OECD Publishing. doi:10.1787/1a23bb23-en. Pier, L., Christian, M., Tymeson, H. and Meyer, R. H. (2021) COVID-19 impacts on student learning: evidence from interim assessments in California. Policy Analysis for California Education. Available from: https://edpolicyinca.org/publications/ covid-19-impacts-student-learning. Qvortrup, L., Christensen, J. H. and Wistoft, K. (2021) Skolenedlukninger i Århus Kommune under corona-pandemien i et elev- og forældreperspektiv: En sammenlign- ing mellem foråret 2020 og vinteren 2021 [School closures in Aarhus Municipality during the corona pandemic in a pupil and parent perspective: a comparison of spring 2020 and winter 2021]. DPU, Aarhus Universitet. Available from: https:// EUROPEAN SOCIETIES 21 ncs.au.dk/fileadmin/NCS/Projekter/Noedundervisning_under_corona-krisen/ Corona-rapport_skoler_AArhus_Kommune_2020_2021.pdf. Reimer, D., Smith, E., Andersen, I. G. and Sortkær, B. (2021) ‘What happens when schools shut down? investigating inequality in students’ reading behavior during Covid-19 in Denmark’, Research in Social Stratification and Mobility 71: 100568. Rose, S., Twist, L., Lord, P., Rutt, S., Badr, K., Hope, C. and Styles, B. (2021) Impact of school closures and subsequent support strategies on attainment and socio- emotional wellbeing in Key Stage 1: Interim Paper 1. National Foundation for Educational Research, London. Available from: https://www.nfer.ac.uk/impact- of-school-closures-and-subsequent-support-strategies-on-attainment-and-socio- emotional-wellbeing. Schult, J., Mahler, N., Fauth, B. and Lindner, M. A. (2022) ‘Did students learn less during the COVID-19 pandemic? reading and mathematics competencies before and after the first pandemic wave’, School Effectiveness and School Improvement. doi:10.1080/09243453.2022.2061014. Spitzer, M. W. H. and Musslick, S. (2021) ‘Academic performance of K-12 students in an online-learning environment for mathematics increased during the shut- down of schools in wake of the COVID-19 pandemic’, PLoS One 16(8): e0255629. Tomasik, M. J., Helbling, L. A. and Moser, U. (2021) ‘Educational gains of in-person vs. distance learning in primary and secondary schools: a natural experiment during the COVID-19 pandemic school closures in Switzerland’, International Journal of Psychology 56(4): 566-76. van der Velde, M., Sense, F., Spijkers, R., Meeter, M. and van Rijn, H. (2021) ‘Lockdown learning: changes in online study activity and performance of Dutch secondary school students during the COVID-19 pandemic’, PsyArXiv Working Paper. doi:10.31234/osf.io/fr2v8. von Hippel, P. T., Workman, J. and Downey, D. B. (2018) ‘Inequality in reading and math skills forms mainly before kindergarten: a replication, and partial correction, of ‘Are schools the great equalizer?’’, Sociology of Education 91(4): 323-57. Werner, K. and Woessmann, L. (2021) The Legacy of Covid-19 in Education, Munich: CESifo. CESifo Working Paper 9358. Zierer, K. (2021) ‘Effects of pandemic-related school closures on pupils’ performance and learning in selected countries: a rapid Review’, Education Sciences 11(6): 252. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png European Societies Taylor & Francis

No evidence of a major learning slide 14 months into the COVID-19 pandemic in Denmark

European Societies , Volume 25 (3): 21 – May 27, 2023

Loading next page...
 
/lp/taylor-francis/no-evidence-of-a-major-learning-slide-14-months-into-the-covid-19-sUhW5b1AbO

References (48)

Publisher
Taylor & Francis
Copyright
© 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group
ISSN
1461-6696
eISSN
1469-8307
DOI
10.1080/14616696.2022.2129085
Publisher site
See Article on Publisher Site

Abstract

EUROPEAN SOCIETIES https://doi.org/10.1080/14616696.2022.2129085 No evidence of a major learning slide 14 months into the COVID-19 pandemic in Denmark Jesper Fels Birkelund and Kristian Bernt Karlson Department of Sociology, University of Copenhagen, Copenhagen, Denmark ABSTRACT We study the effects of the COVID-19 pandemic on children’sacademic performance in Denmark 14 months into the pandemic using nationwide and exceptionally rich data on reading test scores and family background (N ≈ 200,000 per year). We find no evidence of a major learning loss. While pupils in grade 8 experienced a three percentile points loss in reading performance, pupils in grades 2 and 4 experienced a learning gain of about five percentile points, possibly resulting from school closures being significantly longer among older (22 weeks) than younger children (eight weeks). Importantly and in contrast to pre-registered expectations, we find little evidence of widening learning gaps by family background. Further analyses point to that all of these patterns were already in place a few months into pandemic, suggesting that learning gaps did not widen during subsequent, longer school closures. We also find some indication that boys and low-performing pupils suffered more from school closures than girls and high-performing pupils, but these differences are minor. We discuss which political measures may have been instrumental for overcoming the COVID-19 learning slide in Denmark. ARTICLE HISTORY Received 1 June 2022; Accepted 22 September 2022 Edited by Patrick Präg KEYWORDS COVID-19; school closures; learning; reading; social inequality Introduction The prolonged nature of the COVID-19 pandemic with several months of school closures has left policymakers and educators concerned about potential long-term consequences for children’s learning. Although research shows evidence of a short-term learning loss (Hammerstein et al. 2021; Zierer 2021), less is known about the consequences for learning CONTACT Jesper Fels Birkelund jfb@soc.ku.dk Department of Sociology, University of Copen- hagen, Oester Farimagsgade 5, Building 16, Copenhagen DK-1353, Denmark Supplemental data for this article can be accessed online at 10.1080/14616696.2022.2129085. © 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http:// creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. 2 J. F. BIRKELUND AND K. B. KARLSON and how they differ by family background more than one year into the pan- demic. The few studies that have examined the impact on learning beyond the first year of the pandemic generally report persistent, although not increasing learning deficits (Betthäuser et al. 2022). We contribute to this literature by examining whether school closures in Denmark have led to a learning loss among children about 14 months into the pandemic. Distance learning has been criticized for being less effective than the face-to-face instruction that it has replaced during the pandemic, and the learning transition has in many places been hampered by lack of stable internet connectivity and availability of necessary digital tools (Domina et al. 2021; Grätz and Lipps 2021; Grewenig et al. 2021). A further concern has been that prolonged periods of social isolation may have worsened student engagement in school (Loades et al. 2020). Indeed, early studies on the effects of school closures in spring 2020 docu- ment a substantial learning loss. In a study on the Netherlands, Engzell et al.(2021) draw on longitudinal test score data on 350,000 pupils aged 8–11 and find an average learning loss of 3 percentile points, correspond- ing to eight weeks of lost learning, the same number of weeks that schools were closed. This result implies that ‘students made little or no progress while learning from home’ (Engzell et al. 2021, p. 1). Other studies relying on longitudinal data on standardized tests find learning losses of similar magnitude in China (Clark et al. 2021), Italy (Contini et al. 2021), and the United States (Kuhfeld et al. 2020; Pier et al. 2021). Studies relying on cross-sectional comparisons generally find similar results (Blainey et al. 2020; Kogan and Lavertu 2021; Maldonado and De Witte 2022; Rose et al. 2021; Schult et al. 2022), although some find little or mixed evidence of a learning loss (Gore et al. 2021; Depping et al. 2021). However, cross-sectional data do not allow for proper analysis of biases from cohort effects or non-participation, both of which may have been substantial during the pandemic (Werner and Woessmann 2021). Studies with access to individual-level data on family background gen- erally find a social gradient in the learning loss (Engzell 2021;Pier et al. 2021), although Contini et al.(2021) find a social gradient for high-per- forming students only. For instance, Engzell et al.(2021) find the learning loss to be 50% larger among children whose parents do not have upper sec- ondary schooling compared to children with at least one parent who does. These results echo what we know from the well-established social science literature on the ‘summer learning loss’: disadvantaged children are those who suffer most from the learning break during the summer months when there is no formal schooling (Cooper et al. 1996; Downey et al. 2004; EUROPEAN SOCIETIES 3 Alexander et al. 2007; von Hippel et al. 2018). As the structured learning environment of schools is replaced by home schooling, parents’ resources are expected to play a very significant role for how children are able to keep up. Perhaps most importantly for the COVID-19 situation, advantaged parents are likely to have the economic and cultural resources to not only provide stimulating and structured learning environments but also to de-code and translate instructions sent from teachers (Goudeau et al. 2021;Lareau 2000; Lareau and Calarco 2012). Beyond these early findings, we know very little about the lasting effects of school closures. Yet, such knowledge is important, as there is no reason to expect that the initial learning loss can be extrapolated lin- early to the substantially longer closure experiences that have followed in most countries (Werner and Woessmann 2021). In contrast, as schools and teachers have had time to develop active online teaching methods and students have had the opportunity to adapt to them, weekly losses are likely to have been reduced (i.e. pupils’ learning progression would approach their pre-pandemic one). Preliminary findings from Belgium and the Netherlands indicate that the learning loss may indeed have halted during subsequent school closures (Gambi and De Witte 2021; Haelermans et al. 2021). Moreover, a number of studies suggest that stu- dents’ performance in online-learning environments has generally increased during the pandemic (Meeter 2021; Spitzer and Musslick 2021; Tomasik et al. 2021; van der Velde 2021). From March 2020 throughout May 2021, Denmark experienced two lengthy periods of nationwide school closures in response to the COVID-19 pandemic, which lasted for a total of 22 school weeks or more than half a school year – slightly more than the OECD average (OECD 2021). Denmark thus provides an interesting context for study- ing the effects of school closures by being a country with relatively long-lasting closures, while having otherwise good preconditions for handling the educational disruption. The transition to distance learning was made relatively smooth by the reliable digital infrastructure with Denmark being one of the absolute top-scorers in digital skills, broad- band connectivity, and digital public services in Europe (European Com- mission 2020). Schools were better prepared for the second and longer school closure (Qvortrup et al. 2021) and received financial help from a political settlement, which allocated 35 million Euros towards extra teaching and student well-being efforts in the first half of 2021. The Danish response thus presents a potential best-case scenario for limiting the negative impact of school closures on students’ learning. 4 J. F. BIRKELUND AND K. B. KARLSON Our study evaluates the effects of school closures prompted by the COVID-19 pandemic on children’s academic performance more than one year into the pandemic. For this purpose, we use nationwide standar- dized reading test data on Danish public school pupils with very little attrition and very detailed and highly reliable information on family background. Controlling for cohort differences in family background and prior performance, we compare test scores from mid-2021 to what would be expected from test score trajectories in the years prior to the pandemic (i.e. 2017–2019). To examine family background gaps in the learning loss, we use a difference-in-differences approach to compare the average development in reading performance for individual pupils between school years (e.g. between grades 4 and 6) before and after the pandemic and for different social groups defined by gender, ethnicity, family type, prior performance, and parental education, income, and/or employment. These approaches and the underlying research hypotheses were pre-registered (see Supplementary material S1). The empirical results show no evidence of any major learning slide in Denmark. Only among the oldest pupils in grade 8 (age 14) do we find a decrease in reading performance of about 3 percentile points. The youngest pupils, particularly those in grades 2 and 4 (aged 8 and 10), even show a learning gain of about 5 percentile points. However, these pupils are also those least affected by school closures with only about eight weeks of dis- tance learning compared to 22 weeksamong pupils in grades 6 and 8. Impor- tantly, we find only little evidence of widening learning gaps by socioeconomic origin. Still, in grade 8 we see a tendency for gaps by parental income and employment to widen slightly. Nonetheless, these patterns were already in place after the initial lockdown in spring 2020, suggesting that learning gaps did not widen during the subsequent year in which most of the total lockdown period occurred. Finally, we find some indication that boys and low-performing pupils suffered more from school closures than girls and high-performing pupils, but these differences are relatively small. We conclude the paper with a discussion of which measures to coun- teract learning losses in Denmark may explain the findings we report. Materials and methods Study setting Danish schools were closed down twice in response to the COVID-19 pandemic. The first school closure started 16 March 2020 and lasted EUROPEAN SOCIETIES 5 for eight school weeks. The second school closure was initiated in response to rising infection rates on 21 December 2020 and was signifi- cantly longer than the first shutdown, lasting for 14 school weeks. Only the oldest pupils in grades 6–8 were exposed to the full 22 school weeks of distance learning, which amounts to half of the total number of school weeks between 16 March 2020 and 6 May 2021. Younger pupils in grades 0–4 were allowed back in school early on both occasions and were exposed to distance learning for a total of eight school weeks. In addition to these nationwide school closures, there have been numerous local school closures in areas with high infection rates, meaning that 22 (8) weeks of distance learning is the minimum period of exposure. A teacher survey from the first school closure in spring 2020 shows that the vast majority of older pupils’ lessons were successfully replaced by live classroom teaching using video conferencing software such as Skype or Microsoft Teams (The Danish Evaluation Institute 2021). Among the younger pupils, however, particularly those in grades 1–3, this type of online classroom teaching was rare, whereas it was used by about half of teachers in grades 4–6. Younger pupils instead regularly received written instructions from teachers about which distributed assignments they should work on at home, if possible with help from parents. Older pupils in grades 5–9 were surveyed during both school clo- sures and experienced that distance teaching had become more struc- tured and varied and teachers more accessible in the second school closure (Qvortrup et al. 2021). However, pupils also experienced school work during the lockdown as lonely, repetitive, and less instructive than normal classroom teaching in which pupils usually are asked to work together in pairs or groups (The Danish Evaluation Institute 2021). Still, about one-third of pupils reported to have been more motiv- ated to study during lockdown with fewer disturbances and more oppor- tunity to concentrate as primary explanations. Data The analysis was conducted using Danish national test score data made available by The National Agency for IT and Learning (Styrelsen for IT og Læring) under the Ministry of Children and Education. The dataset contains results from standardized tests in reading conducted yearly between 2015 and 2021 among all Danish public school pupils in grades 2, 4, 6, and 8 (i.e. ages 8, 10, 12, and 14). Given that we work with administrative data, our sample covers the vast majority of 6 J. F. BIRKELUND AND K. B. KARLSON schoolchildren in a given grade in a given year, meaning that we have available total population data (N ≈ 200,000 per year). To ensure compar- ability of student cohorts, we exclude test score data from 2020 in the main analysis, as 2020 stands out as being the only test year where not the full student population was tested; instead, a nine-percent random sample of schools was issued. In an additional analysis, we examine the impact on learning in 2020 by studying this subsample of schools. We link the national test score data to the population-wide adminis- trative registers at Statistics Denmark via personal identification numbers. From these registers, we obtain complete and highly reliable information on gender, ethnic origin, family type, number of siblings, and parental education, employment, and income. Test scores Our main dependent variable is the Danish national test scores in reading. The test is conducted each year among all Danish public school pupils in grades 2, 4, 6, and 8. It is carried out at school using an online, self-scoring, and adaptive program that taps into three cogni- tive domains of language comprehension, decoding, and reading com- prehension. Reading test questions involve, for example, word-to- picture matching, word splitting, or reading a text and answering content-related questions. The adaptive nature of the test means that the difficulty level of questions continuously adapts to the test subject’s demonstrated ability level with the online test system drawing questions from the same large national item bank ensuring that test scores are com- parable across schools and test years within school grades (Beuchert and Nandrup 2018). Test scores are, however, not comparable across school grades, meaning that we cannot measure an individual’s reading pro- gression between, for example, grades 4–6. Still, we can measure pro- gression in an individual’s relative reading rank and thus also any gaps in the relative progression of social groups defined by gender, ethnicity, or parents’ socioeconomic resources. In all previous years (2015–2019), the majority of pupils has been tested in the month of April. However, in 2021 the majority took the In the adaptive testing, the pupil answers questions of varying difficulty based on a continuous assess- ment of the pupil’s latent ability in the domain. The final score is derived using Rasch scaling, called the estimated pupil ability level, and is presented on a logit scale ranging from −7 through 7 (Beuchert and Nandrup 2018: 5). In contrast to linear testing, pupils are not answering all questions in the test, but only those at the pupil’s approximate skill level. EUROPEAN SOCIETIES 7 test in May, when schools began re-opening (see Supplementary material S2). Thus the test taking is separated by about four school weeks, amounting to a potential 1.5 percentage points learning gain according to the World Bank benchmark for yearly learning progress (Azevedo et al. 2021; Engzell et al. 2021), which could affect the estimated learning loss. We deal with this data feature in two ways. First, we present esti- mates for which we control for month of test, which is possible due to sufficient variation in month of test in all years. Second, we bound our estimates in light of this potential bias. Both auxiliary analyses show that timing of the test does not alter any of the key conclusions we present. The Danish national test data also include a yearly standardized math test in grades 3, 6, and 8. However, data is only available for years 2016– 2021 for grade 3 and years 2018–2021 for grades 6 and 8. Because of the limited measurement period, we only use the math test data to check the robustness of our main results based on the reading test data. Independent variables Independent variables include parental education, employment, and income as well as gender, ethnic origin, family type, and number of sib- lings (see Supplementary material S2). Our measure of parental edu- cation distinguishes between at least one parent holding a college degree (∼48%) and both parents with less than a college degree (∼52%). Our measure of parental employment distinguishes between both parents being employed (∼82%) and at least one parent being unemployed (∼18%), defined as receiving unemployment benefits, cash assistance, or disability pension. Parental income is measured as parents’ total disposable income from wage employment, self-employ- ment, and public transfers after tax, coded into quartiles. Our measure of ethnic origin distinguishes between children of Danish origin (∼89%), children of immigrants (∼8%), and immigrants (∼4%). Our measure of family type distinguishes between intact (two-parent) families (∼68%) and families in which parents live separately (∼32%). Analytical approach We analyze the impact of the COVID-19 pandemic on children’s learning using two statistical approaches. These approaches and the underlying research hypotheses were pre-registered (see Supplementary material 8 J. F. BIRKELUND AND K. B. KARLSON S1). In the first approach, we estimate the overall learning loss using a linear regression model with the following specification: read = a + dT + uyear + 1 (1) is is is is where read is the reading test score for individual i in school s, T is is is an indicator for the treatment year 2021 and year is a linear trend of the is remaining years of testing. In this specification, reading test scores are standardized to percentile ranks within each grade level over the period 2017–2021 (excl. 2020). The parameter of interest, δ, thus captures the degree to which the 2021 test scores deviate (in terms of percentile points) from what would be expected from the progression in test scores in the years leading up to the pandemic (i.e. 2017–2019) (Engzell et al. 2021). A causal interpretation of the estimate is based on the assumption that in the absence of the pandemic the development of test scores would have followed the same trend as in previous years. To ensure that results are not confounded by changes in student com- position across years, we also include weights for test absenteeism (which only concerns about 4% of the tests in 2021; see Supplementary material S2), control variables for a range of family background characteristics, and school fixed effects: read = a + dT + uyear + bX + g + 1 (2) is is is is is where X is a vector that includes gender, ethnic origin, family type, is number of siblings, and parental education, employment, and income, and g are school fixed effects. We estimate Equations (1) and (2) separ- ately for each grade level (i.e. grades 2, 4, 6, and 8). We also conduct a range of robustness tests (further described in the results section), includ- ing controlling for a lagged measure of reading test performance two years prior to the measurement year to level out any cohort differences in performance. In the second approach, we examine whether the learning loss varies by family background characteristics using a difference-in-differences approach (Engzell et al. 2021). We use the panel structure of the data to analyze the progression of individual students: Dread = is grade g grade g−2 read − read , where g is grades 4, 6, or 8. In this specification is is reading test scores are standardized to percentile ranks within each grade level and year. The average progression of students is thus by definition A replication package with the full syntax is available at the Open Science Framework (DOI: 10.17605/ OSF.IO/JBKWV). EUROPEAN SOCIETIES 9 zero. Nonetheless, the progression of different social groups in the data may differ and we can thus gauge whether the gap in the relative positions between social groups has increased, remained stable, or reduced as a result of the pandemic. Thus, we estimate a number of difference-in- differences models that take the following form: Dread = a + dT + uyear + bZ + pT ∗Z + wyear ∗Z + g is is is is is is is is + 1 (3) is where Z is one of the covariates gender, ethnic origin, family type, is prior performance, parental education, parental employment, or parental income, which are entered into the model one at a time. π is the par- ameter of interest: it captures the difference in relative learning pro- gression by each of the groups captured in Z . Importantly, we also is include interaction terms between year and Z to capture any potential is is differences in pre-trends by social groups defined by the covariates. In a separate analysis, we ensure that pre-trends are sufficiently parallel between social groups, which is an important prerequisite for the causal interpretation of π (see Supplementary material S8). One advan- tage of the difference-in-differences approach is that it ensures that results are not confounded by random fluctuations in student perform- ance over time. Another advantage of this approach is that it is not biased by the month of test taking, given that we are only concerned with gaps in relative ranks or positions, not absolute learning gaps. Results Overall learning development In Figure 1, we show the development in reading test scores by standar- dizing test scores to percentile ranks within each grade level over the entire period 2015–2021 (excl. 2020). To assess the magnitude of the change in reading test scores, we compare test scores in 2021 to what would be expected from test score trajectories three years prior to the pandemic (i.e. 2017–2019), also adding controls for cohort differences in family background and school fixed effects. Figure 2 shows the esti- mated learning losses by grade level and different model specifications. The estimates denoted ‘all controls’ in Figure 2 show a learning gain of In this model, we consider covariates to be time-constant characteristics, which we measure in grade g. As pre-trends are relatively constant in all grade levels, it is of little significance for the results whether we rely on three-year or five-year pre-trend specifications. 10 J. F. BIRKELUND AND K. B. KARLSON Figure 1. Development in reading test scores by grade level. Note: Error bars indicate 95% confidence intervals. 4.8 percentile points in grade 2, 5.1 percentile points in grade 4, and 3.0 percentile points in grade 6. In grade 8, we find a learning loss of 2.8 per- centile points. In a supplementary analysis of math test scores, we find a similar pattern (see Supplementary material S4): a learning gain of 1.2 percentile points in grade 3, no development in performance in grade 6, and a learn- ing loss of 1.0 percentile points in grade 8. Although the impact of school closures thus appears to be smaller for math test scores than reading test scores, the pattern of learning loss in grade 8 and learning gains in lower grades is similar. In an additional supplementary analysis, we consider reading test scores in 2020 (see Supplementary material S5). In this year, the national tests were only conducted on a nine-percent random sample of schools. For reasons of comparability, in this analysis, we restrict our sample to these randomly sampled schools, also back in time. Reading tests were conducted mainly in May and June 2020 when schools re-opened after being closed on March 16. We find no significant development in reading test scores in grades 2, 4, or 6, suggesting that the learning gain experienced by younger pupils materialized in the period after the initial school closure in spring 2020. However, we find a learning loss of 3.5 percentile points in grade 8. Although these estimates are EUROPEAN SOCIETIES 11 Figure 2. Estimates of the 2021 learning development in reading by grade level. Note: Error bars indicate 95% confidence intervals. associated with a degree of uncertainty as a result of the smaller sample size and later month test taking, they point to that the learning loss among pupils in grade 8 was already formed after the initial school closure and did not increase substantially in the subsequent period with much longer school closures. Learning gaps by family background To examine family background gaps in learning progress, we compare the average development in reading performance for individual pupils between school years before and after the pandemic and for different sociodemographic groups using the difference-in-differences approach. Table 1 reports the results. Although we find no differences in learning progress with regard to ethnic origin, family type, or parental education, we observe some differences with regard to parental income, parental employment, gender, and prior performance. In grade 8, we find that the learning loss is greater among pupils with parents who are unem- ployed or belong to the bottom income quartile. The difference in the learning loss between having parents in the top and bottom income quar- tile is about 2 percentile points, which is a moderately sized difference given that these groups were already separated by more than 20 percentile 12 J. F. BIRKELUND AND K. B. KARLSON Table 1. Differences in the 2021 learning development in reading by sociodemographic groups. Grade (2-)4 Grade (4-)6 Grade (6-)8 Pooled Gender (ref: Girl) Boy −1.64*** −1.70*** −0.11 −1.17*** (0.50) (0.46) (0.52) (0.28) Ethnicity (ref: Danish origin) Children of immigrants 0.47 −0.82 −1.11 −0.63 (0.91) (0.91) (1.06) (0.56) Immigrants 0.70 0.87 1.53 1.13 (1.43) (1.40) (1.75) (0.88) Parental education (ref: College) Less than college 0.81 −0.15 −1.00 −0.08 (0.50) (0.46) (0.52) (0.28) Parental income (ref: Top quartile) Third quartile 1.58* −0.35 −1.02 0.10 (0.67) (0.61) (0.69) (0.38) Second quartile 2.61*** −0.19 −1.32 0.41 (0.69) (0.63) (0.70) (0.39) Bottom quartile 1.16 −0.63 −2.10** −0.47 (0.70) (0.65) (0.75) (0.40) Parental employment (ref: Both parents employed) At least one parent unemployed 0.59 −0.23 −2.28** −0.62 (0.68) (0.62) (0.71) (0.39) Family type (ref: Intact family) Non-intact family −0.07 −0.64 −0.22 −0.30 (0.55) (0.49) (0.55) (0.30) Prior performance (ref: Top quartile) Third quartile −0.72 −0.65 0.47 −0.32 (0.63) (0.58) (0.65) (0.36) Second quartile −0.62 0.33 0.20 −0.04 (0.64) (0.59) (0.67) (0.37) Bottom quartile −1.33* −1.30* −1.64* −1.41*** (0.61) (0.56) (0.64) (0.35) Note: Standard errors in parenthesis. *p < .05, **p < .01, ***p < .001. points in reading performance at the baseline in 2019 (see Supplementary material S2). In grade 4, the picture is almost the opposite, as pupils whose parents belong to the top income quartile tend to lose ground, par- ticularly to pupils whose parents belong to the second and third income quartile, suggesting that learning gaps by socioeconomic background narrowed slightly during the pandemic. In an additional analysis, we find a very similar pattern emerging already in mid-2020, suggesting that the pattern is a result of the first school closure in 2020 and did not develop considerably afterwards (see Supplementary material S5). In grades 4 and 6, we also find that boys lose about 2 percentile points in reading performance relative to girls, suggesting that the gender gap increased in 2021, as boys also trailed behind girls in reading perform- ance at the baseline in 2019. Finally, for all grade levels, we find that pupils in the bottom quartile of prior performance lost 1–2 percentile EUROPEAN SOCIETIES 13 points in reading performance relative to top-readers, suggesting a slightly increasing polarization in reading performance. Robustness tests We find that our estimates of the learning development during the COVID-19 pandemic are robust to a range of sensitivity tests. First, results are virtually unaffected by controlling for a two-year lagged measure of reading performance, suggesting that results are not affected by cohort differences in performance (see Figure 2). Second, we exploit that our data include siblings that have taken the national tests at the same grade levels but in different years. Results are robust to controlling for sibling fixed effects, further ensuring that results are not confounded by cohort differences in family background composition. Third, results are robust to excluding schools that did not participate in the national tests in each of the years 2017, 2018, 2019, 2021, which applies to only 5% of schools in 2021. Fourth, we control for month of test to take into consideration that the test in 2021 was postponed by about four school weeks on average. Results are robust to this control. Moreover, even if we factor in a four-week difference, amounting to a potential 1.5 percentage points learning gain (Azevedo et al. 2021; Engzell et al. 2021), it would not affect the overall pattern of results we report: younger children would experience a slightly smaller learning gain; older children would experience a slightly larger learning loss. Fifth, results are generally robust to changing the three-year pre-trend to a two-year pre-trend, thus comparing test scores in 2021 to the pro- jected development from 2018 to 2019. However, completely leaving out a pre-trend (comparing test scores in 2021 and 2019) changes the results markedly for grades 4 and 6, in both instances reducing the esti- mate of the learning gain. This result is due to the slightly downwards trend in reading test scores for these two grade levels between 2015 and 2019 as can be seen from Figure 1. Thus, not taking pre-trends into account will lead to underestimating the learning gain for these grade levels (Engzell et al. 2021). Sixth, we conduct a placebo analysis, meaning that we exclude the actual treatment year (2021) and, by turn, assign treatment to each of the pre-treatment years (2015–2019). Sup- plementary material S6 shows that placebo effects are very small with all 52 placebo estimates being lower than 1.5 percentile points in magni- tude and most being lower than 0.5 percentile point, documenting that the development in reading test scores was relatively stable prior to the 14 J. F. BIRKELUND AND K. B. KARLSON pandemic. Seventh, we ensure that within-individual correlations in reading test scores are similar in 2021 compared to previous years to vali- date that test scores are indeed comparable across time. Supplementary material S7 shows that these correlations hover around 0.70 in all grade levels and years, indicating that even though the adaptive tests are not exactly the same across time, they consistently measure the same underlying construct each year. Discussion In this study, we document the effects of school closures prompted by the COVID-19 pandemic on children’s reading performance in mid-2021 – more than one year into the pandemic in Denmark – and find little evi- dence of a major learning slide. Still, among older pupils in grade 8, we find a decrease in reading performance of about 3 percentile points, corre- sponding to seven weeks of lost learning using the World Bank benchmark for yearly learning progress (Azevedo et al. 2021; Engzell et al. 2021). This provides some evidence that long school closures may have a detrimental effect on children’s learning, as pupils in grade 8 were exposed to 22 school weeks of distance learning compared to only eight weeks among pupils in grades 2 and 4 among whom we do not observe any learning loss. Contrary to this pattern, we do not observe a learning loss among pupils in grade 6, who were similarly exposed to distance learning as were pupils in grade 8. A German time-use study points to that decreases in daily learning time during the pandemic were larger among older chil- dren and that secondary school pupils replaced learning time with detri- mental activities such as social media and gaming (Grewenig et al. 2021). One explanation for the difference in results between pupils in grades 6 and 8 may thus be that lower secondary school pupils (grade 8) were given more autonomy by parents and teachers during home schooling with negative externalities for their learning. Still, we are unable to further examine this puzzling result with the available data. Our finding of no major learning slide means that Denmark stands out in international comparison (Betthäuser et al. 2022). Is the finding due to our 14 months perspective, national responses, or the way we measure learning? We propose that particularly the first two explanations each carry some weight. First, we find that the learning loss among pupils in grade 8 materialized already two months into the pandemic in mid- 2020. Between 2020 and 2021, we observe a stable or positive develop- ment in learning for all grade levels. This finding lends some support EUROPEAN SOCIETIES 15 to the explanation that schools, teachers, and pupils were better prepared for and have adjusted to the online learning format in the second round of school closures (Qvortrup et al. 2021). Second, to explain the remarkable learning gain we observe among younger pupils in Denmark, some national response must be emphasized beyond the fact that these pupils were exposed to shorter durations of dis- tance learning. To minimize the spread of the virus and also to increase student well-being, the youngest children were taught by few, familiar teachers when they returned to school (The Danish Evaluation Institute 2021). This setup often resulted in most or all subjects being covered by the Danish teacher, who may have favored reading over other subjects. During the time when older students were still being taught from home, most teachers also reported to have made use of the additional space to divide classrooms into smaller groups, bringing extra teacher resources or substitute teachers into play (The Danish Evaluation Insti- tute 2021). This extra provision of resources may have contributed posi- tively to younger students’ learning development. Third, the negative influence of school disruptions may generally be smaller for reading than other subjects that are more dependent on formal instruction, for example, math. A systematic review and meta- analysis find that the impact of the COVID-19 pandemic is larger for math than reading (Betthäuser et al. 2022). Nonetheless, our supplemen- tary analysis of math test scores shows a similar pattern of results to reading with a minor learning gain among younger pupils and a minor learning loss among older pupils, suggesting that choice of outcome measure does not explain our findings. Beyond overall trends, we find little evidence of widening learning gaps by socioeconomic origin during the pandemic for pupils in grades 2, 4, and 6. Still, we see a tendency for gaps by parental income and employment status to widen somewhat for pupils in grade 8. These pat- terns were already visible after the school closure in spring 2020, suggesting that learning gaps did not grow during subsequent school clo- sures. This result is surprising given that so much of the teaching burden was shifted to parents during school closures as parents in the absence of teachers were expected to help their children plan and structure their school days. However, although evidence points to well-educated parents being more fitto fill out this supportive role (Andrew et al. 2020; Bol 2020; Jæger and Blaabæk 2020), a recent study on Denmark did not find any influence on inequality in children’s reading activity during the pandemic (Reimer et al. 2021). Inequality in home advantage 16 J. F. BIRKELUND AND K. B. KARLSON may to some extent have been counteracted by emergency care arrange- ments in schools for children with special social or educational needs. About 5% of Danish schoolchildren made use of this scheme (Christen- sen 2021). After the first school closure, a political settlement also set aside 10 million Euros so that municipalities could apply for funding to organize summer schools, study cafés, or other initiatives targeting socially and academically disadvantaged students. These national inter- ventions, along with those directed at younger pupils, might explain why we even observe slight reductions in socioeconomic gaps among pupils in grade 2. We also find some evidence that the reading performance of low-per- forming pupils suffered more from school closures than that of high-per- forming pupils. This finding may be explained by the fact that pupils who already did well in school were the ones who benefitted the most from setting their own pace when learning from home (The Danish Evaluation Institute 2021). Nonetheless, these relative group differences are com- paratively smaller than the overall gains in reading performance that we observe among pupils in the lower grades, suggesting that the polar- izing effects of the pandemic are inconsequential. Similarly, while boys appear to be have been hampered more by the pandemic in their learning progression than girls, thus slightly increasing the gender gap in reading skills, the gender polarization is inconsequential in light of the overall gains achieved by pupils in the lower grades. In conclusion, our study shows that school closures following the COVID-19 pandemic have not resulted in any major, long-run learning slide in Denmark. Moreover, we do not see any substantial differences among children from different family backgrounds, pointing to that school closures have been largely socially neutral. While we cannot pin- point the factors responsible for reducing the severity, the evidence points to that national responses seen in Denmark have mitigated a potentially large and socially skewed learning loss. Acknowledgements We thank participants at the 2021 Meeting on Quantitative Educational Research in Denmark. Disclosure statement No potential conflict of interest was reported by the author(s). EUROPEAN SOCIETIES 17 Funding This work was supported by the Spar Nord Foundation under Grant [62635]. Notes on contributors Jesper Fels Birkelund holds a postdoc position at the Department of Sociology, Uni- versity of Copenhagen. His research centers on educational inequalities. Recent work appears in Social Forces, European Sociological Review, and British Journal of Sociology. Kristian Bernt Karlson is an Associate Professor of Sociology at the University of Copenhagen. He currently serves as an Associate Editor at Research in Social Stra- tification and Mobility. His work revolves around educational stratification, social mobility and quantitative methods. Recent work appears in Sociological Methods & Research, Sociological Science, and British Journal of Sociology. Ethics statement This study complies with the General Data Protection Regulation (Regu- lation (EU) 2016/679), the regulations of the Danish Data Protection Agency, the regulations of Statistics Denmark, the Danish Compulsory School Act (Bekendtgørelse af lov om folkeskolen), and The European Code of Conduct for Research Integrity for storing and processing data and conducting research involving Danish citizens, including minors. Because The Faculty of Social Sciences’ Research Ethics Committee (IRB) at the University of Copenhagen (https://socialsciences.ku.dk/research/ ethic-committee/) only conducts ethical reviews for funding bodies specifi- cally requiring an ethical review, this committee cannot conduct an ethical review for the current study (given that it is not required by the funding body nor by Danish law). Moreover, following the General Data Protection Regulation (Regulation (EU) 2016/679), the regulations of the Danish Data Protection Agency, and the regulations of Statistics Denmark, participant consent is not required for analyzing and reporting on administrative reg- ister data on Danish citizens, including minors. As our study relies only on administrative register data, and we have stored and processed them according to the regulations, we have not obtained participant consent. Data availability statement Administrative register data are maintained by Statistics Denmark and can only be accessed remotely from within Danish universities and research institutions. If a researcher at a university or other research institution outside Denmark wishes to 18 J. F. BIRKELUND AND K. B. KARLSON use these data, this may be accomplished by visiting a Danish research institution or by cooperating with researchers or research assistants working in Denmark. National test score data can be coupled with register data via a separate application to The National Agency for IT and Learning under the Ministry of Children and Education. ORCID Jesper Fels Birkelund http://orcid.org/0000-0002-2375-9832 Kristian Bernt Karlson http://orcid.org/0000-0002-5886-2127 References Alexander, K. L., Entwisle, D. R. and Olson, L. S. (2007) ‘Lasting consequences of the summer learning gap’, American Sociological Review 72(2): 167-80. Andrew, A., Cattan, S., Costa Dias, M., Farquharson, C., Kraftman, L., Krutikova, S., Phimister, A. and Sevilla, A. (2020) ‘Inequalities in children’s experiences of home learning during the COVID-19 lockdown in England’, Fiscal Studies 41(3): 653-83. Azevedo, J. P., Hasan, A., Goldemberg, D., Geven, K. and Iqbal, S. A. (2021) ‘Simulating the potential impacts of COVID-19 school closures on schooling and learning outcomes: a set of global estimates’, The World Bank Research Observer 36(1): 1-40. Betthäuser, B. A., Bach-Mortensen, A. and Engzell, P. (2022) ‘A systematic review and meta-analysis of the impact of the COVID-19 pandemic on learning’, SocArXiv Working Paper. doi:10.31235/osf.io/g2wuy. Beuchert, L. V. and Nandrup, A. B. (2018) ‘The Danish National Tests at a Glance’, Nationaløkonomisk Tidsskrift 2018(2): 1-37. Blainey, K., Hiorns, C. and Hannay, T. (2020) The impact of lockdown on children’s education: a nationwide analysis. RS Assessment from Hodder Education. Available from: https://www.risingstars-uk.com/media/Rising-Stars/Assessment/ Whitepapers/RS_Assessment_white_paper_1.pdf. Bol, T. (2020) ‘Inequality in homeschooling during the Corona crisis in the Netherlands. First results from the LISS Panel’, SocArXiv Working Paper. doi:10. 31235/osf.io/hf32q. Christensen, E. B. (2021) Kommunerne yder stor indsats over for udsatte skoleelever [The municipalities make great efforts towards disadvantaged pupils]. The National Association of Municipalities. Available from: https://www.kl.dk/ forsidenyheder/2021/februar/kommunerne-yder-stor-indsats-over-for-udsatte- skoleelever. Clark, A. E., Nong, H., Zhu, H. and Zhu, R. (2021) ‘Compensating for academic loss: online learning and student performance during the COVID-19 pandemic’, China Economic Review 68: 101629. Contini, D., Di Tommaso, M. L., Muratori, C., Piazzalunga, D. and Schiavon, L. (2021) The COVID-19 Pandemic and School Closure: Learning Loss in EUROPEAN SOCIETIES 19 Mathematics in Primary Education, Bonn: IZA Institute of Labor Economics. IZA Discussion Paper 14785. Cooper, H., Nye, B., Charlton, K., Lindsay, J. and Greathouse, S. (1996) ‘The effects of summer vacation on achievement test scores: A narrative and meta-analytic review’, Review of Educational Research 66(3): 227-68. The Danish Evaluation Institute (2021) Grundskolers erfaringer med nødundervisning under Covid-19 pandemien [Primary schools’ experiences with emergency edu- cation during the Covid-19 pandemic]. Danmarks Evalueringsinstitut. Available from: https://www.eva.dk/grundskole/grundskolers-erfaringer-noedundervisni ng-under-covid-19-pandemien. Depping, D., Lücken, M., Musekamp, F. and Thonke, F. (2021) ‘kompetenzstände Hamburger Schüler*innen vor und während der Corona-Pandemie’,inD. Fickermann and B. Edelstein (eds.), Schule während der Corona-Pandemie. Neue Ergebnisse und Überblick über ein dynamisches Forschungsfeld, Münster: Waxmann, pp. 51-79. Domina, T., Renzulli, L., Murray, B., Garza, A. N. and Perez, L. (2021) ‘Remote or removed: predicting successful engagement with online learning during COVID-19’, Socius 7: 2378023120988200. Downey, D. B., Von Hippel, P. T. and Broh, B. A. (2004) ‘Are schools the great equal- izer? cognitive inequality during the summer months and the school year’, American Sociological Review 69(5): 613-35. Engzell, P., Frey, A. and Verhagen, M. D. (2021) ‘Learning loss due to school closures during the COVID-19 pandemic’, Proceedings of the National Academy of Sciences 118(17): e2022376118. European Commission (2020) Digital economy and society index (DESI) 2020. Thematic Chapters. Available from: https://digital-strategy.ec.europa.eu/en/ policies/desi. Gambi, L. and De Witte, K. (2021) The resiliency of school outcomes after the COVID- 19 pandemic. Standardised test scores and inequality one year after long term school closures. KU Leuven Discussion Paper Series DPS21.12. Available from: https:// feb.kuleuven.be/research/economics/ces/documents/DPS/DPS2021/dps%202112. pdf. Gore, J., Fray, L., Miller, A., Harris, J. and Taggart, W. (2021) ‘The impact of COVID- 19 on student learning in New South Wales primary schools: an empirical study’, The Australian Educational Researcher 48: 605-37. Goudeau, S., Sanrey, C., Stanczak, A., Manstead, A. and Darnon, C. (2021) ‘Why lockdown and distance learning during the COVID-19 pandemic are likely to increase the social class achievement gap’, Nature Human Behaviour 5: 1273-81. Grätz, M. and Lipps, O. (2021) ‘Large loss in studying time during the closure of schools in Switzerland in 2020’, Research in Social Stratification and Mobility 71: 100554. Grewenig, E., Lergetporer, P., Werner, K., Woessmann, L. and Zierow, L. (2021) ‘COVID-19 and educational inequality: How school closures affect low-and high-achieving students’, European Economic Review 140: 103920. Haelermans, C., van der Velden, R., Aarts, B., Bijlsma, I., Jacobs, M., Smeets, C., van Vugt, L. and van Wetten, S. (2021) Balans na anderhalf jaar: Vertraging leergroei 20 J. F. BIRKELUND AND K. B. KARLSON het grootst voor rekenen-wiskunde. NCO Factsheet No. 8. Available from: https:// www.nationaalcohortonderzoek.nl/sites/nco/files/media-files/factsheet08_nco_ algemeen_0.pdf. Hammerstein, S., König, C., Dreisörner, T. and Frey, A. (2021) ‘Effects of COVID- 19-related school closures on student achievement – a systematic Review’, Frontiers in Psychology 12: 746289. Jæger, M. M. and Blaabæk, E. H. (2020) ’Inequality in learning opportunities during Covid-19: evidence from library takeout’, Research in Social Stratification and Mobility 68: 100524. Kogan, V. and Lavertu, S. (2021) The COVID-19 pandemic and student achievement on Ohio’s third-grade English language arts assessment. Online Report. Available from: http://glenn.osu.edu/educational-governance/reports/reports-attributes/ ODE_ThirdGradeELA_KL_1-27-2021.pdf. Kuhfeld, M., Ruzek, E., Johnson, A., Tarasawa, B. and Lewis, K. (2020) Technical appendix for: learning during COVID-19: initial findings on students’ reading and math achievement and growth. NWEA. Available from: https://www.nwea. org/research/publication/technical-appendix-for-learning-during-covid-19- initial-findings-on-students-reading-and-math-achievement-and-growth. Lareau, A. (2000) Home Advantage: Social Class and Parental Intervention in Elementary Education, Lanham: Rowman & Littlefield Publishers. Lareau, A. and Calarco, J. M. (2012) ‘Class, cultural capital, and institutions: the case of families and Schools’, in S. Fiske and H. R. Markus (eds.), Facing Social Class: How Societal Rank Influences Interaction, New York: Russel Sage Foundation, pp. 61-86. Loades, M. E., Chatburn, E., Higson-Sweeney, N., Reynolds, S., Shafran, R., Brigden, A., Linney, C., McManus, M. N., Borwick, C. and Crawley, E. (2020) ‘Rapid sys- tematic review: the impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19’, Journal of the American Academy of Child & Adolescent Psychiatry 59(11): 1218-39. Maldonado, J. E. and De Witte, K. (2022) ‘The effect of school closures on standar- dised student test outcomes’, British Educational Research Journal 48(1): 49-94. Meeter, M. (2021) ‘Primary school mathematics during the COVID-19 pandemic: No evidence of learning gaps in adaptive practicing results’, Trends in Neuroscience and Education 25: 100163. OECD (2021) The State of Global Education: 18 Months Into the Pandemic, Paris: OECD Publishing. doi:10.1787/1a23bb23-en. Pier, L., Christian, M., Tymeson, H. and Meyer, R. H. (2021) COVID-19 impacts on student learning: evidence from interim assessments in California. Policy Analysis for California Education. Available from: https://edpolicyinca.org/publications/ covid-19-impacts-student-learning. Qvortrup, L., Christensen, J. H. and Wistoft, K. (2021) Skolenedlukninger i Århus Kommune under corona-pandemien i et elev- og forældreperspektiv: En sammenlign- ing mellem foråret 2020 og vinteren 2021 [School closures in Aarhus Municipality during the corona pandemic in a pupil and parent perspective: a comparison of spring 2020 and winter 2021]. DPU, Aarhus Universitet. Available from: https:// EUROPEAN SOCIETIES 21 ncs.au.dk/fileadmin/NCS/Projekter/Noedundervisning_under_corona-krisen/ Corona-rapport_skoler_AArhus_Kommune_2020_2021.pdf. Reimer, D., Smith, E., Andersen, I. G. and Sortkær, B. (2021) ‘What happens when schools shut down? investigating inequality in students’ reading behavior during Covid-19 in Denmark’, Research in Social Stratification and Mobility 71: 100568. Rose, S., Twist, L., Lord, P., Rutt, S., Badr, K., Hope, C. and Styles, B. (2021) Impact of school closures and subsequent support strategies on attainment and socio- emotional wellbeing in Key Stage 1: Interim Paper 1. National Foundation for Educational Research, London. Available from: https://www.nfer.ac.uk/impact- of-school-closures-and-subsequent-support-strategies-on-attainment-and-socio- emotional-wellbeing. Schult, J., Mahler, N., Fauth, B. and Lindner, M. A. (2022) ‘Did students learn less during the COVID-19 pandemic? reading and mathematics competencies before and after the first pandemic wave’, School Effectiveness and School Improvement. doi:10.1080/09243453.2022.2061014. Spitzer, M. W. H. and Musslick, S. (2021) ‘Academic performance of K-12 students in an online-learning environment for mathematics increased during the shut- down of schools in wake of the COVID-19 pandemic’, PLoS One 16(8): e0255629. Tomasik, M. J., Helbling, L. A. and Moser, U. (2021) ‘Educational gains of in-person vs. distance learning in primary and secondary schools: a natural experiment during the COVID-19 pandemic school closures in Switzerland’, International Journal of Psychology 56(4): 566-76. van der Velde, M., Sense, F., Spijkers, R., Meeter, M. and van Rijn, H. (2021) ‘Lockdown learning: changes in online study activity and performance of Dutch secondary school students during the COVID-19 pandemic’, PsyArXiv Working Paper. doi:10.31234/osf.io/fr2v8. von Hippel, P. T., Workman, J. and Downey, D. B. (2018) ‘Inequality in reading and math skills forms mainly before kindergarten: a replication, and partial correction, of ‘Are schools the great equalizer?’’, Sociology of Education 91(4): 323-57. Werner, K. and Woessmann, L. (2021) The Legacy of Covid-19 in Education, Munich: CESifo. CESifo Working Paper 9358. Zierer, K. (2021) ‘Effects of pandemic-related school closures on pupils’ performance and learning in selected countries: a rapid Review’, Education Sciences 11(6): 252.

Journal

European SocietiesTaylor & Francis

Published: May 27, 2023

Keywords: COVID-19; school closures; learning; reading; social inequality

There are no references for this article.