Search EdWorkingPapers
Search EdWorkingPapers by author, title, or keywords.
Search
Inequality
This paper presents the results from a randomized controlled trial of Chapter One, an early elementary reading tutoring program that embeds part-time tutors into the classroom to provide short bursts of 1:1 instruction. Eligible kindergarten students were randomly assigned to receive supplementary tutoring during the 2021-22 school year (N=818). The study occurred in a large Southeastern district serving predominantly Black and Hispanic students. Students assigned to the program were over two times more likely to reach the program’s target reading level by the end of kindergarten (70% vs. 32%). The results were largely homogenous across student populations and extended to district-administered assessments. These findings provide promising evidence of an affordable and sustainable approach for delivering personalized reading tutoring at scale.
The improvement of low-performing school systems is one potential strategy for mitigating educational inequality. Some evidence suggests districtwide reform may be more effective than school-level change, but limited research examines district-level turnaround. There is also little scholarship examining the effects of turnaround reforms on outcomes beyond the first few years of implementation, on outcomes beyond test scores, or on the effectiveness of efforts to replicate district improvement successes beyond an initial reform context. We study these topics in Massachusetts, home to the Lawrence district representing a rare case of demonstrated improvements in the early years of state takeover and turnaround and where state leaders have since intervened in three other contexts as a result. We use statewide student-level administrative data (2006-07 to 2018-19) and event study methods to estimate medium-term reform impacts on test and non-test outcomes across four Massachusetts-based contexts: Lawrence, Holyoke, Springfield, and Southbridge. We find substantial district improvement was possible although sustaining the rate of gains was more complicated. Replicating gains in new contexts was also possible but not guaranteed.
Although existing research suggests that students benefit on a range of outcomes when they enroll in early algebra classes, policy efforts that accelerate algebra enrollment for large numbers of students often have negative effects. Explanations for this apparent contradiction often emphasize the potential role of teacher and peer effects, which could create positive effects for individual students placed into early algebra that would not translate to larger-scale policies. We use detailed data from Oregon that contain information on the teachers and peers to whom students are exposed in order to investigate these explanations. Our regression discontinuity analyses replicate key findings from prior studies, indicating that placement in eighth-grade algebra boosts student achievement in math and English language arts. We then demonstrate that eighth-grade algebra placement positively affects the achievement level of students’ classmates, as well as the years of experience and value added of students’ math teachers. The effects on peer composition that we observe are large enough to plausibly explain the majority of the effects of eighth-grade algebra on student test scores.
This study reports the findings from a year-long randomized evaluation assessing the impact of assigning 62 classrooms in Nigeria to receive either blocked or interleaved math problem sets. Blocked practice sessions focused on a single skill at a time. Interleaved problem sets alternated between different skills within a practice session. On tests of short-term retention, interleaved practice increased test scores by 0.29 standard deviations. In contrast, we find no evidence that interleaving improves average performance on a cumulative assessment measuring retention of material over the academic year. We find some evidence of large impacts on the cumulative assessment at the bottom of the distribution, but these impacts appear to be offset by negative impacts at the top.
Longitudinal studies can produce biased estimates of learning if children miss tests. In an application to summer learning, we illustrate how missing test scores can create an illusion of large summer learning gaps when true gaps are close to zero. We demonstrate two methods that reduce bias by exploiting the correlations between missing and observed scores on tests taken by the same child at different times. One method, multiple imputation, uses those correlations to fill in missing scores with plausible imputed scores. The other method models the correlations implicitly, using child-level random effects. Widespread adoption of these methods would improve the validity of summer learning studies and other longitudinal research in education.
The Every Student Succeeds Act (ESSA) began a new wave of school accountability under which states draw on multiple measures to assess school quality. States have options in terms of how to weight components in their school quality indices and how many years of data to use to determine school ratings. In this study, we simulate school ratings using eight years of administrative data in North Carolina to demonstrate how state decisions about school ratings and identification influence school ratings and the list of schools identified for improvement. We then evaluate these decisions against a framework that considers the validity, stability, and equity of the ratings, underscoring the inherent tradeoffs that come with each. We show that while a system that weights proficiency more heavily than growth produces more stable school ratings, identifying schools based on multiple years of performance data instead of one more than offsets the loss of stability in shifting to a growth measure. We conclude with recommendations for state accountability systems under ESSA and for federal policymaking moving forward.
School districts across the U.S. have adopted funding policies designed to distribute resources more equitably across schools. However, schools are also increasing external fundraising efforts to supplement district budget allocations. We document the interaction between funding policies and fundraising efforts in Chicago Public Schools (CPS). We find that adoption of a weighted-student funding policy successfully reallocated more dollars to schools with high shares of students eligible for free/reduced-price (FRL) lunch, creating a policy-induced per-pupil expenditure gap. Further, almost all schools raised external funds over the study period with most dollars raised concentrated in schools serving relatively affluent populations. We estimate that external fundraising offset the policy-induced per- pupil expenditure gap between schools enrolling the lowest and highest shares of FRL-eligible students by 26-39 percent. Other districts have attempted to reallocate fundraised dollars to all schools; such a policy in CPS would have little impact on most schools’ budgets.
School districts historically approached conflict-resolution from a zero-sum perspective: suspend students seen as disruptive and potentially harm them, or avoid suspensions and harm their classmates. Restorative practices (RP) -- focused on reparation and shared ownership of disciplinary justice -- are designed to avoid this trade-off by addressing undesirable behavior without imparting harm. This study examines Chicago Public Schools' adoption of RP. We identify decreased suspensions, improved school climate, and find no evidence of increased classroom disruption. We estimate a 19% decrease in arrests, including for violent offenses, with reduced arrests outside of school, providing evidence that RP substantively changed behavior.
Despite documented benefits to college completion, more than a third of students who initially enroll in college do not ultimately earn a credential. Completing college requires students to navigate both institutional administrative tasks (e.g., registering for classes) and academic tasks within courses (e.g., completing homework). In postsecondary education, several promising interventions have shown that text-based outreach and communication can be a low-cost, easy to implement, and effective strategy for supporting administrative task navigation. In this paper, we report on two randomized controlled trials testing the effect of a text-based chatbot with artificial intelligence (AI) capability on students' academic task navigation in introductory courses (political science and economics). We find the academic chatbot significantly shifted students’ final grades, increasing the likelihood students received a course grade of B or higher by 5-6 percentage points and reduced the likelihood students dropped the course.
In response to widening achievement gaps and increased demand for post-secondary education, local and federal governments across the US have enacted policies that have boosted high school graduation rates without an equivalent rise in student achievement, suggesting a decline in academic standards. To the extent that academic standards can shape effort decisions, these trends can have important implications for human capital accumulation. This paper provides both theoretical and empirical evidence of the causal effect of academic standards on student effort and achievement. We develop a theoretical model of endogenous student effort that depends on grading policies, finding that designs that do not account for either the spread of student ability or the magnitude of leniency can increase achievement gaps. Empirically, under a research design that leverages variation from a statewide grading policy and school entry rules, we find that an increase in leniency mechanically increased student GPA without increasing student achievement. At the same time, this policy induced students to increase their school absences. We uncover stark heterogeneity of effects across student ability, with the gains in GPA driven entirely by high ability students and the reductions in attendance driven entirely by low ability students. These differences in responses compound across high school and ultimately widen long-term achievement gaps as measured by ACT scores.