Search for EdWorkingPapers here by author, title, or keywords.
Program and policy effects
How should schools assign students to more rigorous math courses so as best to help their academic outcomes? We identify several hundred California middle schools that used 7th grade test scores to place students into 8th grade Algebra courses, and use a regression discontinuity design to estimate average impacts and heterogeneity across schools. Enrolling in 8th grade algebra boosts students’ enrollment in advanced math in 9th grade by 30 percentage points and 11th grade by 16 percentage points. Math scores in 10th grade rise by 0.05 standard deviations. Women, students of color, and English-language learners benefit disproportionately from placement into early Algebra. Importantly, the benefits of 8th grade algebra are substantially larger in schools that set their eligibility threshold higher in the baseline achievement distribution. This suggests a potential tradeoff between increased access and rates of subsequent math success.
We examine through a field experiment whether outreach and support provided through an AI-enabled chatbot can reduce summer melt and improve first-year college enrollment at a four-year university and at a community college. At the four-year college, the chatbot increased overall success with navigating financial aid processes, such that student take up of educational loans increased by four percentage points. This financial aid effect was concentrated among would-be first-generation college goers, for whom loan acceptances increased by eight percentage points. In addition, the outreach increased first-generation students’ success with course registration and fall semester enrollment each by three percentage points. For the community college, where the randomized experiment could not be robustly implemented due to limited cell phone number information, we present a qualitative analysis of organizational readiness for chatbot implementation. Together, our findings suggest that proactive outreach to students is likely to be most successful when targeted to those who may be struggling (for example, in keeping up with required administrative tasks). Yet, such targeting requires university systems to have ready access to and ability to make use of their administrative data.
Rising inequality in the United States has raised concerns about potentially widening gaps in educational achievement by socio-economic status (SES). Using assessments from LTT-NAEP, Main-NAEP, TIMSS, and PISA that are psychometrically linked over time, we trace trends in achievement for U.S. student cohorts born between 1954 and 2001. Achievement gaps between the top and bottom quartiles of the SES distribution have been large and remarkably constant for a near half century. These unwavering gaps have not been offset by improved achievement levels, which have risen at age 14 but have remained unchanged at age 17 for the past quarter century.
Recent increases in high school graduation rates have been linked anecdotally to online course-taking for credit recovery. Online course-taking that supports high school completion could open opportunities for postsecondary education pursuits. Alternatively, poorer quality online instruction could diminish student learning and discourage persistence toward graduation and further education. Using quasi-experimental methods in an eight-year longitudinal study of high school online course-taking, we find positive associations between online course-taking, credits earned and high school graduation, and for those with limited online course-taking, small increases in college enrollment. However, we find significantly lower four-year college enrollments and lower-quality college enrollments for all online course-takers, leaving open the question of whether online course-taking will lead to longer-term postsecondary education and labor market success.
The belief that additional time allows children to become more ready for school has affected public policy and individual practices. Prior studies estimated either associations between school entry age and academic growth or causal effects on achievement measured at one or two points. This paper contributes novel causal evidence for the impacts of kindergarten entry age on academic growth in the first three years of school. We embed regression discontinuity into a piecewise multilevel growth model and apply it to rich assessment data from three states. Being a year older leads to higher initial achievement and higher kindergarten growth rates but lower growth rates during 1st and 2nd grades. Effects do not differ by gender or race.
This paper uses meta-analytic techniques to estimate the separate effects of the starting age, program duration, and persistence of impacts of early childhood education programs on children’s cognitive and achievement outcomes. It concentrates on studies published before the wide scale penetration of state-pre-K programs. Specifically, data are drawn from 67 high-quality evaluation studies conducted between 1960 and 2007, which provide 993 effect sizes for analyses. When weighted for differential precision, effect sizes averaged .26 sd at the end of these programs. We find larger effect sizes for programs starting in infancy/toddlerhood than in the preschool years and, surprisingly, smaller average effect sizes at the end of longer as opposed to shorter programs. Our findings suggest that, on average, impacts decline geometrically following program completion, losing nearly half of their size within one year after the end of treatment. Taken together, these findings reflect a moderate level of effectiveness across a wide range of center-based programs and underscore the need for innovative intervention strategies to produce larger and more persistent impacts.
States and localities cannot avoid dealing with issues of teacher compensation. Not only is it the largest budget item for most local governments, but it is the place of largest leverage for improving the quality of schools. Fortunately, consistent research evidence directly informs ways to optimize teacher compensation.
This research provides strong motivation for improving teacher compensation. First, it shows that teachers are paid significantly less than they could earn outside of teaching. Second, teacher salaries have been stagnant, largely because personnel budgets have been more directed toward increasing the number of educators and administrators than toward supporting teachers. But simply increasing pay without consideration of teacher effectiveness will not lead to improved student outcomes.
The economic status of both students and the nation as a whole could be dramatically improved with increases in school quality. But with pressures on public budgets—due importantly to the growing costs of public pensions and health benefits—personnel dollars will have to be used more strategically if our students are to compete internationally. Moreover, the nation has a substantial equity problem: achievement gaps have been constant for a half century despite a wide variety of federal, state, and local policies designed to address them.
Access to quality secondary schooling can be life-changing for students in developing contexts. In Kenya, entrance to such schools has historically been determined by performance on a high-stakes exam. Understandably then, preparation for this exam is a high priority for Kenyan families and educators. To increase the share of students gaining entry to these schools, some educational providers offer targeted instruction for students they believe have a chance of securing a spot. We experimentally evaluate the impact of these “symposia” programs—week-long, sleep-away camps where eighth grade students receive a burst of academic instruction from teachers selected based on merit. While similar models have been tested in the U.S., less is known about this intervention in developing settings. Our results suggest these programs are not particularly effective for the average nominated student relative to a typical week of school. However, we find large, positive effects among students attending schools from which few students are nominated for symposia. We provide suggestive evidence that this was because students from low- representation schools had less pre-camp practice test resources outside of school. The results have implications for program design and contribute to the growing literature on the effectiveness of appropriately targeted individualized instruction.
We use information on the charter school choices made by North Carolina families, separately by race, who switched their child from a traditional public school (TPS) to a charter school in 2015-16 to explore how such choices affect racial segregation between schools and racial isolation within charter schools. We find that the movement of white switchers, but not minority switchers to charter schools increases racial segregation between schools. In addition, using a conditional logit model to estimate revealed preferences, we find that the value parents place on the racial composition of individual charter schools differs by the race and income of the switchers. As a result, even after we control for other valued aspects of charter schools -- such as distance from the previous traditional public school and the charter school’s mission, academic performance and services offered -- the differential preferences of the switchers leads to substantial racial isolation within charter schools.
School Improvement Grants (SIG) represent one type of governments’ capacity-building investment to spur sustainable changes in America’s persistently under-performing public schools. This study examines both short- and long-run effects of the first two cohorts of SIG schools from two states and two urban districts across the country. Using dynamic event analyses, we observe that SIG showed larger effects in the second and third years of the intervention than the first year on 3-8th grade student test scores—a pattern of gradually increase over the course the intervention. These positive effects are largely sustained three or four years after the funding ended. In high schools, the SIG effects on 4-year graduation rates were steadily increasing throughout the period of six or seven years after the initial start of the intervention. These patterns of SIG effects mostly apply to each of the four locations, but the magnitude of effects varies across locations, suggesting differential implementations. Moreover, SIG effects on students of color or low-socioeconomic students are similar to, and sometimes a bit larger than, the overall SIG effects. We also conduct a variety of sensitivity and robustness checks. Lastly, we discuss the policy implications of our findings on states’ continuing efforts of transforming public organizations and building their long-term capacity for better performance.