Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Education outside of school (after school, summer…)

Blake Heller.

In 2016, the GED® introduced college readiness benchmarks designed to identify testers who are academically prepared for credit-bearing college coursework. The benchmarks are promoted as awarding college credits or exempting “college-ready” GED® graduates from remedial coursework. I show descriptive evidence that those identified as college-ready by these benchmarks enroll and persist in college at significantly higher rates than others who pass the GED® exam, but at lower rates than recent graduates with traditional high school diplomas. Regression discontinuity estimates show that crossing a college readiness threshold does not substantially influence testers' college enrollment or persistence during the two years following their first test attempt. Relatedly, I observe little exam retaking by those who fall narrowly short of the minimum college readiness score thresholds. This contrasts strongly with retaking behavior near the lower GED® passing threshold that determines eligibility for a high school equivalency credential. Those who narrowly fail a GED® subject test are over 100 times more likely to retest than those who fall just short of a college readiness benchmark in the same subject. GED® college readiness benchmarks do not currently appear to promote better college outcomes, but in the absence of more detailed test score information they offer a simple heuristic to predict short-run college enrollment and persistence among GED® graduates, particularly for those who identify educational gain as a primary reason for testing. The results highlight the promise and challenges associated with building pathways for non-traditional students to earn credit for prior learning.

More →


Deven Carlson, Adam Shepardson.

As students are exposed to extreme temperatures with ever-increasing frequency, it is important to understand how such exposure affects student learning. In this paper we draw upon detailed student achievement data, combined with high-resolution weather records, to paint a clear portrait of the effect of temperature on student learning across a six-year period for students in Tulsa, Oklahoma. The detailed, longitudinal nature of our data allows us to estimate the effects of both test-day and longer-term temperature on student test performance, and to examine how the effects of both temperature measures vary across seasons, student background, and the distribution of student achievement. Our results show that test-day temperature has no significant effect on student test performance in fall or winter, but a clear negative effect on students’ spring performance, particularly in math. Second, we find that summer temperature has a positive, statistically significant, and substantively meaningful effect on student performance on the fall MAP assessment—these effects appear in both math and reading. The results also illustrate that 90-day temperature affects math performance in winter and spring, but these estimates are modest in substantive magnitude.

More →


Lucy C. Sorensen, Andrea Headley, Stephen B. Holt.

Involvement with the juvenile justice system carries immense personal costs to youth: 30% of detained youth drop out of school (relative to 5% nationally) and 55% are re-arrested within one year. These personal costs are compounded by societal costs – both directly in $214,000 of expenses per confined youth per year – and indirectly in lost social and economic productivity. While much of the extant research on the “school-to-prison pipeline” focuses on school disciplinary practices such as suspension, less attention has been given to understanding the impact of school referrals to the juvenile justice system on students’ relationship with school. Using novel administrative data from North Carolina, we link 3 years of individual educational and disciplinary infraction records to juvenile justice system records to identify the effect of juvenile justice referrals for school-based offenses on student academic and behavioral outcomes. We find that, even for the same offense type and circumstance, relative to students only punished for infractions internally in the school, students referred to juvenile justice experience lower academic achievement, increased absenteeism, and are more likely to be involved in future juvenile system contact. We show that these juvenile referrals are not inevitable and instead reflect a series of discretionary choices made by school administrators and law enforcement. Moreover, we examine demographic disparities in school-based referrals to juvenile justice and find that female students, Black students, and economically disadvantaged students are more likely to receive referrals even for the same offense type and circumstances.

More →


Dorottya Demszky, Rose Wang, Sean Geraghty, Carol Yu.

Providing ample opportunities for students to express their thinking is pivotal to their learning of mathematical concepts. We introduce the Talk Meter, which provides in-the-moment automated feedback on student-teacher talk ratios. We conduct a randomized controlled trial on a virtual math tutoring platform (n=742 tutors) to evaluate the effectiveness of the Talk Meter at increasing student talk. In one treatment arm, we show the Talk Meter only to the tutor, while in the other arm we show it to both the student and the tutor. We find that the Talk Meter increases student talk ratios in both treatment conditions by 13-14%; this trend is driven by the tutor talking less in the tutor-facing condition, whereas in the student-facing condition it is driven by the student expressing significantly more mathematical thinking. Through interviews with tutors, we find the student-facing Talk Meter was more motivating to students, especially those with introverted personalities, and was effective at encouraging joint effort towards balanced talk time. These results demonstrate the promise of in-the-moment joint talk time feedback to both teachers and students as a low cost, engaging, and scalable way to increase students' mathematical reasoning.

More →


Andrew Bacher-Hicks, Olivia L. Chi, Ariel Tichnor-Wagner, Sidrah Baloch.

The COVID-19 pandemic disrupted teacher candidates’ capacity to complete licensure requirements. In response, many states temporarily reduced professional entry requirements to prevent a pandemic-induced teacher shortage. Using mixed methods, we examine the role of the emergency teaching license in Massachusetts, which provided an opportunity for individuals to enter the public school teacher workforce with only a bachelor’s degree. Our results show that emergency licenses increased the supply of teachers in two ways by: 1) providing an entry point for individuals who previously wanted to become teachers but could not meet traditional licensure requirements and 2) expanding the pool of individuals interested in the profession. Among those teachers hired with an emergency license, we find that they were substantially more ethnoracially diverse than their peers with traditional licenses, and they overwhelmingly intend to obtain permanent licensure and remain in the profession. These results suggest that rethinking initial entry requirements may be an effective policy tool to increase the supply of teachers, particularly among teachers of color.

More →


Beth E. Schueler, Katherine E. Larned.

Few interventions reduce inequality in reading achievement, let alone higher order thinking skills, among adolescents. We study “policy debate”—an extracurricular activity focused on improving middle and high schoolers’ critical thinking, argumentation, and policy analysis skills—in Boston schools serving large concentrations of economically-disadvantaged students of color. Student fixed effects estimates show debate had positive impacts on ELA test scores of 0.13 SD, equivalent to 68% of a full year of average 9th grade learning. Gains were concentrated on analytical more than rote subskills. We find no harm to math, attendance, or disciplinary records, and evidence of positive effects on high school graduation and postsecondary enrollment. Impacts were largest among students who were lowest achieving prior to joining debate.

More →


Sara White, Leiah Groom-Thomas, Susanna Loeb.

Tutoring has emerged as an especially promising strategy for supporting students academically. This study synthesizes 33 articles on the implementation of tutoring, defined as one-to-one or small-group instruction in which a human tutor supports students grades K-12 in an academic subject, to better understand the facilitators and barriers to program success. We find that policies influenced tutoring implementation through the allocation of federal funding and stipulation of program design. Tutoring program launch has often been facilitated by strategic relationships between schools and external tutoring providers and strengthened by transparent assessments of program quality and effectiveness. Successful implementation hinged on the support of school leaders with the power to direct school funding, space, and time. Tutoring setting and schedule, recruitment and training, and curriculum influenced whether students are able to access quality tutoring and instruction. Ultimately, evidence suggests that tutoring was most meaningful when tutors fostered positive student-tutor relationships which they drew upon to target instruction toward students’ strengths and needs.

More →


Emily Morton, Paul Thompson, Megan Kuhfeld.

Four-day school weeks are becoming increasingly common in the United States, but their effect on students’ achievement is not well-understood. The small body of existing research suggests the four-day schedule has relatively small, negative average effects (~-0.02 to -0.09 SD) on annual, standardized state test scores in math and reading, but these studies include only a single state or are limited by using district-level data. We conduct the first multi-state, student-level analysis that estimates the effect of four-day school weeks on student achievement and a more proximal measure of within-year growth using NWEA MAP Growth assessment data. We conduct difference-in-differences analyses to estimate the effect of attending a four-day week school relative to attending a five-day week school. We estimate significant negative effects of the schedule on spring reading achievement (-0.07 SD) and fall-to-spring achievement gains in math and reading (-0.06 SD in both). The negative effects of the schedule are disproportionately larger in non-rural schools than rural schools and for female students, and they may grow over time. Policymakers and practitioners will need to weigh the policy’s demonstrated negative average effects on achievement in their decisions regarding how and if to implement a four-day week.

More →


Torsten Figueiredo Walter, Guthrie Gray-Lobe, Sarah Kabay.

Hardware requirements are a barrier to widespread adoption of digital learning software among low-income populations. We investigate the demand among smallholder-farming households for a simple, adaptive math learning tool that can be accessed by widely available ``brick'' phones, and its effect on educational outcomes. Over a quarter of invited households used the tool, with greater demand among households lacking electricity, radios, or televisions. Usage was highest when schools were out of session. Engagement lapsed without regular reminders to use the service. Using random variation in access to the service, we find evidence that the platform increased test scores, school attendance, and grade attainment. Interpretation of these estimates is complicated by potentially endogenous outcome observation.

More →


Edward J. Kim, Luke W. Miratrix.

Greater school choice leads to lower demand for private tutoring according to various international studies, but this has not been explicitly tested for the U.S. context. To estimate the causal effect of charter school appearances on neighboring private tutoring prevalence, we employ a comparative event study model combined with a longitudinal matching strategy to accommodate differing treatment years. In contrast to findings from other countries, we estimate that charter schools increase, rather than decrease, tutoring prevalence in the United States. We further find that the effect varies considerably based on the characteristics of the treated neighborhood: areas with the highest income, educational attainment, and proportion Asian show the greatest treatment impacts, while the areas with the least show null effects. Moreover, methodologically this investigation offers a pipeline for flexibly estimating causal effects with observational, longitudinal, geographically located data.

More →