Search EdWorkingPapers
Search EdWorkingPapers by author, title, or keywords.
Search
Program and policy effects
This study contributes to the science of teaching reading by illustrating how a ubiquitous classroom practice – read alouds – can be enhanced by fostering teacher language practices that support students’ ability to read for understanding. This experimental study examines whether and to what extent providing structured teacher read aloud supplements in a social studies read aloud can allow students to leverage a familiar science schema and thereby positively impact reading comprehension outcomes. Treatment students received a single social studies read-aloud on the story of Apollo 11 with structured teacher read aloud supplements while control students received the same read-aloud story but without structured supplements. Effect sizes from hierarchical linear models indicated that students in the treatment condition significantly outperformed students in the control condition on four measures of domain-specific reading comprehension. Further exploratory analyses using structural equation modeling examined the extent that teacher language mediated the treatment effect. Results indicated that teachers going above and beyond the intervention script explained 67 percent of the treatment effect. Structured supplements for read alouds can help students see important connections between schemas, which ultimately aids in reading comprehension.
We develop a unifying conceptual framework for understanding and predicting teacher shortages at the state, region, district, and school levels. We then generate and test hypotheses about geographic and subject variation in teacher shortages using data on unfilled teaching positions in Tennessee during the fall of 2019. We find that teacher staffing challenges are highly localized, causing shortages and surpluses to coexist. Aggregate descriptions of staffing challenges mask considerable variation between schools and subjects within districts. Schools with fewer local early-career teachers, smaller district salary increases, worse working conditions, and higher historical attrition rates have higher vacancy rates. Our findings illustrate why viewpoints about, and solutions to, shortages depend critically on whether one takes an aggregate or local perspective.
This paper discusses the importance of incorporating personal assistance into interventions aimed at improving long-term education and labor market success. While existing research demonstrates the cost-effectiveness of low-touch behavioral nudges, this paper argues that the dynamic nature of human capital accumulation requires sustained habits over time. To foster better habits, social connections are critical for encouraging enduring effort and intrinsic motivation. The paper showcases examples from various stages of human capital accumulation, including early childhood, adolescence, and adulthood, in which interventions that incorporate personal assistance substantially out-perform less intensive nudges. We underscore the importance of interactive support, guidance, and motivation in facilitating significant progress and explore the challenges associated with implementing cost-effective policies to provide such assistance.
Targeted instruction is one of the most effective educational interventions in low- and middle-income countries, yet reported impacts vary by an order of magnitude. We study this variation by aggregating evidence from prior randomized trials across five contexts, and use the results to inform a new randomized trial. We find two factors explain most of the heterogeneity in effects across contexts: the degree of implementation (intention-to-treat or treatment-on-the-treated) and program delivery model (teachers or volunteers). Accounting for these implementation factors yields high generalizability, with similar effect sizes across studies. Thus, reporting treatment-on-the-treated effects, a practice which remains limited, can enhance external validity. We also introduce a new Bayesian framework to formally incorporate implementation metrics into evidence aggregation. Results show targeted instruction delivers average learning gains of 0.42 SD when taken up and 0.85 SD when implemented with high fidelity. To investigate how implementation can be improved in future settings, we run a new randomized trial of a targeted instruction program in Botswana. Results demonstrate that implementation can be improved in the context of a scaling program with large causal effects on learning. While research on implementation has been limited to date, our findings and framework reveal its importance for impact evaluation and generalizability.
The impact of test-optional college admissions policies depends on whether applicants act strategically in disclosing test scores. We analyze individual applicants’ standardized test scores and disclosure behavior to 50 major US colleges for entry in fall 2021, when Covid-19 prompted widespread adoption of test-optional policies. Applicants withheld low scores and disclosed high scores, including seeking admissions advantages by conditioning their disclosure choices on their other academic characteristics, colleges’ selectivity and testing policy statements, and the Covid-related test access challenges of the applicants’ local peers. We find only modest differences in test disclosure strategies by applicants’ race and socioeconomic characteristics.
Prior research has clearly established the substantial expected payoffs to investments in early childhood education. However, the ability to deliver early childhood programs differs across communities with access to high quality programing especially hard to establish in rural communities. We study one program, Early Steps to School Success, to understand whether the provision of home visiting and book exchange programs in rural Kentucky can influence kindergarten readiness. Linking program data with the state longitudinal data system in Kentucky we create multiple comparison groups by matching children on known program qualification indicators to estimate whether Early Steps program participation was related to school readiness. Our estimates suggest that program participation resulted in small improvements to children’s kindergarten readiness, as measured by the Brigance kindergarten readiness assessment overall score and sub-scores in language, cognitive, and physical development. Results are not sensitive to our choice of comparison group, though they appear driven by the experiences of children who participate from birth through age five or from ages three-to-five only. Our findings suggest that the Early Steps home visiting intervention may be a worthwhile intervention for improving kindergarten preparedness for children living in rural contexts.
We examine the impact of local labor market shocks and state unemployment insurance (UI) policies on student discipline in U.S. public schools. Analyzing school-level discipline data and firm-level layoffs in 23 states, we find that layoffs have little effect on discipline rates overall. However, effects differ across the UI benefit distribution. At the lowest benefit level ($265/week), a mass layoff increases out-of-school suspensions by 4.5%, with effects dissipating as UI benefits increase. Effects are consistently largest for Black students - especially in predominantly White schools - resulting in increased racial disproportionality in school discipline following layoffs in low-UI states.
We estimate the effect of universal free school meal access through the Community Eligibility Program (CEP) on child BMI. Through the CEP, schools with high percentages of students qualified for free or reduced-priced meals can offer freebreakfast and lunchto all students. With administrative data from a large school district in Georgia, we use student-level BMI measures from the FitnessGram to compare within-student outcomes before and after CEP implementation across eligible and non-eligible schools. We find one year of CEP exposure increased expected BMI percentile by about 0.085 standard deviations, equivalent to a nearly 1.88- pound weight increase for a student of average height. We also find that the program led to a small increase in the likelihood of overweight and limited evidence of a small decrease in the likelihood of underweight. We do not find that the program increased student obesity risk. Examining the effects of CEP on child BMI by grade suggests that the overall effect is largely driven by students in middle schools, highlighting potential heterogeneity in the program’s impact across grades. The findings of this paper are relevant for researchers and policymakers concerned with the effects of universal free school meals on student health.
Complexity and uncertainty in the college application process contribute to longstanding racial and socioeconomic disparities in enrollment. We leverage a large-scale experiment that combines an early guarantee of college admission with a proactive nudge, fee waiver, and structural application simplification to test the impacts of emerging “direct admissions” policies on students’ college-going behaviors. Students in the intervention were 2.7 percentage points (or 12%) more likely to submit a college application, with larger impacts for racially minoritized, first-generation, and low-income students. Students were most responsive to automatic offers from larger, higher quality institutions on the application margin, but were not more likely to subsequently enroll. In the face of growing adoption, we show this low-cost, low-touch intervention can move the needle on important college-going behaviors but is insufficient alone to increase enrollment given other barriers to access, including the ability to pay for college.
College success requires students to engage with their institution academically and administratively. Missteps with required administrative processes can threaten student persistence and success. Through two experimental studies, we assessed the effectiveness of an artificially intelligent text-based chatbot that provided proactive outreach and support to college students to navigate administrative processes and use campus resources. In both the two-year and four-year college context, outreach was most effective when focused on discrete administrative processes such as filing financial aid forms or registering for courses which were acute, time-sensitive, and for which outreach could be targeted to those for whom it was relevant. In the context of replicating studies to better inform policy and programmatic decision making, we draw three core lessons regarding the effective use of nudge-type efforts to promote college success.