Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Methodology, measurement and data

Hernando Grueso.

Given the spike of homicides in conflict zones of Colombia after the 2016 peace agreement, I study the causal effect of violence on college test scores. Using a difference-in-difference design with heterogeneous effects, I show how this increase in violence had a negative effect on college learning, and how this negative effect is mediated by factors such as poverty, college major, degree type, and study mode. A 10% increase in the homicide rate per 100,000 people in conflict zones of Colombia, had a negative impact on college test scores equivalent to 0.07 standard deviations in the English section of the test. This negative effect is larger in the case of poor and female students who saw a negative effect of approximately 0.16 standard deviations, equivalent to 3.4 percentage points out of the final score. Online and short-cycle students suffer a larger negative effect of 0.14 and 0.19 standard deviations respectively. This study provides among the first evidence of the negative effect of armed conflict on college learning and offers policy recommendations based on the heterogeneous effects of violence.

More →


David R. Johnson.

At schools with low grading standards, students receive higher school-awarded grades across multiple courses than students with the same skills receive at schools with high grading standards. A new methodology shows grading standards vary substantially, certainly enough to affect post-secondary opportunities, across high schools in Alberta. Schools with low grading standards are more likely to be private, rural, offer courses for students returning to high school, have smaller course cohorts, have a smaller percentage of lone parent households and a larger percentage of well-educated parents. Variation in grading standards changes post-secondary opportunities in systematic ways.

More →


Andrew Kwok, Joseph Waddington, Jenna Davis, Sara Halabi, Debbee Huston, Rita Hemsley.

Our study examines roughly 2,000 novice teachers’ responses about how they account for students’ cultural, ethnic/racial, and linguistic diversity. We qualitatively analyze robust open-ended survey responses to explore teachers’ reported strategies for how they integrate asset-based pedagogy (ABP). We identify codes related to these strategies and then investigate them by participant demographics. This illuminates both the predictive validity of our qualitative analyses as well as provides initial evidence as to whether certain characteristics are associated with critical techniques. Our findings inform practitioners of a suite of ABP strategies as well as districts and policymakers about how novice teachers are processing asset-based instruction and who to target support in this vital pedagogical area.

More →


Jing Liu, Emily Penner, Wenjing Gao.

Teachers’ sense-making of student behavior determines whether students get in trouble and are formally disciplined. Status categories, such as race, can influence perceptions of student culpability, but the degree to which teachers’ initial identification of student misbehavior exacerbates racial disproportionality in discipline receipt is unknown.This study provides the first systematic documentation of teachers’ use of office discipline Referrals (ODRs) in a large, diverse urban school district in California that specifies the identity of both the referred and referring individuals in all ODRs. We identify teachers exhibiting extensive referring behavior, or the top 5 percent referrers based on the number of ODRs they make in a given year and evaluate their contributions to disciplinary disparities. We find that “top referrers” effectively double the racial gaps in ODRs for both Black-White and Hispanic-White comparisons. These gaps are mainly driven by higher numbers of ODRs issued for Black and Hispanic students due to interpersonal offences and defiance, and also partially convert to racial gaps in suspensions. Both the level and racial compositions of the school sites where “top referrers” serve and their personal traits seem to explain some of their frequent referring behavior. Targeting supports and interventions to “top referrers” might afford an important opportunity to reduce racial disciplinary gaps

More →


Christina Weiland, Rebecca Unterman, Susan Dynarski, Rachel Abenavoli, Howard Bloom, Breno Braga, Anne-Marie Faria, Erica Greenberg, Brian A. Jacob, Jane Arnold Lincove, Karen Manship, Meghan McCormick, Luke Miratrix, Tomás E. Monarrez, Pamela Morris-Perez, Anna Shapiro, Jon Valant, Lindsay Weixler.

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs.  Our collaborative network of five research teams applying this design in early education and methods experts has identified six challenges that need to be carefully considered in this next context: 1) available baseline covariates may not be very rich; 2) limited data on the counterfactual; 3) limited and inconsistent outcome data; 4) weakened internal validity due to attrition; 5) constrained external validity due to who competes for oversubscribed programs; and 6) difficulties answering site-level questions with child-level randomization.  We offer potential solutions to these six challenges and concrete recommendations for the design of future lottery-based early education studies.

More →

Appendix140.99 KB

Valerie Bostwick, Christopher Severen.

We provide evidence that graduated driver licensing (GDL) laws, originally intended to improve public safety, impact human capital accumulation. Many teens use automobiles to access both school and employment. Because school and work decisions are interrelated, the effects of automobile-specific mobility restrictions are ambiguous. Using a novel triple-difference research design, we find that restricting mobility significantly reduces high school dropout rates and teen employment. We develop a multiple discrete choice model that rationalizes unintended consequences and reveals that school and work are weak complements. Thus, improved educational outcomes reflect decreased access to leisure activities rather than reduced labor market access.

More →


Courtney Bell, Jessalynn James, Eric S. Taylor, James H. Wyckoff.

We study the returns to experience in teaching, estimated using supervisor ratings from classroom observations. We describe the assumptions required to interpret changes in observation ratings over time as the causal effect of experience on performance. We compare two difference-in-differences strategies: the two-way fixed effects estimator common in the literature, and an alternative which avoids potential bias arising from effect heterogeneity. Using data from Tennessee and Washington, DC, we show empirical tests relevant to assessing the identifying assumptions and substantive threats—e.g., leniency bias, manipulation, changes in incentives or job assignments—and find our estimates are robust to several threats.

More →


Maria Marta Ferreyra, Carlos Garriga, Juan David Martin-Ocampo, Angelica Maria Sanchez-Diaz.

This paper estimates a dynamic model of college enrollment, progression, and graduation. A central feature of the model is student effort, which has a direct effect on class completion and an indirect effect mitigating risks on class completion and college persistence. The estimated model matches rich administrative data for a representative cohort of college students in Colombia. Estimates indicate that effort has a much greater impact than ability on class completion. Failing to consider effort as an input to class completion leads to overestimating ability’s role by a factor of two or three. It also promotes tuition discounts based on a pre-determined student trait—ability—rather than effort, which can be affected through policy, thus limiting higher education’s potential for social mobility.

More →


Lelys Dinarte-Diaz, Maria Marta Ferreyra, Tatiana Melguizo, Angelica Maria Sanchez-Diaz.

Short-cycle higher education programs (SCPs), lasting two or three years, capture about a quarter of higher education enrollment in the world and can play a key role enhancing workforce skills. In this paper, we estimate the program-level contribution of SCPs to student academic and labor market outcomes, and study how and why these contributions vary across programs. We exploit unique administrative data from Colombia on the universe of students, institutions, and programs to control for a rich set of student, peer, and local choice set characteristics. We find that program-level contributions account for about 60-70 percent of the variation in student-level graduation and labor market outcomes. Our estimates show that programs vary greatly in their contributions, across and especially within fields of study. Moreover, the estimated contributions are strongly correlated with program outcomes but not with other commonly used quality measures. Programs contribute more to formal employment and wages when they are longer, have been provided for a longer time, are taught by more specialized institutions, and are offered in larger cities.

More →


Maria Marta Ferreyra, Camila Galindo, Sergio Urzua.

This paper estimates the heterogeneous labor market effects of enrolling in higher education short-cycle (SC) programs. Expanding access to these programs might affect the behavior of some students (compliers) in two margins: the expansion margin (students who would not have enrolled in higher education otherwise) and the diversion margin (students who would have enrolled in bachelor’s programs otherwise). To quantify these responses, we exploit local exogenous variation in the supply of higher education institutions (HEIs) facing Colombian high school graduates in an empirical multinomial choice model with several instruments. According to our findings, the presence of at least one HEI specialized in SC programs in the vicinity of the student’s high school municipality increases SC enrollment by 3.7-4.5 percentage points (40-50% of the SC enrollment rate). The diversion margin largely drives this effect. For female compliers, enrollment in SC programs increases formal employment relative to the next-best alternative. For male compliers, in contrast, it lowers formal employment and wages. These results should alert policymakers of the unexpected consequences of higher education expansionary policies.

More →