Search for EdWorkingPapers here by author, title, or keywords.
Employers may favor applicants who played college sports if athletics participation contributes to leadership, conscientiousness, discipline, and other traits that are desirable for labor-market productivity. We conduct a resume audit to estimate the causal effect of listing collegiate athletics on employer callbacks and test for subgroup effects by ethnicity, gender, and sport type. We applied to more than 450 jobs on a large, well-known job board. For each job listing we submitted two fictitious resumes, one of which was randomly assigned to include collegiate varsity athletics. Overall, listing a college sport does not produce a statistically significant change in the likelihood of receiving a callback or interview request. However, among non-white applicants, athletes are 3.2 percentage points less likely to receive an interview request (p = .04) relative to non-athletes. We find no statistically significant differences among males or females.
The quality of college education is hard for students and employers to observe. Knowing this, colleges often change their names to signal higher quality while leaving other features unchanged. We study how these changes affect college choice and labor market performance of college graduates. Using administrative data, we show that name-changing colleges attract more qualified applicants, with larger effects among applicants who have less information about the college. Text from web discussion boards reveals many college applicants lack important information about colleges. A resume audit study shows employers possess nearly perfect information about how college name changes affect student aptitude.
We consider the case in which the number of seats in a program is limited, such as a job training program or a supplemental tutoring program, and explore the implications that peer effects have for which individuals should be assigned to the limited seats. In the frequently-studied case in which all applicants are assigned to a group, the average outcome is not changed by shuffling the group assignments if the peer effect is linear in the average composition of peers. However, when there are fewer seats than applicants, the presence of linear-in-means peer effects can dramatically influence the optimal choice of who gets to participate. We illustrate how peer effects impact optimal seat assignment, first under a general social planner utility function and then from both an efficiency and an equity perspective. We next use data from a recent job training RCT to provide the first evidence of large peer effects in the context of job training for disadvantaged adults. Finally, we combine the two results to show that the program's effectiveness varies greatly depending on whether the assignment choices account for or ignore peer effects.
Recent interest to promote and support replication efforts assume that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our general approach is derived from the Causal Replication Framework (CRF), which formalizes the assumptions under which replication success can be expected. The assumptions may be understood broadly as replication design requirements and individual study design requirements. Replication failure occurs when one or more CRF assumptions are violated. In design-based approaches to replication, CRF assumptions are systematically tested to evaluate the replicability of effects, as well as to identify sources of effect variation when replication failure is observed. In direct replication designs, replication failure is evidence of bias or incorrect reporting in individual study estimates, while in conceptual replication designs, replication failure occurs because of effect variation due to differences in treatments, outcomes, settings, and participant characteristics. The paper demonstrates how multiple research designs may be combined in systematic replication studies, as well as how diagnostic measures may be used to assess the extent to which CRF assumptions are met in field settings.
Developmental education, in which college students deemed unprepared for college-level coursework enroll in non-credit bearing courses, is widespread in American higher education. The current study evaluates the effect of mobile app courseware on the college outcomes of developmental education students, using a research design which randomly assigned course sections to receive access to the apps or not. The results show that access to the apps significantly improved student performance in developmental education outcomes, marginally improved medium-term college persistence and performance, but did not effect credential attainment in the study timeframe. Despite a number of barriers to implementation, the results suggest the intervention has the potential to improve the short-term outcomes of developmental education students in addition to being low-cost and scalable.
We draw on administrative data from the country of Colombia to assess differences in student learning in online and traditional on-campus college programs. The Colombian context is uniquely suited to study this topic, as students take an exit examination at the end of their studies. We can therefore directly compare performance on the exit exam for students in online and on-campus programs both across and within institutions, degrees, and majors. Using inverse probability weighting methods based on a rich set of background characteristics coupled with institution-degree-major fixed effects, our results suggest that bachelor’s degree students in online programs perform worse on nearly all test score measures (including math, reading, writing, and English) relative to their counterparts in on-campus programs. Results for shorter technical certificates are more mixed. While online students perform significantly worse than on-campus students on exit exams in private institutions, they perform better in SENA—the main public vocational institution in the country.
The transfer between two-year and four-year colleges is a critical path to baccalaureate attainment. Yet, students face a number of barriers in transfer pathways, including a lack of coherent coordination and articulation between their community colleges and four-year institutions, resulting in excess units and increased time to degree. In this paper we evaluate the impact of California’s Student Transfer Achievement Reform Act, which aimed to create a more seamless pathway between the Community Colleges and the California State University. We investigate whether the reform effort met its intended goal of improving baccalaureate receipt, and greater efficiency in earning these degrees, among community college transfer students. We tease out plausibly causal effects of the policy by leveraging the exogenous variation in the timing of the implementation of the reform in different campuses and fields of study. We find that this reform effort has led to significant reductions in time to baccalaureate receipt among community college transfers and reduced total unit accumulation. These positive effects were shared across all student subgroups.
I study how postsecondary admission policies affect the composition and subsequent academic outcomes of new cohorts. I leverage the staggered replacement of lotteries and waitlists at California's community college nursing programs with admissions that rely on grades, work experience, and other measures. The change in admissions increased the average prior academic performance of incoming cohorts, but did not improve academic outcomes such as completion rates or pass rates on the national licensing exam. I find suggestive evidence that the change in admissions decreased the share of new students who were not White, but by small amounts. The change in admissions also substantially reduced the time students spent waiting between taking prerequisite coursework and entering the nursing programs.
The Top 10% Plan admissions policy has now been in place in Texas for over two decades. We analyze 18 years of post-Top 10% Plan data to look for evidence of increased access to the selective Texas flagship campuses among all Texas high schools. We provide a detailed description of changes in enrollment patterns at the flagship campuses from Texas high schools after the implementation of the Top 10% Plan, focusing on whether the policy resulted in new sending patterns from high schools that did not have a history of sending students to the flagship campuses. Our analysis reveals an increase in the likelihood that high schools in non-suburban areas sent students to the flagship campuses, but ultimately little to no equity-producing effects of the Top 10% Plan over this 18-year period. In fact, the representation of traditional, always-sending, feeder high schools on the flagship campuses continued to dwarf the population of students from other high schools. Thus, the purported high school representation benefits of the policy appear to be overstated and may not go as far as advocates might have hoped in terms of generating equity of access to the flagship campuses in the state.
Multiple studies have documented the positive effect of school choice on college attendance. We focus instead on the quality of colleges, which is linked to higher graduation rates and later-in-life wages, especially for Black and Hispanic students. We examine the effect of the New Orleans school reforms, a district-wide reform creating an almost all-charter school district, on the quality of colleges that students attended. Using difference-in-differences analysis of statewide microdata, we find that the reforms led students to attend four-year colleges, and higher-quality ones, at higher rates. The reforms also increased the share of college-goers who were well matched to their colleges and this had little effect on transfer or persistence rates. Overall, these results reinforce that the reforms led students to attend higher-quality colleges that will improve long-term life outcomes.