CEO Library

The technical appendix to Experiences of America’s Promise Participants During the “COVID-19 Recession”: Examining Gender Differences in Labor Market and Training Program Outcomes (Spitzer et al. 2022): Section A describes the data sources used for this study, Section B describes the approach taken to analyze employment and earnings, and Section C describes the approach taken to analyze program completion and enrollment.

The toolkit represents successful practices in negotiating agreements to obtain and use administrative data in U.S. Department of Labor (DOL) program evaluations. It includes detailed instructions, recommendations, and lessons learned on how to obtain data from various data providers including state workforce agencies, community colleges, criminal justice agencies, and other DOL grantees, primarily by establishing data use agreements.

The brief reports results of an exploration of survey non-bias using data collected for the evaluation of the Ready to Work (RTW) Partnership Grant program. Additional detail on the RTW program and its evaluation are also provided.

The brief explores the employment and earnings of applicants to the Ready to Work (RTW) Partnership Grant program before and during the COVID pandemic. When the RTW program began offering services in 2015, it targeted workers who had lost their job during or after the 2007-2009 recession and remained long-term unemployed or/and experience to become re-employed in higher-paying middle- or high-skill jobs.

The brief documents the impact of four Ready to Work (RTW) programs on participants’ service and credential receipt through 18 months after random assignment, and on participants' employment and earnings through three to four years after random assignment.

The technical appendices to The Ready to Work Partnership Grant Evaluation: Findings from the Final Impact Study of Four Employment Services Programs for the Long-Term Unemployed (Klerman, Herr, and Martinson 2022): Appendix A: Additional RTW Impact Study Technical Information, Appendix B: Demographic Comparison of RTW Samples to U.S.

Building on an interim impact report at 18 months after program start, this final impact report describes each Ready to Work (RTW) Partnership Grant program’s impacts on participant earnings and employment through 3 years or more. For the report, the evaluation pre-specified average quarterly earnings for the period from 1 year to 2.5 years after random assignment as the evaluation’s main indicator of the extent to which a given RTW program had impact.

The U.S. Department of Labor (DOL) funded Evaluation of the Pathway Home Grant Program study was a result of the annual process to determine the Department’s research priorities for the upcoming year. It contributes to the labor evidence-base to inform Reentry and Employment and Training programs and policies and addresses Departmental strategic goals and priorities. In particular, the brief focuses on the first 20 Pathway Home grants awarded in 2020 and their experiences implementing their programs during the COVID-19 pandemic between January and December 2021.

The brief discusses costs to the American Apprenticeship Initiative (AAI) grantees of supporting employers and sponsors in their efforts to create apprenticeships. The brief also explores how grantees progressed in setting up apprenticeship programs and how costs varied over time. Practitioners and policymakers, including state and local workforce agencies, can use these findings to plan future public investments in apprenticeship expansion through intermediary organizations like the AAI grantees or direct subsidies to employers. The AAI grantees began operations in October 2015.

The brief examines the earnings growth of American Apprenticeship Initiative (AAI) apprentices compared to the earnings growth for comparable workers during the same period. Researchers limited the sample to apprentices who started their program by 2018 and had a valid Social Security Number so that they could match their earnings records and follow them for 2.5 years after registration. They define comparable workers as workers with earnings records in the U.S.

The brief discusses the number and value of indirect benefits of American Apprenticeship Initiative (AAI) registered apprenticeship programs to participating employers. Supporters of apprenticeship, including state and local workforce agencies, can use these findings from the AAI evaluation to promote adoption of apprenticeship by employers. Direct benefits estimates were based on employers’ reports of a reference apprentice’s increased productivity. Indirect benefits were employers’ reported values relative to the value of the reference apprentice’s increased productivity.

The brief examines the recruitment, program experiences, and post-program employment and earnings outcomes of American Apprenticeship Initiative (AAI) apprentices from underrepresented populations—defined as women and people of color (Black, Hispanic, and Other Races, specifically Asian, Native Hawaiian or Pacific Islander, Native American, or multiple races)—relative to all AAI apprentices and historically represented populations—defined as White men. The brief combines data from a number of sources, including U.S.

The brief is part of the the American Apprenticeship Initiative (AAI) evaluation, and is based on site visits and follow up clarification calls to 6 AAI grantees that constituted 7 State or local workforce development boards. The evaluation team talked primarily with staff in management and leadership positions, although some agencies invited direct-service staff, such as career counselors and business services staff, to join the conversation.

The report presents findings from the American Apprenticeship Initiative (AAI) demonstration study that examined the impact of employer engagement efforts on employers’ take-up of registered apprenticeship. The primary data source is data collected by the two grantees (MassHire and Philadelphia Works) in the demonstration on their efforts to research, contact, and subsequently develop apprenticeship programs with employers.

The report presents findings from the outcomes study of the American Apprenticeship Initiative (AAI) evaluation. It examines the characteristics, reasons for enrollment, program experiences, and postprogram outcomes of AAI apprentices and pre-apprentices. The data sources include an AAI Apprentice Survey administered to a sample of approximately 2,600 registered apprentices, program records from grantees, and administrative earnings data from the National Directory of New Hires.

The report presents results from the American Apprenticeship Initiative (AAI) grant employer return-on-investment (ROI) sub-study. The primary data source is an Employer Survey administered to 68 employers that hired apprentices supported by an AAI grant. Each employer was asked to describe one of their apprenticeship programs in detail; all together, these programs represented 2,854 apprentices. The survey was deployed between March 2020 and October 2020, towards the end of the 5-year AAI grant period.

The report for the Evaluation of the Pathway Home Grant Program. Individuals released from incarceration face substantial obstacles to successful reentry and self-sufficiency once in the community. The Pathway Home Grant program seeks to help mitigate these obstacles by providing linked pre- and post-release employment services to improve individuals’ chances of finding meaningful employment and avoiding recidivism.

The purpose of the Older Workers Implementation and Descriptive Study is to build evidence about the implementation of the Senior Community Service Employment Program (SCSEP) and other U.S. Department of Labor (DOL) workforce programs serving older workers to inform the continuous improvement of SCSEP. To inform evaluation activities, the report reviews the literature and identifies the state of the evidence on workforce programs, including those that serve older workers and populations with similar employment barriers.

In 2018, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) to fund contractor The Urban Institute to design and conduct an evaluation that examines critical policy issues, lessons learned, and challenges states faced administering Unemployment Insurance (UI) programs during the Great Recession that began in 2007 and the economic recovery that followed.

The U.S. Department of Labor (DOL) sponsored a process study of the two Pay for Success (PFS) pilots, conducted by Abt Associates, to document project implementation and provide information on the PFS approach to policymakers and program administrators. This is the process study’s report. An earlier interim report documented the development of the pilots and their initial implementation. This final report updates information about the implementation of the pilots and includes observations based on the entirety of the DOL supported portion, or first phase, of the PFS grants.

The report documents the early efforts of Massachusetts and New York as they designed and implemented the Pay for Success (PFS) pilots funded under the U.S. Department of Labor’s (DOL) Workforce Innovation Fund (WIF). This report examines the seven-month period grantees had to develop their grant applications after the Solicitation for Grant Awards (SGA) was announced, the four months of planning once awards were made, and the initial approximately 10 months of operation.

Appendix to Workforce Innovation Fund (WIF) Evaluations: A Synthesis Report on Findings and Experiences Synthesis Report: Appendix A. Summary Briefs of Workforce Innovation Fund (WIF) Projects, Appendix B. List of All WIF Projects, Appendix C. WIF Background and Context Materials, and Appendix D. Understanding WIF Evaluation Findings.

The report identifies the interventions implemented by the 43 Workforce Innovation Fund (WIF) grantees, summarizes findings from the evaluation reports produced between 2015 and 2019, and provides observations regarding the evaluations themselves. Finally, it highlights lessons learned from the experiences with evaluations under WIF and discusses how these lessons might be applied in future initiatives involving grantee-led evaluations.

The 2018 amendments to the Social Security Act (hereafter “the Statute”) permanently authorized the Reemployment Services and Eligibility Assessment (RESEA) program, required that states’ programs be supported by evidence, and allowed states to use up to 10 percent of their RESEA grant for evaluations. Developed as part of the Evaluation to Advance RESEA Program Evidence, the evidence-building options report aims to serve as a resource for decision makers to understand and weigh options for developing evidence of various types.

The brief summarizes the state of the evidence for basic career services—a category of reemployment services—to help unemployment insurance (UI) claimants return to work. The brief closes with a discussion of gaps in the current evidence base and implications of evaluating these kinds of Reemployment Services and Eligibility Assessments (RESEA) program components.