CEO Library

In 2014, the Chief Evaluation Office (CEO) contracted with Mathematica Policy Research and ideas42 to examine whether insights from behavioral science can be used to improve outcomes in the U.S. Department of Labor (DOL) programs under the Advancing Behavioral Interventions in Labor Programs portfolio of studies.

The report provides analysis of intermediate impacts on participation in and completion of TechHire and Strengthening Working Families Initiative (SWFI) programs training, receipt of credentials, and use of child care and other services, as well as on longer-term outcomes such as employment and earnings, advancement and job quality, and other, exploratory outcomes such as overall well-being, health, and housing status at about 2 years following random assignment. 

In 2023, the Chief Evaluation Office (CEO), in collaboration with the Office of Disability Employment Policy (ODEP), funded independent contractor Abt Associates to conduct the evaluation of ODEP’s Equitable Transition Models (ETM) Demonstration Projects. The ETM Evaluation aims to build the evidence of strategies to enable low-income youth and young adults with disabilities (Y&YAD) ages 16-24, including those experiencing homelessness, leaving foster care, or involved in the justice system, to successfully transition into the workforce.

Building on an interim impact report at 18 months after program start, this final impact report describes each Ready to Work (RTW) Partnership Grant program’s impacts on participant earnings and employment through 3 years or more. For the report, the evaluation pre-specified average quarterly earnings for the period from 1 year to 2.5 years after random assignment as the evaluation’s main indicator of the extent to which a given RTW program had impact.

The technical appendices to The Ready to Work Partnership Grant Evaluation: Findings from the Final Impact Study of Four Employment Services Programs for the Long-Term Unemployed (Klerman, Herr, and Martinson 2022): Appendix A: Additional RTW Impact Study Technical Information, Appendix B: Demographic Comparison of RTW Samples to U.S.

The brief documents the impact of four Ready to Work (RTW) programs on participants’ service and credential receipt through 18 months after random assignment, and on participants' employment and earnings through three to four years after random assignment.

The brief explores the employment and earnings of applicants to the Ready to Work (RTW) Partnership Grant program before and during the COVID pandemic. When the RTW program began offering services in 2015, it targeted workers who had lost their job during or after the 2007-2009 recession and remained long-term unemployed or/and experience to become re-employed in higher-paying middle- or high-skill jobs.

The brief reports results of an exploration of survey non-bias using data collected for the evaluation of the Ready to Work (RTW) Partnership Grant program. Additional detail on the RTW program and its evaluation are also provided.

The report documents the interim findings from the impact study of the Ready to Work (RTW) grant program. This report describes interim program impacts on service and credential receipt, earnings and employment, public benefits receipt, and a range of other employment-related outcomes through approximately 18 months after random assignment of participants into the study. The evaluation also estimates impacts for subgroups based on age, education level, employment status and gender.

The technical appendices to The Ready to Work Partnership Grant Evaluation: Findings from the Interim Impact Study of Four Employment Services Programs for the Long-Term Unemployed Report (Klerman, Herr, Martinson, and Copson 2022): Appendix A: Additional Technical Information on Methodology, Appendix B: Data Sources, Appendix C: Survey Methods for the 18-Month Follow-Up Survey, Appendix D: Definitions of Outcomes, Appendix E: Definitions of Base

In 2019, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration, Office of Unemployment Insurance (OUI) to conduct the Behavioral Interventions to Improve Work Search Among Unemployment Insurance Claimants project. The unemployment insurance (UI) program requires claimants to be actively looking for work while they receive benefits to encourage a rapid return to work.

The report of impact evaluations aimed to assess the effectiveness of behaviorally-informed communications – such as a pop-up alert and emails – in increasing unemployment insurance (UI) claimants’ compliance with work search requirements.

The brief is based on lessons from an evaluation: a randomized controlled trial (RCT) of a small subset of the 53 TechHire and Strengthening Working Families Initiative (SWFI) programs—three TechHire programs and two SWFI programs—that explored the implementation and short-term impacts of TechHire and SWFI. In particular, this brief focuses on findings from the implementation analysis that was part of the RCT; data sources for the implementation analysis included observations of TechHire and SWFI programs, interviews with staff members, and a review of program participation data.

The report focuses on the implementation and short-term impacts of TechHire and Strengthening Working Families Initiative (SWFI) — capturing between 7 and 14 months of follow-up—in the five programs that participated in a randomized control trial. The implementation analysis explored broad research questions about how the programs were implemented and what factors facilitated or inhibited implementation.

The report documents findings from an implementation study, describing how the Ready to Work (RTW) Partnership grantees’ programs were implemented over the full term of the grants, the institutional benefits the grantees anticipated would be sustained after the grants ended, and lessons for current workforce programs. Future reports, to be released in 2021 and 2022, will examine the impact of the four RTW programs on participants’ education and employment outcomes. Findings from this implementation study will be important in interpreting those impact results.

This brief documents findings from the Ready to Work (RTW) Partnership Grant Evaluation, describing how the grantees’ programs were implemented over the full term of the grant, the institutional benefits the grantees anticipated would be sustained after the grants ended, and lessons for current workforce programs. Future reports, to be released in 2021 and 2022, will examine the impact of the four programs on participants’ education and employment outcomes. Findings from this implementation study will be important in interpreting those impact results.

Paper that presents a study of consumer learning in the context of payroll accounts, a simple financial technology that is currently being rolled out to millions of workers worldwide in response to demands for increased supply chain transparency and as a result of the Covid-19 pandemic. The researchers conducted a field experiment with a population of salaried factory workers in Bangladesh who, prior to the study, received their wages entirely in cash.

Paper that presents results of a randomized controlled trial with 3,136 salaried factory workers in Bangladesh employed at two large garment factories which, at the beginning of the study, paid all wages in cash. The researchers randomly and individually assign workers within the same factory to either continue receiving their wages in cash or receive electronic wage payments through either a bank or mobile account.

Making the successful transition to adulthood has become increasingly difficult for many young people in the United States, particularly for those without a college education. Those without a high school degree face even tougher prospects, with especially high unemployment rates and falling wages. A typical worker without a high school diploma earns less today than the same worker did in the 1970s. YouthBuild is a program that attempts to improve prospects for less-educated young people, serving over 10,000 individuals each year at over 250 organizations nationwide.

A key challenge facing policymakers and program administrators is how to develop effective strategies to help Americans facing economic challenges, particularly the long-term unemployed, to succeed in the labor market. During the deep recession of 2008-2009, an unprecedented number of workers lost their jobs and many remained under- or unemployed, even as the economy recovered.

The brief presents findings on the effects of 12-month information campaigns designed to increase employer awareness of Short-Time Compensation (STC) programs in Iowa and Oregon. The states ran their campaigns starting in mid-September 2014 in Iowa and late October 2014 in Oregon, and researchers tested the effects of this outreach using a random controlled trial (RCT) design in Iowa and the Portland metropolitan area of Oregon and a quasi-experimental design (QED) in Oregon outside of Portland.

Short-time compensation (STC), also known as work sharing, is an optional program within some state unemployment insurance systems. Under STC, employers experiencing a temporary reduction in business lower the average hours of employees in lieu of laying off workers. Employees whose hours are lowered receive Unemployment Insurance (UI) benefits in proportion to the reduction in their hours, while businesses retain valued employees and avoid future recruitment and training costs.

The podcast describes lessons learned from the Behavioral Interventions for Labor Related Programs Project, designed to test the use of behavioral science in U.S. Department of Labor (DOL) programs.

The way we write and structure documents can make them much more impactful. The checklist provides guidance before sending out an important communication. Make sure to review the checklist and see if there are edits you can make to improve it. While it may not always be possible to complete each item on the checklist, communications that incorporate more behavioral insights will have greater potential.

Effective U.S. Department of Labor (DOL) programs often require people to take action to get the benefits offered, but people often fail to do so. The reasons can be varied: they aren’t motivated to participate or they intend to but get distracted, or they begin and then are deterred by seemingly minor operational hassles. Fortunately, behavioral scientists have developed many techniques to improve the effectiveness of program procedures–techniques that have been applied successfully in many DOL programs.