CEO Library

The paper presents a new analysis examining gender and racial/ethnic differences in wage growth among workers in the United States who, between the ages of 18 and 34, entered occupations that require some training or experience beyond a high school degree, but do not necessarily require a college degree (referred to as “mid-level” occupations). The paper includes implications for policymakers and practitioners.

The brief summarizes lessons learned from using machine learning to study the implementation of career pathways programs. First, this brief describes the research questions that guided the study and summarizes the machine learning methods designed for the data collection and analysis activities, including study limitations and challenges encountered. It then provides lessons learned on using machine learning methods for social science research.

Graphic highlighting several Career Pathway program milestones and improvements from the 1980's through the 2020's.

The brief summarizes findings of the Career Pathways Descriptive and Analytical Project’s meta-analysis study, which analyzes research on the impacts of 46 career pathways programs, based on evaluation findings published between 2008 and 2021. The brief first describes the programs and participants in the evaluations included in the meta-analysis. It then discusses the study’s overall impact findings and the findings about which program characteristics were associated with impacts, as well as the implications of each for policymakers, practitioners, and researchers.

The report summarizes 46 impact evaluations that focus on programs that embed elements of the career pathways approach. In the past decade, the career pathways approach to workforce development emerged as a promising strategy to promote long-term earnings advancement and self-sufficiency by helping workers attain in-demand postsecondary credentials (Fein, 2012). The approach involves a combination of rigorous and high-quality education, training, and other services to support participant success (WIOA, 2014).

The brief summarizes the input on research priorities gathered from stakeholders and experts by the WIOA Research Portfolio project team between November 2020 and April 2021. The timing of these discussions provides important context for the findings. Many discussions were held during a surge in cases of COVID-19, when social distancing measures were widespread. Other discussions were held after the vaccines were becoming widely available and restrictions were being lifted. The conversations also spanned two different presidential administrations.

The report focuses on implementation of key changes to financial and management requirements for the American Job Center (AJC) system in order to seamlessly deliver services to all workforce customers across various partners. Data for this report are drawn primarily from site visit interviews, conducted in early 2019, with administrators, board chairs and members, employer and agency partners, and frontline staff in 14 states and 28 local areas. Other sources of information include administrative data and relevant state and local documents.

The report focuses on implementation of key changes to governance of the workforce system and how state and local workforce boards engage in planning across the core programs. Discussed here are the successes and challenges, promising practices, and possible areas for further technical assistance related to WIOA for workforce system governance and planning.

In 2021, the Chief Evaluation Office (CEO) funded contractor Westat Insight and their partner American Institutes for Research to conduct the Explorations in Data Innovations project under the Administrative Data Research and Analysis portfolio of studies. This use case study was designed to explore options around employing machine learning to create and maintain a public-facing, labor-related data catalog.

The report describes the National Health Emergency (NHE) Demonstration Grants to Address the Opioid Crisis: Implementation Evaluation findings and considers lessons learned and practices that appear potentially promising for future efforts to provide workforce services and system investments to support people directly and indirectly affected by the opioid crisis.

The report focuses on the implementation and short-term impacts of TechHire and Strengthening Working Families Initiative (SWFI) — capturing between 7 and 14 months of follow-up—in the five programs that participated in a randomized control trial. The implementation analysis explored broad research questions about how the programs were implemented and what factors facilitated or inhibited implementation.

The report of an evaluation of strategies used in the TechHire and Strengthening Working Families Initiative (SWFI) grant programs. The evaluation includes implementation, outcomes, and impact studies. The impact study involves a randomized controlled trial of services provided by five grantees to estimate the effects of their programs on outcomes such as skill attainment, employment, and earnings. The focus of this report is the implementation study, which examines how 49 TechHire and SWFI grantees implemented their programs and the perceived effectiveness of the strategies used.

The report describes the characteristics of TechHire and Strengthening Working Families Initiative (SWFI) grant programs participants, participation in services, training enrollment, training completion, credential receipt, and employment. It also examines how outcomes vary by participant characteristics. The data come from the Participant Individual Record Layout (PIRL).

The brief draws on data collected from virtual site visits with 18 of the 23 America’s Promise Job Driven Training (America’s Promise) grant programs as part of a comprehensive implementation study to explore the development of and services provided by regional grant partnerships involving workforce development agencies, institutions of higher education, economic development agencies, employers, and community based organizations.

In 2021, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) to fund contractor Manhattan Strategy Group to conduct a literature review on the employment impacts of training vouchers and cash transfer programs.

The literature review examined studies related to cash transfers and training voucher programs, through a search of the literature using the bibliographic databases/search engines Google Scholar, JSTOR, and ProQuest Social Science Premium and searched for terms expressing the concepts of interest: cash transfers and training vouchers, as well as specific training voucher programs identified in the search. The resources database of the National Bureau of Economic Research was also searched for additional relevant works.

The report is the first of three to present findings from the American Apprenticeship Initiative (AAI) Evaluation implementation study. This initial report primarily uses data from an online survey completed by all grantees, which documented the planning and implementation of grant-supported programs, including characteristics of grantees and their partners, strategies to engage employers, registering apprenticeship programs, identifying and recruiting apprentices, and the major components of apprenticeship programs, including related technical instruction and on-the-job learning.

View Homeless Veterans’ Reintegration Program Evaluation Addendum to this plan published in March 2024.

The report presents findings from the National Agricultural Workers Survey (NAWS), collected from face-to-face interviews with 2,586 crop workers interviewed between October 1, 2016, and September 30, 2018. It is organized into nine chapters, each beginning with a summary of the chapter’s key findings.

The report describes recent and long-term economic and policy developments with relevance for the public workforce system. This research evidence scan is one of a pair of reports developed as part of DOL’s WIOA Research Portfolio project. The companion report is A Research Evidence Scan of Key Strategies Related to the Workforce Innovation and Opportunity Act (WIOA) Report  (Deutsch et al. 2021).

Ongoing research and evaluation that produce actionable, widely disseminated evidence are central to the continuous improvement of U.S. Department of Labor (DOL) programs. In addition, the Workforce Innovation and Opportunity Act of 2014 (WIOA) requires DOL to conduct periodic, independent evaluations to inform the effective operation of WIOA programs and services. To support the development of DOL’s research portfolio, this scan examines existing evidence on key topics related to WIOA programs and services.

The report documents findings from an implementation study, describing how the Ready to Work (RTW) Partnership grantees’ programs were implemented over the full term of the grants, the institutional benefits the grantees anticipated would be sustained after the grants ended, and lessons for current workforce programs. Future reports, to be released in 2021 and 2022, will examine the impact of the four RTW programs on participants’ education and employment outcomes. Findings from this implementation study will be important in interpreting those impact results.

This brief documents findings from the Ready to Work (RTW) Partnership Grant Evaluation, describing how the grantees’ programs were implemented over the full term of the grant, the institutional benefits the grantees anticipated would be sustained after the grants ended, and lessons for current workforce programs. Future reports, to be released in 2021 and 2022, will examine the impact of the four programs on participants’ education and employment outcomes. Findings from this implementation study will be important in interpreting those impact results.

In 2017, the Chief Evaluation Office partnered with the Employment and Training Administration (ETA) to fund contractors Urban Institute, George Washington University, Capital Research Corporation, and the National Association of State Workforce Agencies to conduct an analysis of employer performance measurement approaches required by the Workforce Innovation and Opportunity Act (WIOA).

The Consolidated Appropriation Act of 2014 authorized the Performance Partnership Pilots for Disconnected Youth (P3), which provided awarded pilots the flexibility to use funding from across multiple Federal discretionary programs to support efforts to improve the systems serving youth and youth’s outcomes. The report assesses the 14 awarded pilots’ implementation of the Federal vision for P3. Findings showed that pilots took a variety of approaches to try to improve youth outcomes, which commonly included new or enhanced services.