America’s Promise Job-Driven Grant Program Evaluation
Related Tags
Topic
Research Methods
Study Population
DOL Partner Agency
Country
About the Study
In 2017, the DOL’s Chief Evaluation Office (CEO), in collaboration with the Employment and Training Administration (ETA), funded contractor Mathematica to conduct an implementation and impact evaluation of the America’s Promise grant program. The implementation study examines how the 23 grantee organizations implemented their programs between 2016 and 2020. Early findings on how the grantees’ sector training strategies were affected by the onset of the COVID-19 pandemic were released in 2021. Final findings from the evaluation’s impact study are anticipated later in 2023. This evaluation adds to the growing evidence base about how career pathways and related sector-based training programs and regional partnership strategies meet employers’ needs and prepare American workers for middle- and high-skilled jobs.
The America’s Promise implementation evaluation included the collection of qualitative data from a variety of sources — including virtual site visits, phone interviews with grant representatives and employer partners, focus groups with America’s Promise participants, a grantee survey, and a partner network survey — and analysis of grantees’ performance data from the Workforce Integrated Performance System (WIPS). Researchers used these data to identify the approaches taken by America’s Promise grantees to strengthen or establish regional partnerships and provide assistance to unemployed and underemployed individuals, as described in the final report. Additional reports include an evaluation design pre-specification plan, a data-use agreement toolkit, and three short issue briefs. The issue briefs describe in-depth findings from interviews conducted with a large number of employer representatives (31) as well as the survey administered across the 23 grantee sites. Finally, a short paper examines the outcomes of America’s Promise participants by gender after the onset of the COVID-19 pandemic.
This DOL-funded study was a result of the annual process to determine the department’s research priorities for the upcoming year. It contributes to the labor evidence-base to inform employment and training programs and policies and addresses Departmental strategic goals and priorities.
- What impact does America's Promise and/or its components have on the outcomes of participants including obtaining: education/training (including tuition-free education); industry-recognized credentials and degrees; relevant skills with job market value; employment and earnings; and employment or advancement within H1-B industries?
- What are the characteristics of the program participants? To what extent do impacts vary across selected subpopulations?
- How were regional workforce systems and partnerships built and maintained, including employer engagement in sector strategies and aligning federal resources? What factors influenced the development and maintenance of the systems and partnerships over time?
- What are the types and combinations of services and approaches provided? How were the components operationalized and the program implemented? What implementation practices appear promising for replication?
- The Impact of Regional Sectoral Training Partnerships: Findings from America’s Promise (Final Outcomes and Impact Report, October 2023)
- Employment Research Brief: The Impact of Regional Sectoral Training Partnerships: Findings from America’s Promise (Employment Research Brief, October 2023)
- Creating and Expanding Regional Workforce Partnerships for Skill H1-B Industries and Occupations: Implementation of America’s Promise Job-Driven Training Grants (Final Implementation Study Report, December 2022)
- Employer Perspectives on Regional Workforce Partnerships: Lessons from America’s Promise (Issue Brief, December 2022)
- Employer Engagement Strategies in Regional Partnerships: Lessons from America’s Promise (Issue Brief, December 2022)
- Experiences of America’s Promise Participants During the “Shecession”: Examining Gender Differences in Labor Market and Training Program Outcomes (Short Paper, December 2022)
- DOL Evaluation Design Pre-Specification Plan: America’s Promise Job Driven Grant Program Evaluation (Design Pre-Specification Plan, December 2022)
- Technical Appendix for Experiences of America’s Promise Participants During the “COVID-19 Recession”: Examining Gender Differences in Labor Market and Training Program Outcomes (Technical Appendix, December 2022)
- Obtaining Administrative Data for DOL Research and Evaluations, Insights from Employment and Training Research (Toolkit, December 2022)
- Sector Training Strategies During the COVID-19 Pandemic: Issue Brief – Lessons from the America’s Promise Partnerships (Issue Brief, October 2021)
- Adapting Sector Training Strategies During the COVID-19 Pandemic: Lessons from America's Promise Webinar (February 2021)
- H-1B America's Promise Data-Driven Decision Making: Using Data for Strategic Planning (Webinar, April 2019)
- Building Evidence: The America’s Promise Job-Driven Grant Program Evaluation (Webinar, September 2017)
Project Duration: 87 Months
Contract End Date: September 2024
Contractor: Mathematica Policy Research and Social Policy Research Associates
For More Information: ChiefEvaluationOffice@dol.gov
The Department of Labor’s (DOL) Chief Evaluation Office (CEO) sponsors independent evaluations and research, primarily conducted by external, third-party contractors in accordance with the Department of Labor Evaluation Policy and CEO’s research development process.