< Back to Search Results
Release Date:
February 01, 2020
Evaluation of Impacts of the Reemployment and Eligibility Assessment (REA) Program Impact Methodological Insights Impact Study Brief
Related Tags
Topic
Research Methods
Study Population
DOL Partner Agency
U.S. Regions
Midwest (IA, IL, IN, MI, MN, ND, NE, OH, SD, WI)
,
New York – New Jersey (PR, U.S. Virgin Islands, NY, NJ)
,
West (AK, AZ, CA, HI, ID, NV, OR, WA)
U.S. States
Country
About the Brief
The brief describes methodological lessons from Evaluation of the Reemployment and Eligibility Assessment (REA) Program impact study that may inform future evaluations of reemployment interventions.
Key Takeaways
- At the highest level, the REA impact study offers three inter-related methodological insights:
- First, such studies—with very large samples, using only administrative data, involving multiple states—are feasible. A “no survey” design kept costs relatively low, despite enormous samples.
- Second, such studies have the potential to yield multiple, major, and program-relevant insights: relatively precise estimates of program impacts, estimates of how impacts vary across UI claimants, formal evidence on the role of various pathways or program components in achieving those impacts, and insights into which states see larger impacts and why.
- Third, though feasible, such studies are challenging. Understanding the role of program components required designing and implementing new program models and combining several states in a single evaluation to achieve sufficiently large sample sizes. Successfully inserting randomization into large, ongoing programs required multiple rounds of testing. Doing these things well also raised evaluation, management, reporting, and contractual issues. The REA Impact Study benefited from both program and evaluation technical assistance to think through the issues. Together the study’s strategy led to the successful completion of one of the largest evaluations of an American social program ever conducted.
Citation
Klerman, J.A., Saunders, C. (2020). Abt Associates. REA Impact Study Briefs: Methodological Insights. Chief Evaluation Office, U.S. Department of Labor.
Download Brief View Study Profile
The Department of Labor’s (DOL) Chief Evaluation Office (CEO) sponsors independent evaluations and research, primarily conducted by external, third-party contractors in accordance with the Department of Labor Evaluation Policy and CEO’s research development process.