CEO Library

In 2017, the Chief Evaluation Office (CEO) partnered with the Employee Benefits Security Administration (EBSA) and funded contractor Summit Consulting to conduct An Analysis of Benefit Plans Auditors under the Administrative Data Research and Analysis portfolio of studies. The statistical analysis aims to analyze trends in employee benefit plan audit quality, particularly when plan administrators change certified public accountant (CPA) firms.

The report presents findings from a trend analysis of benefit plan auditors using 5500 filing data and audit reviews conducted by Employee Benefits Security Administration (EBSA) between plan years 2011 and 2015. EBSA administers and enforces the reporting, disclosure, and fiduciary requirements of Title I of the Employee Retirement Income Security Act of 1974 (ERISA). EBSA’s Office of the Chief Accountant, Division of Accounting Services enforces annual audit requirements of employee benefit plans.

The U.S. Department of Labor (DOL) conducted a rigorous impact evaluation of the Job Corps program in the 1990s. The original National Job Corps Study was a large scale random assignment evaluation to examine program impacts on participants’ employment related outcomes. The design involved the random assignment of all eligible applicants nationwide between 1994 and early 1996 to a program or control group. The study participants are now between the ages of 38 and 46.

Appendices to the National Job Corps Study: 20-Year Follow-Up Study Using Tax Data Final Report. Appendix A presents additional tables of impact results referenced in the main report. Appendix B presents additional details on the tax data, the construction of outcome variables, and analytic methods used to estimate the impacts and interpret them.

In 2018, the Chief Evaluation Office (CEO) partnered with the Office of Workers’ Compensation Programs (OWCP) and funded contractor Summit Consulting to conduct Return-to-Work Outcomes for Federal Employees in the Office of Workers’ Compensation Disability Management Program under the Administrative Data Research and Analysis portfolio of studies.

The report provides descriptive statistics and associations between case characteristics (injury, claim, and claimant characteristics) and the outcomes of interest (return-to-work and disability management duration). Process diagrams and survival models complement the descriptive statistics. This report also assesses the similarities and differences in return-to-work rates and duration in disability management across case characteristics and timing and sequence of disability management services.

The report presents findings on plan filings of Form 5500 using data from 2000 to 2016. The Employee Benefits Security Administration (EBSA) administers and enforces the reporting, disclosure, and fiduciary requirements of Title I of the Employee Retirement Income Security Act of 1974. Each year, employee benefit plans are required to submit Form 5500 to EBSA to report information about the plan. Form 5500 captures important employee benefit plan information on plan type, plan administration, and plan benefits.

In 2017, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) and funded contractor Mathematica Policy Research to conduct Data on Earnings: A Review of Resources for Research and Comparing Job Training Impact Estimates Using Survey and Administrative Data under the Administrative Data Research and Analysis portfolio of studies. The descriptive analyses aim to review potential opportunities and implications of using different

On October 1, 2012, the Office of Workers’ Compensation Programs (OWCP) introduced two new requirements for all cases within the Federal Employees’ Compensation Program (FECP). The first requirement is that within 28 days of the start of a worker’s participation in FECP disability management, OWCP must assign a field nurse to the case. The second requirement is that, for workers determined to be “totally disabled,” a second opinion evaluation is necessary if the case remains unresolved after 12 months.

The report documents and explores the strengths and drawbacks of data sources commonly used to produce impact estimates for evaluations of workforce development programs. Specifically, researchers use information from the Workforce Investment Act (WIA) Adult and Dislocated Worker Programs Gold Standard Evaluation to examine three data sources used to evaluate the impacts of access to services provided by the public workforce system’s Adult and Dislocated Worker programs, two of the largest, publicly-funded workforce development programs in the nation.

Earnings are a key outcome in evaluating the impact of job training and other employment- oriented assistance programs. Adequate and sustained earnings provide a reliable measure of success for these interventions and contribute to other positive outcomes as well. Accordingly, high quality data on the income earned from employment—including self-employment—are an essential component of any analysis that seeks to understand the consequences of participating in an employment-assistance program.

As part of its mission to combat child labor, the U.S. Department of Labor’s Office of Child Labor, Forced Labor, and Human Trafficking (OCFT) provides grants to support the work of organizations around the world that implement projects to keep children out of the child labor (referred to as OCFT grantees). Some OCFT grantees gather data to estimate, both before and after project implementation, the prevalence of child labor in the areas that they serve.

This study includes a systematic review of existing evidence on the intersection of the opioid epidemic and workers’ compensation programs administered by public and private payers. The study will analyze existing evidence and identify innovative interventions and initiatives that may be relevant to the Federal Employees’ Compensation Act (FECA) client/customer population, and will develop research and evaluation design options for generating new evidence in the field.

In 2018, the Chief Evaluation Office (CEO) funded Mathematica Policy Research to conduct Data on Earnings: A Review of Resources for Research under the Administrative Data Research and Analysis portfolio of studies. This secondary data review describes data sources on wages and earnings that may be used by researchers who wish to incorporate reports of earned income in their analyses but original data collection is not feasible.

In 2017, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) and funded Mathematica Policy Research to conduct the Comparing Job Training Impact Estimates using Survey and Administrative Data study under the Administrative Data Research and Analysis portfolio of studies.

In 2017, the Chief Evaluation Office (CEO) partnered with the Employee Benefits Security Administration (EBSA) and funded contractor Summit Consulting LLC to conduct the Form 5500 Schedule A Data Analysis. under the Administrative Data Research and Analysis portfolio of studies.

In 2017, the Chief Evaluation Office (CEO) partnered with the Employee Benefits Security Administration (EBSA) and funded contractor Summit Consulting to conduct the Form 5500 Filing Patterns Analysis under the Administrative Data Research and Analysis portfolio of studies. The statistical analyses aim to better understand why employee benefit plans stop filing Form 5500s. Researchers used data from 2000 to 2016 to conduct two filing pattern-related analyses.

In 2016, the Department of Labor (DOL) Chief Evaluation Office (CEO) partnered with the Office of Child Labor, Forced Labor, and Human Trafficking (OCFT) in the Bureau of International Labor Affairs (ILAB), and funded contractor Mathematica to develop Resources for Quantitative Surveys on Child Labor under the Administrative Data Research and Analysis portfolio of studies.

Assuring that all workers in the United States have safe and healthful working conditions is the mission of the U.S. Department of Labor’s (DOL) Occupational Safety and Health Administration (OSHA). The Site-Specific Targeting (SST) program, a planned inspection program managed by OSHA, aims to improve health and safety of workplaces under OSHA's jurisdiction by targeting enforcement actions on establishments with historically high injury and illness rates.

In 2016, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) to fund contractors Westat and MDRC to conduct an implementation study and randomized controlled trial (RCT) impact study of the H-1B-funded TechHire Partnership Grants (TechHire) and the Strengthening Working Families Initiative (SWFI). The Department of Labor awarded funds for both of these programs in September 2016.

The report of a study first to examine the Occupational Safety and Health Administration’s (OSHA’s) Federal Agency Targeting (FEDTARG) inspection program. Under the FEDTARG program, OSHA targets Federal worksites that have high lost time case (LTC) counts. The goal of the program is to reduce hazards, injuries and illnesses, and the costs associated with injuries and illnesses in Federal worksites.

The Chief Evaluation Office (CEO) works with other Department of Labor (DOL) agencies to conduct Administrative Data Research and Analysis (ADRA) studies. The various studies aim to examine administrative data sets from agencies within DOL and other federal agencies to provide timely responses to changing strategic agency priorities. Completed studies are listed below. New and ongoing studies will occur regularly.

In 2015, the Chief Evaluation Office (CEO) partnered with the Occupational Safety and Health Administration (OSHA) and funded Summit Consulting LLC to conduct the Federal Agency Targeting Inspection (FEDTARG) Program Study under the Administrative Data Research and Analysis portfolio of studies. The outcome evaluation aims to better understand activities, outputs, and outcomes of the FEDTARG program from fiscal year (FY) 2008 through FY 2013.

The report describes a study that uses administrative data from the Office of Federal Contract Compliance Programs (OFCCP) on reviews of federal contractors that closed between fiscal years 2003 and 2012 to examine trends in, and factors associated with, violations and re-violations of equal employment opportunity laws and the effectiveness of remedies and press releases to deter re-violations.

The brief presents high-level findings from the Using Administrative Data to Address Federal Contractor Violations of Equal Employment Opportunity Laws Final Report.