Evaluation Learnings Search

Learning Description

Learning process. The project has promoted a ‘learning-by-doing’ approach, not just for the capacity development of the partner non-governmental organizations, but also for the project delivery. The curriculum and content of the three main training programs (one from each technical partner) was piloted through training provided to the two partner non-governmental organizations based close to Kathmandu. Staff of the other technical partners also participated and provided feedback. The training materials were revised, including extending the duration, prior to rolling out the training to the main bulk of partner non-governmental organizations.

Learning Description

Early completion of training manual. Training manuals and guidelines, at least in usable draft form, were prepared early in the project, enabling them to be used during implementation rather than just being a project product.

Learning Description

Provision of support to municipalities managed through a single organization. The technical expertise for each of the three outcomes has come from three different specialist organizations providing training and support. Due to the role of the partner non-governmental organizations, with a single non-governmental organizations for each municipality, there has been a single focal point for the development of ‘Round Table’ meetings and action plans and for the provision of services to the municipality. The evaluation was not able to verify what effect this had on the municipalities, but it is expected that this made it simpler for them to engage with the support from the three technical providers.

Learning Description

Localized evidence-based information as an effective basis for engagement with local governments. The partner non-governmental organizations carried out systematic child labor identification within specific wards and municipality areas which they then presented to the municipality administration. This localized data provided a basis for advocacy to the municipality and other stakeholders to recognize the situation and to make appropriate plans to address it.

Learning Description

Working with very local existing community-based organizations. The partner non-governmental organizations had networks with very local community-based organizations (youth groups, women’s groups, school management committees, etc.). This enabled them to have a reach into specific communities. Most of the research work was carried out by members of these community-based organizations. Social and behavior change communication was implemented with their assistance and care, and referral activities were able to benefit from the participation of community-based organization members.

Learning Description

It is critical to match training content to the experience and skill level of participants. To meet the needs of stakeholder staff, the project offered workshops that were more theoretical and geared toward technical staff and an accredited certificate courses that were more practical to meet the needs of a more general group of stakeholders. The project also made a midcourse correction where it consulted training graduates to ascertain suggestions to adjust future training. Nevertheless, training participants opined that there was a mismatch between training content and the experience and skill levels of the participants. Some technical staff thought the training content was too basic to meet their needs while others thought the content was too advanced. To ensure that learning and its application is maximized, it is important to assess the experience and skill level of participants (i.e., training diagnostic) and ensure that training content meets participant needs.

Learning Description

It is important to adjust training schedules to accommodate the work responsibilities of participants and ensure maximum attendance and participation. The project transitioned from face-to-face training to remote training to avoid COVID-19 infections. For many participants, the scheduling created conflict with on-going job responsibilities because the number of hours per day and the number of days per week required for the training were too many. Fewer hours per day and fewer days per week would have been more effective. Also, offering training session during non-peak business hours, such as mid-morning and early afternoon, would have been more convenient. Based on a midterm evaluation recommendation, the project started to record training sessions and make them available online to participants who could not attend. This is another option that future projects might consider when participant work responsibilities conflict with training schedules.

Learning Description

Establishment surveys require trusted actors such as business associations to coordinate the survey and follow-up with establishments to ensure acceptable questionnaire response rates. As documented in the funding opportunity announcement and project document, there exists a mistrust between the public and private sectors in the project countries. In the past, this mistrust has impeded the willingness of businesses to participate in surveys conducted by government institutions. The project involved the main business associations of each sector to explain the purpose of the survey to its members and encourage them to fill out the questionnaire, which significantly increased the survey response rate.

Learning Description

Institutional limitations, especially the lack of financial resources, reduce the chances of sustaining key outputs and outcomes. The likelihood of sustaining key project outputs including the establishment surveys, advanced sampling methodologies, electronic data collection systems, and labor market information capacity building (workshops and certificate courses) is considered low or medium-low due primarily to a lack of financial resources or political willingness. In all three countries, labor market information institutions do not have the resources in their budgets to sustain these outputs. In Guatemala, a lack of political willingness seems to be the main reason that advanced sampling methodologies will not be sustained.

Learning Description

The project’s performance indicators did not entirely capture the achievement of the outcomes. The project developed a set of performance indicators to measure the achievement of the outcomes. The U.S. Department of Labor's Bureau of International Labor Affairs approved the indicators. However, the indicators did not measure all of the dimensions of the outcome statements. For example, while Outcome 1 includes seven indicators that reflect the project’s outputs (revised household surveys, establishment surveys, etc.) It is not clear whether governments are publishing reliable, comprehensive, and current labor market information in user-friendly formats for the general public and professional audiences (Outcome 1).