Evaluation Learnings Search

Learning Description

Political stability is not without its own risks: Whereas political instability creates obvious risks, political stability and a positive atmosphere of change also bring their own challenges: that of a multitude of new actors and uncoordinated donor actions absorbing government and civil society staff time, likely causing delays in the implementation of already established projects and programs.

Learning Description

Research may take a longer time than expected: Although the research is relevant and can be characterized as “emerging good practices” of the project, it may not be a good idea to make other project actions dependent on the research. For example, the reggae music video animation produced for awareness raising is waiting for data from the Labor Force Survey, which is not yet released by the government. Actions should, to the extent possible, be independent (especially as regards research that must be vetted) so that other actions can move ahead while waiting for government vetting (or other clearance) for research. Also, research is frequently taking longer than expected, as the design and implementation may have to be reviewed after a pilot test.

Learning Description

Research designs should consider providing services for the control population and/or others involved in the research: Research designs using a control group may be useful for evaluating impact. However, it may also be frustrating for the control group, as interviewees give up their time without receiving anything. Providing a service package at the end of the research may be a good way of thanking them for their help, and also avoiding frustration. For those involved in research in non-pilot areas (i.e. research just for research’s sake), small incentives may make the research population more interested in participating (this is not necessary or possible for large-scale surveys). For research conducted in areas where the project will implement activities, it is important to make the stakeholders aware about the service or project activity to be implemented, as well as the timing for such activities. This will avoid confusion and build understanding about the research project. It could also be part of the awareness raising process.

Learning Description

Two-stage, data-driven project design is logical but not always the best choice: The two-stage design, with research, awareness raising, legal and policy support and capacity building during the first stage followed by the implementation of direct services, is rational and consistent with a data-driven implementation process. However, having a lot of research data is not necessary in order to start a number of activities: a rapid qualitative assessment can lay the groundwork for pilot actions that can be further refined as research data trickle in. The project improved the project design through implementing a micro-pilot project that proved very useful to plan the “main” pilot, and this latter is taking place during the project’s second stage.

Learning Description

A wide range of research and implementation areas create a “rich” project at the risk of losing focus: The project has established research on a wide range of child labor sectors, and is involved in both urban and rural areas, as well as with ethnic groups. It deals with everything from reggae music (videos created for awareness raising) to high-level advocacy and legal support, to packaging for the homemade medicinal balm for sale in small markets. This variety can be seen as a strength with regard to gaining information and data on a wide variety of child labor issues, and for building a “library” of research data and analysis. However, this diversity comes at the cost of lesser focus. For a first child labor initiative in the country, this broad approach may be a good way of creating initial information, as long as the implementing institution and other stakeholders including the government are able to capitalize on the research. For future projects, a more focused approach concentrating on one child labor sector should be considered.

Learning Description

For direct services, frequent project presence is important: The messy school buildings in Panambon Village demonstrated the importance of direct follow-up from the project, even during school holidays. Also, it showed that in some cases, the provision of supplies and materials comes secondary to building awareness about the value of school. The project has already acted on this lesson learned: the valuation of the micro-project foresees a stronger focus on education for the second stage pilot initiatives.

Learning Description

For microcredit projects, provision of initial capital by the project may not always be a good way to ensure ownership: When community members’ savings are at stake for microcredit projects, the loans and reimbursements are usually based on a careful evaluation of the borrower’s capability to pay it back. Also, this latter feels compelled to pay back on time, as the amount “belongs” to someone. The ownership of project capital is much more theoretical, and may lead to borrowers taking ownership of it instead of the microcredit association. It is important for the project to follow up on reimbursements in June in order to assess the future direction of similar components.

Learning Description

An organization with experience and multiple projects in a specific field (and country) may be more effective than an organization starting up in that country: The project’s cost effectiveness is further enhanced ILO’s in-country experience, status, ability to draw on resources (legal, programming…) from the Bangkok Regional office and Headquarters in Geneva, and its interproject coordination.

Learning Description

Awareness raising and research are activities that may benefit from the implementer’s standing: For these activities it is important to use implementation organizations that produce research that has respectability in terms of data validity and robustness of analysis. Otherwise, research may be produced but not used. For awareness raising, a similar concern could be raised about the origin of the message in an information-rich environment. ILO is a respected name in this regard, and the strategy of the project is building on ILO’s strength, which is enhancing costeffectiveness.

Learning Description

Policy and legal support may be inherently sustainable: Actions that help improve the country’s laws and policies are likely to be effective for a long time, and thus remain inherently sustainable actions. The challenge is to make high-level legal and policy changes “trickle down” to implementation level.