Evaluator, Consultant at IOM

Evaluation purpose

The purpose of the evaluation is to look at the project’s performance and achievements, to identify best practices and aspects that could be improved in similar projects currently implemented by IOM, as well as lessons learned to be taking into consideration during the designing and implementation of the projects aimed at provision of livelihood opportunities. IOM senior management and IOM project, procurement and finance teams in the Mission will use the evaluation to better understand the effectiveness, efficiency and relevance of the project, along with impact on beneficiaries and sustainability prospects, and help develop interventions for providing further necessary assistance for IDPs and other conflict affected population. Moreover, the findings of the evaluation will be shared with the donor, Government of Germany, to assess value for money for the funded activities.

Evaluation scope

The final evaluation will cover the period of 22 December 2018 – 21 June 2020. The interviews with the project implementer (IOM), project partners (Ministry of Internal Affairs, Ministry of Social Policy, Ministry of Veterans Affairs), beneficiaries (veterans of conflict in eastern Ukraine, IDPs, host community members) and stakeholders (government agencies, local communities and institutions) will take place in Kyiv, Lviv, and Dnipropetrovsk regions.

Evaluation criteria

The evaluation will use the following main OECD-DAC criteria: relevance, effectiveness, efficiency, impact, coherence and sustainability. In addition, this evaluation will consider cross-cutting issues of gender and human rights. All listed criteria are equally relevant and important within final evaluation of the project implementation. The list of questions is included below:

Evaluation questions

Relevance:

• Is the project aligned with and supportive of IOM national, regional, and global strategies and the Migration Governance Framework?
• Is the project aligned with and supportive of national strategies?
• Is the project in line with donor priorities?
• To what extent does the project remain valid and pertinent in the current context?

Effectiveness:

• Were the activities sufficiently well-defined and implemented in order to reach relevant results? If results are not reached, would a different set of activities have produced the results?
• What would you change, if anything, to enhance effectiveness in future projects?

Efficiency:

• Were the project resources (time, funds, human resources) managed appropriately?
• What would you change, if anything, in the project design/implementation in future projects?

Impact:

• What changes can be observed in the target population/key stakeholders/community?
• What, if anything, in your opinion, has already or is likely to hamper impact? How could impact be maximised in the future?

Coherence:

• Were project activities coordinated with other actors?
• Were there any synergies and interlinkages between the project activities and other interventions carried out by local institutions/government agencies?

Sustainability:

• Are results obtained sufficient to draw any conclusion on the sustainability of the project activities? This should include the following sub-questions:
  • Do the target group have any plans to continue making use of in-kind support provided within the project framework?
  • Are some activities already on-going without support from the project/programme?
  • Do the project partners have the financial and technical capacity and are they committed to maintaining benefits of the project in long run?
• What should be done in order to guarantee the sustainability, if necessary?

Cross-cutting issues of gender and human rights:

• Was gender equality taken into account and included throughout the project implementation (design, implementation and monitoring)? How was it done? If not, why not?
• Did the project activities promote sustainable changes in the area of Gender Mainstreaming (GM) and Gender Equality (GE)? How?

Evaluation methodology

The final evaluation should be conducted in line with IOM standard M&E methodology and procedures as outlined in the IOM Project Handbook, consisting of three main stages:

1. Desk review – project documents, interim report and updates to the donor, key outputs to date, monitoring database and other relevant documents;
2. Proceed with data collection among the community members, project stakeholders, local authorities, livelihood beneficiaries, MHPSS workers, members of the Community Support Groups (CSG) and project staff through virtual/e-communication tools[1]; and
3. Synthesis Phase in which the results are compiled into the evaluation report, along with an accompanying learning brief to summarize the main findings and recommendations.

The evaluation must be conducted considering IOM Data Protection Principles, United Nations Evaluation Group (UNEG) norms and standards for evaluation and other relevant ethical guidelines for conducting evaluations (UNEG).

Evaluation deliverables

1) Inception report with an evaluation matrix and a draft interview guide, along with any other needed data collection tools, to describe the evaluator’s understanding of the TOR and how he/she will conduct the evaluation used including any revisions to the methodology. This should be submitted to the Project Manager, for comments and discussion, to finalize plans prior to the field visit;

2) Presentation of preliminary findings and discussion of these with the project team, draft evaluation report to be shared for Project Manager’s feedback;

3) Once comments received are addressed, the final evaluation report that includes an executive summary, list of acronyms, introduction, evaluation context and purpose, evaluation framework and methodology, findings, conclusions, and recommendations should be submitted to IOM. The length of the final evaluation report should be 20-30 pages excluding annexes; and

4) Together with the final evaluation report a two-page Evaluation Brief with key findings, conclusions and recommendations should be provided. IOM will provide a template as guidance, which can be adapted by the evaluator, but which should be no longer than two pages. Page one should include: Identification of audience at start of the brief; Project information (project title, countries covered, project type and code, project duration, project period, donor(s), and budget); Evaluation background (purpose, team, timeframe, type of evaluation, and methodology); Brief description of the project. Page two should summarize the evaluation results: Key findings and/or conclusions, best practices and lessons learned (optional), and key recommendations.

All deliverables are to be written in English and meet good language standards. The final report should meet the standards laid out in the UNEG Quality Checklist for Evaluation Reports.

[1] In case restrictions will be lifted, the site visits might be conducted.

For more information on the requirements, please visit our website: http://iom.org.ua/en/vacancies

Call for consultants

The external evaluator should meet the following requirements:

• Advanced degree in a relevant field such as social sciences or statistics is required.
• Minimum of five years of experience conducting evaluations is required.
• Experience in the country or region, in community stabilization and livelihoods is preferred.
• Skills in evaluation design, qualitative data collection and analysis, drafting and editing in English, communication, time management and cultural sensitivity are required.

Interested external evaluators are invited to submit the following application materials, referring to this advertisement in the subject line of your message:

• CV of the evaluator;
• Proposal outlining the proposed methodology for the evaluation including data collection and analysis techniques, quality control measures, and timelines;
• Proposed all-inclusive budget for the evaluation, to include expert fees all other expenses to be incurred.

Any questions should be addressed to the e-mail mentioned above.

The deadline for applications is May 11, 2020.

2020-04-24T14:45:01.000 2020-05-11T23:59:59.000 Full time / Повна зайнятість TELECOMMUTE Ukraine IOM