Evaluation of EU-UNICEF Jointly funded "Improving WASH Projects"

Solomon Islands 🇸🇧

Job Number: 498850 | Vacancy Link
Location:
Work Type : Consultancy
 

Download File External TOR WASH Evaluation.docx

If you are a committed, creative professional and are passionate about making a lasting difference for children, the world’s leading children’s rights organization would like to hear from you.

For 70 years, UNICEF has been working on the ground in 190 countries and territories to promote children’s survival, protection and development. The world’s largest provider of vaccines for developing countries, UNICEF supports child health and nutrition, good water and sanitation, quality basic education for all boys and girls, and the protection of children from violence, exploitation, and AIDS. UNICEF is funded entirely by the voluntary contributions of individuals, businesses, foundations and governments.

Purpose of the Assignment:

The results of the evaluation will serve the purpose of various audiences. The primary audience and users of this evaluation are, first and foremost, the project proponents which are the EU and UNICEF multi-country office, and the implementing partner LLEE, who will use the evaluation to promote Accountability within their respective institutions, further build-up learning and education in WASH programmes, and advocate among concerned government agencies and development partners of the lessons learned from the exercise. Various branches of the government from the national to local levels are also among the primary users of the evaluation results mostly to utilize the information to make better, more-informed decisions around their own planning, policies and guidelines, implementation and service delivery, and also advocacy for WASH-related issues.

Meantime, other parties not directly involved or concerned with the project can also stand as secondary audiences and users of the evaluation report. These parties include the UNICEF East Asia and Pacific Regional Office (EAPRO) and UNICEF HQ, for which the lessons out of this work would contribute to strategic thinking around integrated approaches to WASH in the region. Major WASH donors and development agencies, likewise, would also benefit as secondary users of the report utilizing it to ensure that there are coherent approaches to WASH based on good practices, challenges and lessons learned. The findings can also be used by the donors as well as CSO’s to enhance commitment to WASH in countries by way of advocacies. (See Annex 4)

Work Schedule

The assignment is for 60 working days over a period of 3.5 months from 01 October 2016 to 15 January 2017. The consultant will provide a detailed timetable in its technical proposal, specifying the distribution of tasks and duration to complete each task. The proposed sequencing in the table below is an indicative proposal which could be improved in the technical offer. The right column indicates an estimated duration for the activity.

Activity

 Duration and Location

Phase 1: Literature Review & Preparation ( Total number of days: 14   )

  1. Literature review and consultations

8 days offsite and 6 days in Honiara

  1. Draft Inception report with proposed revised version of TOR, and revised evaluation questions, evaluation methodology, information/data collection method for each evaluation question, sampling for interviews and field visits, and development of data collection, and data analysis plan
  1. Review and feedback on inception report and evaluation questions by the Evaluation Reference Group (ERG)
  1. Finalization of inception report and evaluation questions

Phase 2 : Consultations, Analysis and Reporting ( Total number of days: 46)

  1. Data collection and field work in all project areas; Submission of field reports

28 days in Solomon Islands (Honiara, Isabel, Makira and Temotu)

18 days offsite

  1. Processing, cleaning, validation, triangulation and analysis of the collected data
  1. Preparation, presentation and review of interim report for ERG feedback
  1. Incorporate feedback and conduct validation exercise with key stakeholders
  1. Presentation of draft final evaluation findings and recommendations to key stakeholders
  1. Finalization and submission of Evaluation Report with a six page summary for publication in the newsletter or website

Total duration = 60 days

Legend:

 

Payment Milestones

   

 Deliverables/End Products with Payment Schedule

The following are the Consultant’s/Team’s Deliverables with Timelines and Payment Terms

Deliverable

Due date

Payment

Inception report with final Evaluation ToR and evaluation questions and final version after comments from Reference Group

3 weeks from contract commencement date

20% upon receipt and acknowledgement by UNICEF that the deliverable meets required standards and is of high quality

Field reports

Within 2 days from completion of field data collection

10% upon receipt and acknowledgement by UNICEF that the deliverable meets required standards and is of high quality

Interim report submission for ERG feedback

Within 1 week from UNICEF approval of field report

20 % upon receipt and acknowledgement by UNICEF that the deliverable meets required standards and is of high quality

Final evaluation report and Power Point presentation with data base of collected data

4 weeks from submission of Interim report to ERG 

50 % upon receipt and acknowledgement by UNICEF that the deliverable meets required standards and is of high quality

 Note: The assignment is for 60 working days over the period 01 October 2016 to 15 January 2017.

The final evaluation report should not exceed more than 60 pages (without the annexes) and will include at least the following:

  •  Executive Summary
  • Brief description of the program, its context , financial arrangements , areas of intervention, timing, implementation modalities and actors
  • Objectives , methodology, timing of evaluation and challenges / limitations of the analysis
  • Results in terms of relevance , efficiency, effectiveness , impact, sustainability
  • Analysis , including reflection on gender, human rights
  • Lessons learned, challenges, conclusions, recommendations, action plan
  • Annexes including list of the data with maximum disaggregation

Note: The final report needs to meet UNICEF standards on the quality of evaluation as described in the UNICEF evaluation reports quality assessment tool. More information on the quality criteria (utility, feasibility, accuracy and appropriateness) and good examples of WASH evaluation reports from other countries will be provided.

The report and all collected and produced data by the evaluation team remain the exclusive property of UNICEF.

[1] i.e. project’s influence on wider development for WASH and Health including the value of contrbutions to the RWASH policy framing EDF capacity devt at SIG or NGOs, etc

[2] Although the Theory of Change (TOC) is not expressed as a diagram in any of the project documents, the logical framework explicitly describing the results chain and mean-end relationships between different levels of results is very clear and can be used as the basis for developing a project TOC if need be for the purpose of this evaluation.

[3] Among these should be the target beneficiaries as well as some of the Evaluation audience identified in Section 2 and Annex 4

Payment Schedule:  Reimbursement of airfare upon submission of official receipt. Professional fees to be paid following payment terms specified above.

Supervisor Name and Type of Supervision that will be provided:

The Research, Evaluation, Study and Ethics Committee (RESEC)[1] of the Fiji Multi-Country Office (MCO), together with the other key stakeholders[2] of the WASH programme in Solomon Islands, will constitute the Evaluation Reference Group (ERG). The ERG, under the chairmanship of the Chief of Social Policy, Monitoring and Evaluation, will have overall management of the Evaluation, with technical, and administrative support provided by WASH, SIFO and other members as needed. The UNICEF East Asia and the Pacific Regional Office (EAPRO), particularly the EAPRO Regional Adviser WASH and the EAPRO Evaluation Adviser, will provide technical support. For the quality assurance of the key evaluation exercise, draft inception and final evaluation reports will be shared with the mentioned regional advisors and with the WASH evaluation specialist in the UNICEF Evaluation Office, to obtain their technical input and clearance before finalization of the inception and final Evaluation report.

The main roles of Evaluation Reference Group are:

  • To contribute to the design of the evaluation
  • To share available information
  • To clear the ToR and validate the evaluation questions
  • To monitor and facilitate its implementation
  • To provide comments on draft reports
  • To assist with feedback on the findings and making recommendations
  • To disseminate the results of the evaluation to all stakeholders in WASH and possibly to certain beneficiaries or their representatives.
  • To develop the Management response plan and regularly monitor follow-up actions

The consultant will be responsible for the refinement of evaluation questions as deemed appropriate, the methodology, data collection and analysis as well as the formulation of findings and conclusions containing judgments in response to the evaluation questions. Recommendations and lessons will also be included in the report.

The consultant/s should adhere to UNICEF Evaluation Policy; to UNEG’s ethical guidelines for UN evaluations; to UNEG’s code of conduct for evaluation and to UNICEF Reporting Standards.

Consultant’s Work Plan and Official Travel Involved:

The consultant is required to make his/her own return travel arrangements from Place of recruitment-Duty Station-Place of recruitment on the most direct route and economical class.  Travel costs will be reimbursed to the consultant upon submission of invoice and travel documents.

All related (internal/external) official travel of the consultancy will be organized by the consultant and costs reimbursed accordingly.

The consultant is also required to organize his own visa to the duty station – UNICEF will provide a support letter to assist with visa approval.

Consultant’s Work Place and Work Arrangements:

  • 60 working days (60 person-days) over the period of 01 October 2016 to 15 January 2017
  • The evaluator will be provided a working desk in the UNICEF office while in Honiara, Solomon Islands. The evaluator will use his /her own laptop for the assignment.
  • UNICEF WASH and Solomon Islands Field Office (SIFO) will facilitate the arrangement of meetings and workshops with partners as required and will provide logistic and financial support as necessary.
  • The evaluator is expected to undertake field trips to selected project locations in the target provinces. UNICEF will cover the following to facilitate the field visits:
  • Provide a land and water transportation for field mobilization;

  • Provide standard monthly living allowance;

  • Provider translator /interpreter to support field work (national consultant NOA level), especially the discussion with partners and relevant community groups.

Qualifications or Specialized Knowledge/Experience Required: 

The evaluation will be conducted by an individual with the following minimum qualifications:

Qualifications

  • Training and experience in the field related to water, sanitation and hygiene with academic qualifications (at least a Master’s degree) in civil engineering, mechanical engineering, sanitary engineering, social sciences or combination of it;
  • Familiarity with cross-cutting issues (e.g. gender equality, equity and human rights, including child rights) and how they relate to the WASH results and equity agenda;
  • Strong analytical skills including ability to conduct quantitative data analysis to demonstrate attribution/impact (as applicable) and background on WASH sector information and data;

Experience

  • At least 10 years of professional experience in planning, implementation, management, monitoring and evaluation of integrated water, sanitation and hygiene programmes in developing countries;
  • Proven experience with similar programme evaluations in the WASH sector in developing countries, preferably for the fields of WASH in school, hygiene behavior change approaches including CLTS (Community-Led Total Sanitation), and community interventions;
  • Proven experience for EU project evaluations is an asset;

Languages

  • Excellent communication and report writing skills in English;

Competencies

Ability to work independently;

  • Commitments to deliver the final products in line with the set TOR within the agreed timeline.

[1] RESEC membership is composed of one representative from each section and chaired by the Chief of Social Policy, Monitoring & Evaluation

[2] This includes at least 1 member each from RWSS-MHMS, Ministry of Health and Ministry of Education and the donor, EU. The membership of these non-UNICEF stakeholders will contribute to ensuring ownership to the evaluation exercise.

To view our competency framework, please click here

Please indicate your ability, availability and daily/monthly rate (in US$) to undertake the terms of reference above (including travel and daily subsistence allowance, if applicable).  Applications submitted without a daily/monthly rate will not be considered.

UNICEF is committed to diversity and inclusion within its workforce, and encourages qualified female and male candidates from all national, religious and ethnic backgrounds, including persons living with disabilities, to apply to become a part of our organisation.


Opening Date 30 Aug 2016 Central Pacific Standard Time
Closing Date 14 Sep 2016 Central Pacific Standard Time


POSITION TYPE

ORGANIZATION TYPE

EXPERIENCE-LEVEL

DEGREE REQUIRED