Terms of Reference
Consultancy to conduct an evaluation of an Integrated Health, Nutrition, WASH, and Pastoral Food Security and Livelihood program in Somalia
Duty station: Nairobi with travel to Somalia
Duration of contract: 1 month
Mercy-USA for Aid and Development seeks to hire a consultant with the core responsibilities of conducting a Program Evaluation for the Integrated Health, Nutrition, WASH, and Pastoral Food Security and Livelihood program in Elwak district in Gedo region; and Mahaas, Jalalaqsi and Buloburte District in Hiraan Region, South –Central zone, Somalia. The consultant will report directly to the Mercy-USA Program Manager, and Monitoring and Evaluation Co-ordinator. The consultant will also work in close consultation with other relevant Program staff.
To improve the quality of life and build household resilience for vulnerable populations in Somalia through improved pastoral livelihoods, water and sanitation practices, and lifesaving nutrition and health services.
The main responsibility of the consultant will be to conduct an end of project evaluation of the ongoing projects and specifically, the consultant will look into the following:
1.1. Relevance and appropriateness:
• To what extent were the selected strategies relevant and appropriate to the needs of the targeted beneficiaries?
• To what extent the project has taken into account people’s different needs according to age, gender and culture?
• Was the targeting criteria communicated and understood by all members within the community?
• To what extent were target communities involved in the needs assessment, design, and implementation of the project?
• Was the methodology used for the beneficiary selection appropriate and were communities involved in the process?
1.2. Quality and Effectiveness
• Did the project achieve what it set out to do?
• Were humanitarian standards met and humanitarian principles followed? (Sphere, HAP, Codes of conduct)?
• Were the interventions timely, appropriate and cost effective? Were the operational systems put in place effective in ensuring this?
• To what extent have the interventions contributed to improve the condition of targeted communities?
• How satisfied are the communities with the project?
• How well did the project mainstream/integrate gender, equality, protection, disaster risk reduction (DRR), capacity building and conflict/cultural sensitivities?
• Were the needs assessments, monitoring, evaluation systems and associated indicators appropriate?
• Did the responses contribute to reduce future vulnerabilities?
• To what extent were resources used efficiently to produce the intended outputs?
• How well were resources invested to efficiently achieve the intended results?
• What were the intended and unintended impacts of the action of the project?
• To what extent were the beneficiaries able to adapt and maintain the knowledge acquired without further assistance?
The methodology will be developed in detail by the consultants and the evaluation will require methods such as, but not limited to, review of key documentation and programme data, household surveys, semi-structured interviews and focus group discussions. The evaluation should be rigorous, with data sources triangulated to ensure accuracy; the evaluation should also be comprehensive, using both quantitative and qualitative data. Findings and conclusions should be presented clear and concisely. The evaluation is expected to refer to international standards and benchmarks of good practice in the areas of intervention. The evaluation will take place in the following phases:
• Secondary data review, with a thorough examination of available secondary documentation;
• Field visits to project sites and collection of primary information (quantitative and qualitative) including detailed discussions with a sample of target beneficiaries. This process should be participatory to the extent possible;
• Presentation and validation of draft findings with stakeholders;
• Writing of a final detailed report and submission for review;
• Incorporation of feedback in the draft report and submission of the final report;
- Final methodology and tools
- Draft report
- Pictures and data sets
- External Final report (data set for quantitative and qualitative data attached)
- Minutes of the debrief meetings with programme and management staff
- Health/ Nutrition background with 3 years working experience.
- At least three years of hands on experience in conducting assessments, mid term reviews and evaluations. Experience as team-leader in project evaluations/mid-term reviews is essential
- Familiar with issues related to food security and WASH; experience in integrated evaluations is a plus.
- Good working knowledge of at least one statistical software package (Epi Info, Stata, SPSS, etc.), Excel and other MS-Office tools is necessary
- Knowledge of and familiarity with different qualitative and quantitative monitoring and evaluation tools and techniques. Strong knowledge and experience in survey design, implementation of surveys and statistical data analysis is required.
- Experience in the use of participatory appraisal techniques in data collection.
- Experience in developing and implementing gender sensitive evaluation methodologies
- Ability to assess/review critically the project activities and results.
- Strong presentation and reporting skills
- Knowledge of Somali language is a bonus
- Experience working with USAID grants funded projects and familiar with USAID protocol, procedures and policies.
Evaluator/s will make clear to all participating stakeholders that they are under no obligation to participate in the evaluation study. All participants will be assured that there will be no negative consequences if they choose not to participate. Evaluator/s will obtain informed consent from the participants. In case if evaluation team does not understand participants’ first language, they will be along with an interpreter/s. Evaluation team will have to receive prior permission for taking and use of visual still/ moving images for specific purposes, i.e., ‘for evaluation report and presentations. Evaluator/s will assure the participants’ anonymity and confidentiality and will ensure the visual data is protected and used for agreed purpose only.
Interested consultants should send their expression of interest including following documentation to Human resource [email protected] and copy [email protected] and [email protected] by the deadline of 16th September 2016
• Cover letter including details of professional rates charged
• CV(s) of consultant (s)
• Outline of proposed technical and financial work plan
• At least two examples of previous evaluations carried out