End of Project Evaluation for Emergency Livelihoods and WASH Project for drought and conflict affected populations via ReliefWeb

CARE

, , SO

TERMS OF REFERENCE FOR EXTERNAL CONSULTANT

End of Project Evaluation for Emergency Livelihoods and WASH Project for drought and conflict affected populations in Lower Juba region, Somalia

1. PROJECT BACKGROUND AND CONTEXT

The drought situation in Somalia has intensified following the complete failure of 2016 Deyr rains (Short season of October – December) in the entire country that combined with the similar failure of the 2016 GU rains (Long season of March – May) and 2015. FSNAU and SWALIM drought watch update released on January, 2017 indicates the country is faced with extreme drought conditions and the situation anticipated to deteriorate to famine level as from April 2017 should the upcoming rainy season turns below average. The drought follows one of the strongest El Niño events on record in the Great Horn of Africa (GHA) region. The worst drought affected areas are Somaliland and Puntland which are experiencing four consecutive seasons of poor rains from 2015 and 2016. The drought has also expanded to Central and Southern Somalia with the regions of Lower Juba, Bay, Bakol, Gedo, Hiran and Galgadud being worst hit. According to the FSNAU January update release, over 1.14m people are classified to be in state of Humanitarian Crisis and Emergency (IPC 3 &4) and require immediate live saving responses. Another 4M persons are in state of stressed food insecurity and require livelihood protection support to cushion them from falling back into state of destitution. In total over 5M are classified to be in need of humanitarian assistants, out of which 300,000 are malnourished children under the age of 5.

Drought conditions, disease outbreak, refugee /IDP return and food insecurity continue to drive humanitarian needs in Somalia. Given the impacts of two consecutive below-average rainy seasons on crop production, pasture and water availability, and household purchasing power, the size of the food insecure population (IPC Phase 3 or higher) has increase significantly to more than 1.14 million people as per the FEWSNET food security update of January, 2017. The drought has devastated the livelihood sources of the pastoral and Agro-pastoral communities as the result if drastic decline of livestock prices and high mortality rate. In the South Somalia, High-Potential Agro pastoral and Low Potential Agro pastoral livelihood zones (Bay/Bakol/lower/Lower Juba/Middle Juba and Gedo) are of highest concern. Poor households in these areas had little to no harvests, typically their main source of food for consumption and income from sales. In addition, poor households have few livestock and are especially reliant on wage labor, an income source that can decline quickly during severe droughts. Distress migration out of rural areas towards IDP settlements in main towns such as Mogadishu, Kismayo and baidoa are rapidly experienced.

In response to the above situation, CARE Somalia and its local partner WASDA implemented a one & half year project dubbed Emergency Livelihoods and WASH Project for drought and conflict affected populations in Lower Juba region, Somalia. The project is funded by the GAC-DFATD-IHA and commenced on March 2016 and is expected to end June 2017. The project is designed to intervene in order to save lives, alleviate suffering and maintain human dignity of the most vulnerable rural and urban households in the districts of Kismayo and Badhaadhe in the Lower Juba Region of Somalia through WASH & livelihood intervention in the form of conditional cash transfers (Cash for Work, mainly targeting able and willing beneficiaries meeting minimum criteria to take part in rehabilitation of key community identified infrastructure such as water pans and market access roads) , unconditional transfers (direct Cash Relief, mostly for elderly and women headed households), restocking to pastoral dropouts as well as WASH intervention of water sources rehabilitation, provisions of latrines , hygiene education, hygiene kits and training of water management committees. The direct transfers of monthly cash for work wages and unconditional cash was undertaken by CARE through KAAH money Transfer Company. CARE has developed an MOU with KAAH to facilitate cash transfers and payment to beneficiaries at field level.

The primary goal of CARE‟s proposed intervention is to save lives, alleviate suffering and maintain human dignity. The intermediate outcome of the project is to reduce the Vulnerability of crisis-affected people, especially women, girls and boys in Lower Juba (Kismayo and Badhaadhe districts), Somalia. In order to accomplish this CARE will provide WASH and Livelihoods assistance, to reach 17,600 individuals (8,976 women and 8,624 men) Kismayo and Badhaadhe districts (Lower Juba region). The initiative will seek to assist women, men, boys and girls through the following activities:

§ Conditional cash transfers through cash-for-work activities will be provided to 1,124 women and 1,176 men.

§ Unconditional cash transfers will be provided to 900 vulnerable men and 459 women.

§ 2,400 pastoral households (1,176 males and 1,224 females) who have lost their animals in the previous droughts will be provided with productive livestock.

§ 882 males and 918 female vulnerable refugees and IDPs will be provided with an initial return package in line with Somalia return consortium guidelines.

§ Rehabilitation of strategic water sources such as shallow wells and boreholes, which will benefit 4,410 males and 4,590 females.

§ 400 households will receive hygiene kits that meet the specific needs of women and girls.

CARE in partnership with WASDA successfully managed to complete the planned activities despite the security challenges in some locations. This final evaluation is expected to provide an opportunity to determine whether restocking and cash-based interventions provided a viable and effective means of addressing severe, widespread household food insecurity in an extremely volatile context such as Somalia. The outcomes and findings of the evaluation will be useful to determine the measure the voucher and cash based response impacts in the project areas and to help in making informed decisions.

2. OBJECTIVES OF THE EVALUATION

This evaluation will inform the results of the project based on five criteria (relevance, effectiveness, efficiency, sustainability and impact) recommended by OECD-DAC. The external evaluation will contribute to both strengthening accountability of CARE International in Somalia for its donor and key stakeholders including beneficiaries, and to learn from this experience to inform future Livelihood and WASH project. The overall objective of the evaluation is to assess and provide reliable end-line information on project performance against set parameters (i.e. indicators, principle objective, and short-term impact) on the three project components i.e. cash and voucher based interventions in the target area of Lower Juba region. This will be used to measure progress of achievements against benchmarks established during the baseline.

3. SCOPE OF THE EVALUATION

The specific objectives of the evaluation are:

  • To undertake an independent and comprehensive evaluation with a view to provide evidence-based information on GAC project performance against set indicators.
  • To assess the extent of project’s efficiency, effectiveness, appropriateness/relevance, and short-term intended and unintended impacts.
  • To explore the possible linkage of restocking, unconditional and conditional cash transfer programs in emergency in building community resilience in relation to different livelihood groups, seasonality and humanitarian support.
  • To assess the WASH facilities constructed and augmented i.e. latrines, shallow wells and the borehole (Waraq)
  • To analyze and document lessons learnt on restocking and cash based response practices in the project areas and among beneficiaries in relation to targeting criteria, seasonality, security, gender relations, copying strategies and impact of cash transfer program on local credit systems.
  • To document lessons learnt and provide recommendations on how to improve programming of similar emergency projects in future.

The project will be evaluated in line with the DAC- OCED Evaluation criteria. The evaluation will seek to answer the following proposed evaluation questions.

Relevance

§ Was the project consistent with the sector policies and strategies of the Government of Somalia?

§ Was the project consistent with the water supply and sanitation sector policies and strategies of the Department of Foreign Affairs, Trade and Development (DFATD)?

§ To what extent did the project respond to the needs and priorities of the affected people/ communities it targeted, with specific reference to the experiences and opinions of women, girls and other vulnerable and/or marginalized groups?

§ To what extent were the integrated approaches employed appropriate for the pursued project objectives?

Effectiveness

§ To what extent has the project increased the capacity of Water accessibility and enhance operation and maintenance of the water points? Are the results satisfactory? If yes, to what extent are the results satisfactory? If no, what are main reasons for dissatisfaction?

§ To what extent has the project enhanced hygiene promotion to speed up the attainment of the . Are the results satisfactory? If yes, to what extent are the results satisfactory? If no, what are main reasons for dissatisfaction?

§ To what extent has the public private sector partnership enhanced and strengthened the supply chain of WASH materials for repairs, rehabilitation and construction of new WASH Infrastructure? Are the results satisfactory? If yes, to what extent are the results satisfactory? If no, what are main reasons for dissatisfaction?

§ To what extent has the project increased self-reliance in livelihoods and improved water accessibility among the target population? Are the results satisfactory? If yes, to what extent are the results satisfactory? If no, what are main reasons for dissatisfaction?

§ What were the key drivers and barriers that impacted on the delivery of the project outputs?

§ To what extent has the project used learning to improve delivery?

Efficiency

§ Were resources utilized and managed in efficient manner? Would it have been possible to achieve the same results at a lower cost?

§ Were the project activities implemented within the planned time and financial targets?

§ How well did the operation co-ordinate with other, similar interventions (if any) for synergy and in order to avoid overlaps?

§ To what extent did the project understand cost drivers and manage these in relation to performance requirements?

§ Did the project receive timely disbursement of funds from the Australian Aid as per the implementation schedule?

§ What factors and constraints affected project implementation including technical, managerial, organizational, institutional and socio-economic policy issues in addition to other external factors unforeseen during the project design?

Sustainability**

§ Has the government shown and likely to show adequate commitment for the functioning of water supply and sanitation system delivered by the project?

§ What is the level of community ownership, as reflected in the participation of the community in the project supported WASH community based structures?

§ Are the project supported community based structures adequate and have a long term vision and strategy for operating, maintaining and regulating the water supply and sanitation infrastructure/system? Do they have capacity to maintain the benefits from the project without the support from CARE or any other donor? If yes, how? If no, what will be the principal challenges in sustaining the program benefits?

§ What aspects would most certainly not continue without CARE support?

§ What could the project have done different to improve sustainability?

Impact**

§ Has the project contributed to the improvement in the quality of life of the people in affected district? If yes, how? If no, why?

§ Has the project contributed to the improvement in environmental sustainability in the project area? If yes, how? If no, why?

§ To what extent has the project increased the availability of and access to drinking water of adequate quality and quantity in affected district?

§ To what extent has the project increased access to adequate sanitation, hygiene and solid waste disposal facilities in affected district?

§ To what extent are the project beneficiaries aware of and adopt healthy sanitation and personal hygiene practices?

§ Have there been any other changes (positive and negative) at household, school or community level as a result of project? Has the project affected people in ways that were not originally intended? If yes, what has changed?

§ Which changes are regarded as most significant? ( Rank in order of importance)

§ Of the changes that you have mentioned, what are some of the factors (program and non program) that contributed to the changes? Which of these factors are regarded as most significant? ( Rank in order of importance)

§ Has the relationship between program partners helped or hindered the delivery of the changes? If yes, how? If no, how can these relationships be improved?

§ What actions have worked and can be scaled up and what needs to be done differently?

Equity

§ Was the project aligned with CARE International in Somalia’s equity agenda in addressing the needs of the target groups (i.e.to what extent the initiative reached different groups including the most marginalized)?

§ Did the project contribute to equitable participation and benefits to various groups (men, women, children and differently abled people)?

§ Over the past 3 years, were there any undertakings by the project to promote equity? If yes, how? If no why not?

Changing the Nature of Program

§ Based on your experience & expertise, are there areas that should have been done differently with respect to:

ü Priorities

ü Implementation strategies: Implementation, Monitoring process and Management:

ü Other facets

4. APPROACH AND METHODOLOGY

The evaluation will cover Kismayo, Afmadow and Badhadhe districts of Lower Juba Somalia, Specifically the five villages where the GAC project has been implemented i.e. four in Badhaadhe district and one in Afmadow district. These locations are Kulbiyow, Waraq, Hida, & Raskiamboni for Badhaade as well as Kismayo. The participants of the survey will include; IDP’s, Returnees (both IDP returnees and Refugee returnees), host Rural and Urban Communities in the target area.

The consultant and his/her team are expected to use different evaluation tools, comprising of primary data collection (through qualitative and quantitative survey questionnaires) and secondary data review and literature. Furthermore, the study will be undertaken through a participatory and collective manner based on active involvement of project beneficiaries. The methodology must be designed in a way to measure indicators set in the project design document.

In particular, the consultant is expected to:

§ Conduct desk reviews of project documents and meetings with key project staff. Key documents to be reviewed include GAC market baseline survey, project proposal (which includes indicators and indicator targets), project M&E plan, quarterly reports, post distribution monitoring reports and third party monitoring report.

§ Conduct meetings with key project staff of CARE and partners

§ Obtain feedback on data collection tools from key CARE and partner staff and finalize data collection tools

§ Organize one-on-one interview with key stakeholders who include local authorities; IDP and host community representatives; village relief committees

§ Train enumerators (should be a mix of both male and female) who will pre-test the data collection tools.

§ Administer household questionnaires to a representative sample to be agreed with CARE.

§ Data processing (data entry, verification and analysis)

§ Hold community and stakeholder feedback sessions to present findings and recommendations of the study

However, the consultant and his/her team are encouraged to propose additional methods to conduct the evaluation.

5. KEY DELIVERABLES

a. Work plan/Inception report which includes data collection methodology, including translated data collection tools for all indicators and sampling methodology

b. Final data collection tools incorporating feedback from CARE

c. Briefings/Debriefings: Provide regular feedback/briefs to Emergency Coordinator. The consultant will report his/her preliminary findings to the Emergency coordinator, and M&E Advisor before leaving the field.

d. Draft report – The consultant is expected to produce a draft report identifying key findings, conclusions, recommendations and lessons for future programming. This will be reviewed by CARE Somalia for initial feedback.

e. Final report – The consultant will produce the Final Evaluation Report after incorporating all comments and feedback provided by CARE.

6. Report format.

The main body of the report (draft and final version) should not exceed 40 pages (excluding annexes). One of the annexes should consist of a table which summarises the findings according to the OECD-DAC criteria.

The draft and final report should include the following sections:

  1. Executive Summary

  2. Introduction

· Purpose of the evaluation

· Organisation context

· Logic and assumptions of the evaluation

· Overview of the project

  1. Evaluation Methodology

· Evaluation plan

· Strengths and weaknesses of selected design and research methods

· Summary of problems and issues encountered

  1. Findings

· Overall Results.

(This section should include the table showing the data collected for each of the indicators in Annex 1 and performance against the indicators)

· Assessment of accuracy of reported results

· Relevance

· Effectiveness

· Efficiency

· Sustainability

· Impact

  1. Conclusions

· Summary of achievements against evaluation questions

· Summary of achievements against rationale for Department of Foreign Affairs, Trade and Development (DFATD)? funding

· Overall impact and value for money of Department of Foreign Affairs, Trade and Development (DFATD) funded activities

  1. Lessons learnt & Best practices (where relevant)

· Project level – management, design, implementation

· Policy level

· Sector level

· Department of Foreign Affairs, Trade and Development (DFATD) level

  1. Recommendations

  2. Annexes

· Table summarizing the findings according to the OECD-DAC criteria (relevance, effectiveness, efficiency, sustainability and impact.)

· Independent final evaluation terms of reference

· Evaluation research schedule

· Evaluation framework

· Data collection tools

· List of people consulted

· List of supporting documentary information

· Details of the evaluation team

· Grantee management response to report findings and recommendations.

7. DURATION OF THE ASSIGNMENT

The duration of the assignment is 18 working days after signing of contract. Days are inclusive of travelling, fieldwork and reporting. The evaluation is expected to take place from 1st of June 2015 to 18th of June 2017.

Activity

Time Frame

1 Inception Meetings and Finalization of Inception Report (with tools attached)

Week 1 of signing of contract

2 Hiring Enumerators, Pretest of tools and Training of Enumerators

Week 2 of signing of contract

3 Fieldwork –Data Collection –Qualitative and Quantitative

Week 2

4 Data Entry and Cleaning

Week 2 and 3

5 Data Analysis and Production of Tables

Week 3

6 Final Endline Study Report Preparation

Week 4

7 Formal presentation of results to stakeholders

Within 1 week –After completion of study

8. CARE’S RESPONSIBILITIES ON THE ASSIGNMENT

In support to the consultant(s) to undertake the assignment, CARE Somalia will:

  • Provide all relevant/available materials pertinent to study
  • Make 30% down payment once the inception report is approved and 70% after the approval of the final report and the stated deliverables.

9. QUALIFICATIONS OF THE CONSULTANT

The consultant must possess relevant operational experience and qualifications to undertake the work, specifically the following;

§ Advanced university degree in Public Health, Social Sciences or any other related field with a minimum of 5 years of experience in conducting similar work. Previous experience in evaluating GAC-DFATD-IHA funded projects will be an added advantage.

§ Expertise in the fields of emergency food security, livelihood & WASH

§ Experience in conducting project evaluations of similar programmes using participatory methods.

§ Advanced analytical and report writing skills.

§ Fluency (written and verbal) in English and Somali language

ANNEX 1 – INDICATORS TO BE MEASURED THROUGH THE FINAL EVALUATION**

Type of

Indicator

Performance Indicator

Outcome 1 : 100 -LIVELIHOODS

Increased self-reliance of at-risk and vulnerable pastoral and IDP/refugee returnee populations

% of beneficiaries able to restore their livelihoods within the first 12 months of the project

% of refugee/IDP returnees (# female, # male) fully integrated in the host community by the end of the project.

% of men and women satisfied with the value and appropriateness of the cash provided

# of men and women whose livelihoods have been restored

Outcome 2: 200 WATER ,SANITATION AND HYGIENE Improved access to water, sanitation and hygiene services for vulnerable populations in line with the Somalia WASH cluster standards and guidelines

% of target beneficiaries accessing 15 litres of safe water per person per day for drinking, cooking and personal hygiene use.

% of target population who report using a latrine the last time they defecated

% of beneficiaries demonstrating good personal hygiene practices[1]

% of men and women reporting being satisfied with the appropriateness of hygiene supplies

110 Vulnerable populations identified within target communities and

beneficiaries registered

# of vulnerable households assessed and registered for assistance

120 CFW opportunities identified jointly

with the community members

# Number of cash for work micro

projects jointly identified with target community representatives

130 Conditional cash transfers provided

to women and men engaged in CFW activities in line with Somalia Food Security Cluster and Cash Based response Technical working Group guidelines.

Number and value of cash forwork payments made to registered beneficiaries

Number of men and women receiving CFW payments.

140 Unconditional cash transfers

provided to vulnerable men and women unable to participate in CFW activities

Number and value of unconditional cash payments made to selected beneficiaries

Number of men and women provided with cash assistance

150 Livelihoods inputs (livestock)

provided to pastoral households who lost their livestock assets in line with cluster guidelines

Number of pastoral households supported with livelihoods inputs

(productive animals)

Number of refugee/IDP returnee households(# female headed, # male headed) supported with return package as per UNHCR guidelines

160 Initial return packages provided to returnees in line with Somalia return consortium guidelines

Number of refugee/IDP returnee households(# female headed, # male headed) supported with return package as per UNHCR guidelines

210 Strategic water sources such as

Shallow wells and boreholes are identified and rehabilitated

Number of shallow wells and boreholes rehabilitated

220 Emergency water trucking

conducted in selected locations with no access to water sources during the dry periods

Number of persons provided with 7.5 litres of safe water per person per day

230 Water purification supplies

distributions

Number of hygiene kits distributed

Number of women and girls with gender sensitive hygiene kits

240 Hygiene kits provided in accordance

with Somalia WASH cluster that meet the specific needs of men, women, boys and girls

Number of chlorine drums used to purify water

250 Community hygiene promoters

trained on appropriate promotion methodology (PHAST)

Number of community hygiene promoters trained on PHAST methodology

260 Community based hygiene

promotion sessions conducted

Number of hygiene promotion sessions conducted

Number of people (# female and # male) reached directly with key hygiene promotion messages

270 Water management committees

established and trained on basic operation and maintenance of water infrastructure to ensure effective management and use of resources.

Number of water management committee members (# female/# males) trained

280 Shared household latrines

constructed to meet the specific needs of men, women, boys and girls.

Number of shared household latrines constructed

Number of men, women girls and boys using constructed latrines.

[1] This includes hand washing ,bathing and women hygiene

How to apply:

10. HOW TO APPLY:

All applications MUST be accompanied by maximum 10 pages technical and financial proposal including a brief outline of the proposed methodology, 3 references with contacts and a tentative work plan as well the candidate’s availability during the months of June 2017. The budget should include logistics, accommodation, transportation and enumerators’ costs during the consultancy period. Deadline for submission of technical and financial proposals is 15th May 2017.

Interested consultants or firms are expected to conduct their own security and accessibility of the target project locations before application. Updated CVs of individuals or profile of applying company expressing interest to conduct the survey should be sent to [email protected]

Please indicate “End of Project Evaluation for Emergency Livelihoods and WASH Project for drought and conflict affected populations in Lower Juba region, Somalia” as the subject heading.


POSITION TYPE

ORGANIZATION TYPE

EXPERIENCE-LEVEL

DEGREE REQUIRED