End-term Evaluation for a CVM/GRC joint project entitled: Humanitarian Aid in the Areas of Shelter and WASH for the People Affected by Cyclone Idai

German Red Cross

Mozambique 🇲🇿

1 Background

In 2019, Cyclone Idai has caused severe devastation in a corridor from Mozambique’s coast to neighboring Zimbabwe including Manica province (on the border with Zimbabwe). Around 263.000 people / 56.200 households in Manica Province were affected by Cyclone Idai; which represents 14% of the entire population in the Province.

The Sussundenga District and the southern Administrative Post (P. A.) of Dombe were strongly hit by severe flooding, affecting around 124.000 people / 26.700 families, which represent around 74% of the total Sussundenga district population. 86% of the buildings in the area were destroyed (17.660) or damaged (9.274)[1].

Since July 2019, the Mozambique Red Cross (CVM) and the German Red Cross (GRC) are implementing a 30-months emergency project in Sussundenga (Manica Province), responding to humanitarian needs of 15.000 people at different areas including:

  1. SHELTER – Targeted population has access to adequate/culturally appropriate (temporary) shelter solution (through in-kind support) providing protection from hazards, while considering privacy, safety, dignity, and healthy living conditions enabling essential households and livelihood activities.
  2. NFIs – Targeted population has access to sufficient, adequate and culturally appropriate non-food items (NFIs), e.g. household items, clothing and bedding, cooking utensils and cooking facilities (stoves, fuel, etc.), heating, tools for construction, lightening for personal safety, etc.
  3. WATER & SANITATION – The target communities have improved access to safe water points and sanitation and hygiene facilities.
  4. HYGIENE KNOWLEDGE AND HYGIENE MATERIALS – Targeted population has access to hygiene knowledge and access to appropriate hygiene materials.
  5. WASH COMMITTEES AND ACTIVITIES – Targeted population participates in the process of designing and implementing WASH activities.

2 Objectives of the End-term Evaluation

2.1 Purpose

The end-term evaluation should analyse and comment on the achieved status of the project and evaluate how effective and efficient the project has so far achieved its specific objectives. The end-term evaluation should be carried out based on the approved project proposal, in particular the logical framework, outlining the objectives of the projects and the operational work plans, as well as on the baseline studies. Based on its results, the evaluation will provide CVM and GRC with recommendations for future projects.

2.2. Users of the evaluation

The primary audience of the evaluation findings are the staff of i) CVM both in Manica Province as well as in the headquarters, ii) GRC Chimoio (Manica Province), Maputo and at HQ in Berlin, iii) the Sussundenga District Administration, iv) the Dombe Administrative Post (where the project is implemented) v) German Federal Foreign Office (GFFO).

3 Task description

3.1 Evaluation scope

The purpose of this end-term evaluation is to assess the achievement of the project´s expected results, indicators and budget execution as well as to provide recommendations and lessons learned for future projects implemented by GRC and CVM.

3.2 Evaluation criteria (OECD-DAC) including specific evaluation questions related to the project/program

a) Relevance

▪ To what extent were the objectives of the project met?

▪ Were the activities and outputs of the programme consistent with the intended impacts and effects?

▪ Were the activities and outputs of the project consistent with the overall goal and the attainment of its objectives?

▪ Were the project priorities in line or complement with those of the communities, authorities and other national and international humanitarian actors including the CVM?

▪ Were the project priorities focusing on the humanitarian priorities of the identified target groups? If not, why?

▪ To what extent were the most vulnerable population reached / provided with assistance relevant to their current humanitarian needs?

▪ How relevant were activities and which ones have not been included/conducted yet?

b) Effectiveness

▪ To what extent has the program achieved its expected objectives?

▪ How effective was the programme in terms of responding to the needs identified by the affected communities?

▪ What were the major factors influencing the achievement or non-achievement of the objectives?

▪ To evaluate the engagement of the beneficiaries in the activities and in the design of these activities.

c) Efficiency

▪ Were activities cost-efficient?

▪ Were the objectives achieved on time?

▪ Were appropriate human resources (skills, experience and seniority) available to the programme in key areas of management, coordination, technical programme design and implementation?

▪ Evaluation and analysis of the organizational set-up (CVM HQ, CVM Province and Districts, GRC Country Office)

d) Impact

▪ Impact of the project at the community and regional level and within CVM (branch and HQ)

▪ What has happened as a result of the project and why?

▪ What difference has the project made to the beneficiaries?

▪ How many people were reached?

e) Gender, PwD and CEA

▪ Were project staff and volunteers aware of the gender aspects and were they adequately addressed in the project?

▪ What has been done to ensure gender equality within the project?

▪ Were men and women participating in project activities to the same extent?

▪ Were people with disabilities participating in the project and are their needs met adequately?

▪ Has a CEA system been established within the project incl. communication/feedback channels between beneficiaries, the project team and authorities etc.?

f) Connectedness and exist strategy

▪ In how far are activities linked/ connected to other future action and actors?

▪ What were the major factors which have influenced the achievement or non-achievement of the connectedness of the project?

▪ Has the exit strategy achieved it goals?

g) Coherence

▪ In how far activities are coordinated with other (humanitarian) actors and stakeholders in the project region.

4 Evaluation design and methodology

4.1 Evaluation team

The evaluation team will be composed of:

1) One external evaluator (consultant) (Portuguese Speaker)

2) One evaluator from CVM headquarters in Maputo/Manica Province

4.2 Participation of stakeholders

  • Key CVM staff Chimoio / Sussundenga and CVM volunteers
  • Relevant GRC staff in Chimoio, Maputo and Berlin
  • Relevant Local Government Stakeholders in Sussundenga District
  • Dombe PA Relevant stakeholders
  • Stakeholders such as NGOs, private organizations and other partners of the Red Cross and Red Crescent Movement

4.3 Methodology

The evaluation team should use the available secondary data for analysis. For the collection of primary data, participatory methods should be applied including opinions of the target group. The choice of methods will have to be presented and described by the evaluation team and will be approved by GRC and CVM in the kick-off meeting. The IFRC standards for evaluation[2] should be respected and are the framework and basis for any evaluation activity executed by a consultant under GRC contract.

4.4. Sources

The evaluator team will have access to all relevant project documents like projects proposals, projects management documents (Log frames, activity plans, and budgets), monitoring tools, projects reports (narrative and financial) etc. The decision about the publication is the right of GRC.

5 Timetable and reporting

5.1 Proposed Timetable (22 days)*

Day,Task, Responsible person, days/person**

  • 1-3, Introductory Meeting with Consultant (Skype), Analysis of relevant documents, Work on inception report, Consultant and GRC Berlin, Maputo, 3
  • 4, Kick off Meeting with GRC office Maputo and work on inception report,Consultant and GRC Maputo, 1
  • 5, Finalisation of inception report (0,5), and travel to Chimoio (0,5),Consultant,1
  • 6, Kick-off meeting with local team (0,5) and preparation of field trip, Consultant and baseline team,1
  • 7-13, Data collection and preliminary analysis (field activity), Consultant and baseline team, 7
  • 14, Discussion of preliminary findings in Chimoio (0,5) and travel to Maputo (0,5), Consultant and team,1
  • 15, Discussion and presentation of preliminary findings in Maputo (0,5), work on final report (0,5), GRC Maputo and Consultant, 1
  • 16-18, Data analysis / Draft report, Consultant and team, 3
  • 19-20, Discussion of findings and including feedback from CVM/GRC, Consultant and GRC Berlin/Maputo, 2
  • 21-22, Travel days, To and from Maputo, 2

Total 22

*The proposed timetable is subject to the security situation and might need to be modified (especially due to Covid-19 restrictions).

The consultancy should preferably be conducted in October/November 2021.

5.2 Reporting: Consultant Deliverables

5.2.1 Inception report

  • Tentative list of persons/ organisations to be interviewed
  • Feedback / Amendment of the ToR – suggestions for ToR amendments if necessary
  • Status of the evaluation preparation (team, timetable, distribution of tasks, reporting)
  • Evaluation design: Chosen methods, approach, steps for their implementation
  • Tools for their implementation (questionnaires, data processing and analysis etc.)
  • A draft implementation plan for the evaluation

The inception report will be discussed with GRC and the evaluators. Any changes of the ToR need an agreement of both parties because they might change the conditions and thereby the contract between GRC and the evaluators.

5.2.3 Evaluation and validation workshop/ lessons learnt workshop

Representatives of stakeholders and the evaluators will come together in the evaluation workshop. The workshop will be organized to discuss and validate findings, lessons learnt, and recommendations proposed by the evaluator/s. Stakeholders might formulate additional recommendations if necessary. Possible content of an evaluation workshop:

  • Presentation and discussion of the preliminary evaluation report
  • Validation of lessons learnt and recommendations by all stakeholders
  • Collection of additional observations or recommendations

It is expected that the evaluators present a structure for the workshop as part of their preliminary report. GRC/CVM and partners are responsible for the workshop preparation and all related logistics.

5.2.4 Final report

The final evaluation report should consider the validation of the stakeholders during the evaluation and lessons learnt workshop and must be delivered latest 10 days after the workshop. All evaluation works, inception-, preliminary- and final report should be delivered in English language.

The evaluators will give his/her recommendations but should incorporate the validation process during the workshop in the final report, including additional recommendations from the workshop participants. The report will have to be approved by German Red Cross (GRC Head of Office in Maputo and Country Manager at GRC HQ Berlin).

The final report should, as a minimum, include the following elements:

  • Key data of the evaluation (from the inception report)
  • Executive summary – a tightly drafted, to-the-point, free standing document (about 5 pages max) with the following, fixed structure:
  • Short project description
  • Key questions of the evaluation
  • Key findings (Structured (if applicable) along the OECD DAC criteria: Relevance / Effectiveness / Efficiency / Sustainability / Impact)
  • Lessons learned
  • Major project-specific recommendations
  • Introduction – with purpose of the evaluation, scope, key questions, short description of the project to be evaluated and relevant framework conditions.
  • Evaluation design and methodology
  • Key findings per indicator and with regards to the questions pointed out in the ToRs
  • Conclusions based on evidence and analysis
  • Recommendations as expected in the ToR, which are relevant and feasible and targeted to the respective audience
  • Lessons learnt ad recommendations for the further project implementation
  • Annexes (ToR, list of consulted persons/organisations, literature, etc.)

Key findings, conclusions and recommendations should be presented in a clear and transparent way, possibly put next to each other in a table to demonstrate the logic.

The report can be extended by the evaluator/s by additional points if necessary.

6 Responsibilities and tasks

6.1.GRC

  • Will facilitate transport and accommodation during the evaluation.
  • Will support the consultant with the necessary working material for workshops.
  • Will facilitate the organization of the workshop or other activities depending on the proposed methodology.
  • Will give a security briefing to the consultant.
  • Will sign the contract with the consultant and cover the consultancy fees as per the contract
  • Maintain coordination with the CVM Project Team in Mozambique

6.2. Evaluator

  • Will conduct the evaluation as outlined in the TORs / inception report;
  • Will specify arrangements required to organize the lessons learned workshop or any other activity in close collaboration with CVM and GRC
  • Will follow the timeframe agreed, and shall communicate any unforeseeable change as soon as possible
  • Will submit all deliverables (inception report, preliminary and final evaluation) to GRC as per the agreed timeline
  • Will revise the draft, based on the comments from CVM and GRC.

7 Evaluator Profiles

The evaluator/s should meet the following criteria:

Obligatory

  • At least 5 years of experience as a consultant/evaluator
  • In-depths knowledge of Emergency/relief projects (in the context of Mozambique is an advantage)
  • Knowledge in Wash and Shelter is an advantage
  • High analytical, writing and workshop facilitation skills
  • Excellent command of written and spoken English and Portuguese
  • Legal status to conduct this activity in Mozambique.
  • Possess a BI or DIRE or Work Visa
  • NUIT number

Preferable

  • Knowledge/experience of the Red Cross Movement (highly desirable)

8 Application Procedure

Interested consultants should submit their dossier by until September 15th 2021 to**

GRC Delegation Regional Office situated at Av. 24 de Julho N°641, 1st floor Maputo the latest at 15h30 on 15th of September 2021. On the the sealed envelope should be stated: “Application for Consultancy End-term Evaluation Project Shelter, WASH Manica”

Or to

[email protected]

The application should include:

  • Curriculum Vitae
  • Brief letter of motivation summarising relevant experiences and qualifications for the consultancy
  • Technical proposal: the technical proposal should contain the following elements:

a) A chronogram for how the consultant proposes to complete all tasks

b) A description of the proposed methodology

  • Financial proposal: the financial proposal will indicate:

a) The financial proposal is inclusive of daily fees and applicable taxes

Please indicate in your financial proposal: daily fees + % of taxes = overall fees

b) the validity of your offer.

c) a tax/VAT/NUIT no.

Flight tickets to/from Mozambique, insurance and per diem/DSA are not reimbursed by GRC, thus these should be factored into the daily fee. The financial proposal needs to be in EUR.

(GRC will facilitate the consultant´s accommodation and cover travel costs within Mozambique).

GRC will not consider incomplete dossiers.

9 Evaluation Criteria of the Application

The decision for the award of contract will be determined via method Credit points divided by total price; ratio 50/50%. Credit points will be added up through the following criteria:

A =Technical Proposal,

B = Experience as a consultant and knowledge about emergency projects,

C = Comprehension of the ToRs.

Weight:

A =Technical Proposal=60%,

B = Experience as a consultant and knowledge about emergency projects = 30%

C = Comprehension of the ToRs = 10%)

Applied Scoring system:

5 points: Excellent

4 points: Very good

3 points: Good

2 points: Sufficient

1 point: Bad

0 points: Insufficient

[1] Shelter Cluster 2019

[2] The IFRC Evaluation Standards are:

  1. Utility: Evaluations must be useful and used.
  2. Feasibility: Evaluations must be realistic, diplomatic, and managed in a sensible, cost effective manner.
  3. Ethics & Legality: Evaluations must be conducted in an ethical and legal manner, with particular regard for the welfare of those involved in and affected by the evaluation.
  4. Impartiality & Independence; Evaluations should be impartial, providing a comprehensive and unbiased assessment that takes into account the views of all stakeholders.
  5. Transparency: Evaluation activities should reflect an attitude of openness and transparency.
  6. Accuracy: Evaluations should be technical accurate, providing sufficient information about the data collection, analysis, and interpretation methods so that its worth or merit can be determined.
  7. Participation: Stakeholders should be consulted and meaningfully involved in the evaluation process when feasible and appropriate.
  8. Collaboration: Collaboration between key operating partners in the evaluation process improves the legitimacy and utility of the evaluation.

How to apply

Interested consultants should submit their dossier by until September 15th 2021 to**

GRC Delegation Regional Office situated at Av. 24 de Julho N°641, 1st floor Maputo the latest at 15h30 on 15th of September 2021. On the the sealed envelope should be stated: “Application for Consultancy End-term Evaluation Project Shelter, WASH Manica”

Or to

[email protected]

The application should include:

  • Curriculum Vitae
  • Brief letter of motivation summarising relevant experiences and qualifications for the consultancy
  • Technical proposal: the technical proposal should contain the following elements:

a) A chronogram for how the consultant proposes to complete all tasks

b) A description of the proposed methodology

  • Financial proposal: the financial proposal will indicate:

a) The financial proposal is inclusive of daily fees and applicable taxes

Please indicate in your financial proposal: daily fees + % of taxes = overall fees

b) the validity of your offer.

c) a tax/VAT/NUIT no.

Flight tickets to/from Mozambique, insurance and per diem/DSA are not reimbursed by GRC, thus these should be factored into the daily fee. The financial proposal needs to be in EUR.

(GRC will facilitate the consultant´s accommodation and cover travel costs within Mozambique).

GRC will not consider incomplete dossiers.


POSITION TYPE

ORGANIZATION TYPE

EXPERIENCE-LEVEL

LANGUAGE REQUIRED