Evaluation Study (DRR WASH) via ReliefWeb

Practical Action

Kathmandu, , NP

Terms of Reference


Evaluation Study

BISWASH – Building back better, Institutionalizing and Strengthening WASH sector for urban resilience


Practical Action Nepal Office House No. 1114, Panipokhari, Lazimpat PO Box 15135, Kathmandu Nepal Phone: 977-1-4423639, 4423640, 4413452 Fax: 977-1-4423632 E-mail: [email protected]

November 2017

  1. Introduction

Practical Action is an international non-governmental organisation (NGO) that uses technology to challenge poverty in developing countries. Practical Action’s projects are organized under four programmer themes Sustainable energy access, agriculture, urban water and waste ,disaster risk reduction, besides these four major areas, Two cross-cutting themes are also present across our work, Climate change, markets.

  1. About BISWASH Project

Under WASH, we are implementing an BISWASH project aims to strengthen capacity of stakeholders in creating disaster resilience in Panuti Municipality with a focus on WASH and support for replication of good practices in other municipalities within District. The action has four expected results, the first and second result particularly focus on building capacity in preparing and institutionalizing holistic CBDRR plan of the municipality including strengthening market system for response. The third result focuses on preparing detail WASH emergency/preparedness plan demonstrating a few resilient WASH facilities as per the comprehensive emergency WASH plan. The fourth is about improving coordination among different actors and preparing “knowledge products” in resilient WASH and disseminating them for wider replication of the good practice. These knowledge products will emerge from the activities and interventions during the project period and will be documented as best approaches, best practices and learnings. The action focuses in 6 wards of Panuti Municipality with replication target in other 2 municipalities of Kavrepalanchowk District. The action facilitates local government planning processes (LGCDP) to allocate funds for DP/DRR at local and municipal levels. The action mobilizes existing structures at municipality and community level for gaining optimum resource mobilization to implement DP/DRR plan. DMCs/task forces representing women, youth, elderly people and other vulnerable groups will be mobilized to put an intensive effort for advocating government accountability towards inclusive DP and mainstreaming DRR into development plans. The action will develop strong linkages with national coordination agencies, stakeholders and other DIPECHO partners. this end-line study is aimed assessing the impact of the project at community and municipality level, assessing the process of institutionalisation on WASH and DRR in urban settings and identify important lessons learnt across the project period and suggest how those lessons can be used in designing the next phase of the programme or similar kind of the project. It is also expected from the study to provide concrete suggestions on the learning and lessons of the project and how those can be integrated into future cycle of action and into regular programmes

2.1 Purpose of the Project

Project purpose refers to the specific objective in this project, which is “Strengthened capacity of stakeholders in creating disaster resilient Panduit Municipality with a focus on WASH and support for replication of good practices in all municipalities within Kavrepalanchowk District.

Project Results:

• Strengthened capacity of stakeholders at ward and municipal level committees in developing municipal DRM plan and integrate into annual municipal plan • Enhanced capacity of communities in developing and implementing CBDP in DRM along with strengthened WASH focused market system for disaster response • Developed a comprehensive emergency WASH plan and demonstrated disaster resilient WASH facilities • Developed and disseminated knowledge objects on WASH during emergency and support to replicate good practices for DP, DRR and Resilience

2.2 Project location:

Panuti is a small town located 32 km Southeast of Kathmandu, found in the central regions of Nepal having population of less than 100,000.Panauti municipality was affected by the recent mega-earthquake. Practical Action along with its implementing partner ENPHO is implementing disaster preparedness, disaster risk reduction project with a focus on WASH to institutionalize and strengthening WASH sector for urban resilience through the support of European Commission humanitarian Aid office .The municipality was hit by 2015 earthquake and none of the DP/DRR agencies are working in the municipality. A DRM plan focusing on Shelter was prepared in 2009 for the municipality but it could not be implemented due to limited consultation with the municipality and stakeholders. Since then nothing on disaster preparedness and resilience building has been done Practical Action under this this action aims to strengthen capacity of stakeholders in creating disaster resilient Panduit Municipality with a focus on WASH and support for replication of good practices in other municipalities within Kavrepalanchowk District.

  1. Objectives of the Evaluation Study

The Evaluation Study is to review the BISWASH performance identifying the achievements against set indicators for the results and outcomes as set in the Log frame. The Study needs to identify good practices, problems and challenges faced during implementation and how those were overcome and addressed. The specific objectives are:

• To measure and update the overall achievement of the project based on log frame indicators (all for Specific Objective Indicators and Result Indicators) • To identify the achieved results aligning with the set indicators and how those were achieved; • To identify changes in the lives of community people and other stakeholders (knowledge, attitude and practice relevant to disaster management and DRR) by the project intervention; • To identify at what extent the project addressed the issues related with inclusion; • To undertake the stick of institutionalising process into different government departments and agencies and its sustainability. • To suggest how WASH demonstrations were useful for the targeted population and retention of the targeted communities knowledge on DRR • To suggest and/or recommend for designing the next phase of the programme following lessons learnt, promising practices and impacts of the programme.

  1. The Evaluation Study

The evaluation Study will focus on the following project elements:

 Project Management and Administration

• Collect, document and assess relevant elements and processes including: o Project related administrative procedures o Key decisions and outputs o Major project implementation documents prepared with an indication of how the documents and reports have been useful o What coordination mechanism took place at local and national level (within the partners and outside stakeholders e.g. other NGOs, government agencies etc.)

 Project Substantive and Technical Implementation

The Study will assess to what extent the project has achieved its defined results. It will also identify what outputs have been produced and how they have enabled the project to achieve its objectives. This section will focus on following priority project delivery areas:

• Progress of the project as a whole in achieving anticipated results and outcomes: • Efficiency of project activities- This will be covered through several parameters like relevance, impact, sustainability, timeliness of implementation etc. • Achievement of immediate results (level of indicator achievements when available – with reference to the project’s Logical Framework for indicators) • Quality of project activities and outcomes.

Monitoring and evaluation: • Has there been a monitoring and evaluation plan for the project, was it efficient? • Was the reporting framework effective/appropriate? • Is this framework suitable for replication/continuation for any future project support?

Risk Management: • Identify problems/constraints which have impacted or might have any impact on the successful delivery of the project; • Are they (problems and constraint) likely to repeat or occur in next phase? Project Finances: • Review the changes to fund allocations as a result of budget revisions and provide an opinion on the appropriateness and relevance of such revisions, taking into account the project activity timeframe • Review the effectiveness of financial coordinating mechanisms

Framework of Assessing the Project Activities

The Evaluation study will be undertaken following the Logical Framework of the project; i.e. the Logical Framework will be the key document of End-line Study. The project already developed a data plan and the End-line Team is suggested to review the data plan to identify the required data for the study. However, it would be highly appreciated if the study carried out following the criteria below in assessing the activities/strategies of the project:

 Relevance

The extent of the activities suited to the priorities and policies of the target group, recipient and donor. In evaluating the relevance of project activities and strategies, it is useful to consider the following questions: • To what extent are the objectives of the programme still valid? • Are the activities and outputs of the programme consistent with the overall goal and the attainment of its objectives? • Are the activities and outputs of the programme consistent with the intended impacts and effects? • Is the selection of target groups appropriate?

 Effectiveness

A measure of the extent to which activities attains its objectives. In evaluating the effectiveness of the project, it is useful to consider the following questions: • Have the outputs and expected results been appropriate to achieve the project purpose? • To what extent were the objectives achieved / are likely to be achieved? • What were the major factors (hindering or contributing) influencing the achievement or non-achievement of the objectives?

 Efficiency

Efficiency measures the outputs — qualitative and quantitative — in relation to the inputs. It is an economic term which signifies that the aid uses the least costly resources possible in order to achieve the desired results. This generally requires comparing alternative approaches to achieving the same outputs, to see whether the most efficient process has been adopted. When evaluating the efficiency of the project, it is useful to consider the following questions: • Have the project activities been appropriate to produce the outputs? • Have there been any factors hindering or contributing to the efficiency of the project?
• Were activities cost-efficient? • Were objectives achieved on time? • Was the programme or project implemented in the most efficient way compared to alternatives?

 Impact

The positive and negative changes impacted by the intervention of the project When evaluating the impact of the project, it is useful to consider the following questions:

• What has happened as a result of the project? • What real difference has the activity made to the beneficiaries? • How many people have been benefitted/affected? • Is the project purpose still appropriated to achieve the overall goal? • Have there been any other ripple effects? (expectation/forecasting)

 Sustainability

Sustainability is concerned with measuring whether the benefits of an activity are likely to continue after donor funding has been withdrawn. Projects need to be environmentally as well as financially sustainable. When evaluating the sustainability of the project, it is useful to consider the following questions: • To what extent did the benefits of a programme or project continue after donor funding ceased? • What were the major factors which influenced the achievement or non-achievement of sustainability of the project? • Will the technologies and ideas/methodologies introduced by the project continuously be utilized? • What are the possible measures to further facilitate the project implementation successfully?

 Resilience

As a project aimed to ‘build back better – institutionalise BISWASH – Building back better, Institutionalising and Strengthening WASH sector for urban resilience evaluate the strategic direction, operation modality and its sustainability to depict the leaning on resilience. What are the features and how far they are feasible each activities and strategies.

• What are the resilience features in the project? • How resilience component mainstreamed and will sustain?
• How resilience features are institutionalised? • How BBR approach was used  Gender Gender (refer to the minimum standards and indicators developed by Practical Action and launched in 2016 • Has the project delivered on the mandatory relational wellbeing indicators? • Have the specific material wellbeing indicators been achieved? • What is the importance of gender-related factors in the implementation of the intervention? • Are gender-sensitive methods of data collection used where required? • Are data properly disaggregated by gender?

  1. Scope of Work

Study will address the following questions for all the selected outcomes and their related outputs: • Do outcomes/outputs complement and enhance one another, and if yes, to what extent? • Do the projects outputs significantly contribute to the achievement of the outcomes? • How and what extend community and institutions were involved with the project implementation process;
• How any duplication or lack of co-ordination managed? • What are the efficient processes adopted? • What are resilience features are undertaken? • What extent have the results been achieved? • Was the community approach efficient or not? • What and how much is achieved as per the outcome/output set on the • What extent have gender, inclusion and capacity issues been addressed? • What were the major factors influencing achievement/non-achievement of the results?

  1. Methodology

The Evaluation Study will be done through a combination of processes including a desk research, site visit, interviews involving key project stakeholders, FGD, KII other required qualitative methods/tools etc. The methodology for the evaluation study is envisaged to cover the following areas:

• Desk review of all relevant project documentations (Single form, LFA, Data Plan and tools for data capturing progress reports, IEC materials etc.) • Consultations and discussion with staff involved with the implementing process
• Field visit • KII/FGD/interviews with stakeholders (both primary and secondary)

A detail methodology needs to be developed after reviewing the project documents and discussion with, Programme Manager Practical Action, and MEAL members.

Note: the applying agency can also suggest the innovative methodology to cover this assignment besides the above mentioned one

  1. Products/Deliverables

The evaluation Study consultant will come up with a comprehensive report to describe answers as mentioned in the scope of work. An agreed reporting format and outline will be developed prior to start the study. An executive summary will require to be furnished at the beginning of the report as well (Not more than 3 pages).

  1. Agreed table of contents of the report (beforehand)
  2. Executive summary (3 pages)
  3. Detail report
  4. Presentation of the finding
  5. Draft, final documents compiled during the Evaluation work Alongside the single report, all data collected from field need to be submitted with the report.

  6. Responsibilities of the parties

8.1 Consultant • The consultant will prepare a detail methodology aligning with the data plan already developed under the project. The data plan can be revised further in consultation with the Project manager Practical Action • The Consultant will give detail timeline for the study • Specific roles and responsibilities of the team members are to be defined and tasks are to be disseminated by the consultant • After gathering data from fields, the team will debrief the concern NGOs was responsible for implementation at field level;
• The draft report will be shared with PM, MEAL Group & Municipality Authorities • The consultant needs to submit both soft and hard copy (3 copies) of the final report to the Practical Action south Asia Nepal. • The shortlisted agencies will be called for a presentation and fine tuning the proposal further based on the presentation

The following are to be submitted by the consultant:

• A technical alongside financial proposal for evaluation • A copy of Company Registration and Profile • Tax Clearance Certificate up to 2072/073 • PAN/VAT Registration Certificate

• The financial proposal should consist of the following: o The remuneration day rate o Transportation and communication cost o Stationeries o VAT amount should be mentioned

• The technical proposal should consist of the following: o A brief description of the consultant’s organization and experience on similar assignments, o Methodologies, tools and techniques for the study, o Detailed work plan, o List of proposed staff team and tasks assigned to each staff team member

8.2 Practical Action

The main responsibility of Practical Action is to support consultants to produce a professional and accepted study report. Remaining within the main responsibility, followings are the specific responsibilities;

• Provide project related documents; • Hold discussion meeting to clarify the objective of project and scope of study • Provide support in finalising study methodology; • Facilitate field visits in coordination with project partners; • Provide inputs and comments on draft report; • Release budget as per agreed payment schedule;

  1. Human Resources

The following key technical experts and assistants are envisaged for the completion of the study.

An evaluation expert on DRR & WASH projects, having previous similar experience of conducting an evaluation of ECHO/ EC- USAID or DEC donor funding projects and developing of high quality reports .This is open to National Consultants as well having international experience on similar project evaluations on DRR & WASH

  1. Time Schedule and Deliverables The total duration of this assignment will be 15 days that spreads starting from early December 2017 and is expected to submit the final report by 15 January 2018.

  2. Budget and Payment Schedule

Budget available for this assignment is EUR 8,000 (approx.) / NPR 848000 .Payment schedule will be as following:

S.N. Description % of Contract Amount 1 After selection and granting a contract 40% 2 After submission of draft final report 30% 3 After submission and acceptance of final report 30%

How to apply:

Request for Proposal

All the interested international firms/ individual are requested to send their technical & financial proposals at [email protected] by 20th Of November 2017. However the local consultants/ Individuals firms need to send their proposals through sealed envelopes.

Note: The international consultant/ individual / firms are requested to send their proposals ONLY in non-edited PDF version. The other version will not be accepted “Practical Action believes in and follows through a fair and competitive process to recruit the consultant in all of its assignment to ensure quality assurance