ToR - Midline Survey of a WASH Project via DevNetJobsIndia

Terms of Reference

Mid-line Evaluation of the project: Universal Language for Behaviour Change programme

1.            Introduction and context

This contract is for a project of Parmarth Samaj Sevi Sansthan which is co-funded by two German NGOs- Viva con Agua and Welthungerhilfe. To encourage vulnerable communities for sustainable WASH behaviour for their health and livelihood.

1.1 Background

Parmarth Samaj Sevi Sansthan hereby is onboarding an agency/individual to evaluate the Outcomes and Impact of project IND 1397 which promote access to clean drinking and other Water, Sanitation and Hygiene (WASH) related activities through unique Universal Language of Behviour Change approach in Madhya Pradesh in the time period of Feb 2022 to Feb 2024.

The proposal/description of action covering Project objectives, target groups, final beneficiaries, main Outcomes and Outputs/Logframe matrix can be seen through the following link: –

Click Here

1.2   Purpose of Midline Evaluation

The evaluation’s goal is to collect information that will help the project team determine the impact of the project activities from Feb 2022 to Feb 2024. The learnings will help improve the remaining implementation activities of the project and gather information on effectiveness of the Universal Language of Music, Arts and Sports for Behaviour Change approach. This will also help in creating programmatic strategy for future activities.

• The degree to which the project achieved the goals outlined in the proposal in past two years.
• Establishing a meaningful link between Input Activities-Input Cost-Outcomes and Impacts
• Gather information and evidence on effectiveness of the Universal Language of Music, Arts and Sports for Behaviour Change approach to inculcate sustainable Water, Sanitation and Hygiene (WASH) in vulnerable communities, including schoolchildren.
• Improving the scope of Log Frame of the project and review of the set indicators as well as sources of verification.
• Improving the M&E indicators of the project and helping in developing more effective and appropriate M&E system.
• Succinctly summarize the lessons learned and suggest evidence-based judgement to the implemented activities project, project steering, and future project activities.

The exercise is primarily undertaken to get an outside perspective on project execution through a process of analysing project materials, documents and reports reviews, having meaningful discussions with all stakeholders and target groups involved, including beneficiaries, to determine the impact of the project activities done so far. Primarily, the following aspects/criteria are expected to be examined during the evaluation: – i) Relevance, ii) Coherence, iii) Efficiency, iv) Effectiveness, v) Impact and vi) Sustainability. Additionally, the following aspects are also examined vii) Cross cutting issues (gender, human rights, environment/climate change) viii) Communication and visibility, ix) Horizontal issues.

2.           Scope of the Midline Evaluation

This is an external Midline project evaluation to assess if the project activities done so far are meeting its objectives taking into consideration relevant time and logistics limitations. The Final review will assess the project mentioned in section 2 above (including cross cutting, communication & visibility, and horizontal issues). The Recommendations & Lessons learned through this evaluation will be applied by the project team to inform and improve current and future strategies of the project activities.

3.           Evaluation questions and criteria

A selection of the OECD/DAC evaluation criteria will be used to guide the evaluation questions.

4.           Evaluation design and methodology

The evaluation will use a mixed method approach consisting of both qualitative and quantitative data collections. This will include, when available, project surveys and assessments, Baseline, Evaluation and project periodic reports. The consultant is expected to review the project’s background documentation as part of the desk review phase of the study using the existing project documentation and key documents. The evaluation will be conducted, using gender responsive participatory methods to collect qualitative data, triangulated for validation.

Aligning with the content of the scope of work shared for this study, the consultant will develop the methodology, the data collection tools to be validated by Head of project and MEAL coordinator. The consultant will collect primary data through observation, household interviews using baselines tools and same sample size, key informant interviews (KII) with project staff and stakeholders and focus group discussions (FGD) with project beneficiaries and other key stakeholders. A (detailed) design and methodology for the evaluation will be proposed by the Consultant in their inception report.

5.1 Document Review and Discussions with the Project Team

Review and analyse of the following documents:

• Proposal document (narrative, Logframe, budget) and amendments
• Baseline survey
• Quarterly reports
• Partner assessments
• Furthermore, discussions and interviews with key programme staff of the IND 1397 project, with special focus on the major success and the main challenges in the project delivery.

5.2 Field visit / observation

• Visit project sites and beneficiary HHs-Nodal partner NGOs
• Observe project impact on beneficiary HHs.

5.3. Survey

Conduct a survey with questionnaire, covering a sample of beneficiaries of a sufficient size and representativeness to allow reasonable levels of certainty that the findings are representative for the target communities.

5.4 Key Informant Interviews and Focus Group Discussions

Meetings and interviews with relevant stakeholders. At a minimum, KII and gender disaggregated FGDs should be conducted with the multiple sets of beneficiaries- School cosmos, Community, Govt officials & local leaders and external consultants and partners.

5.           Managerial Arrangements/ Roles and Responsibilities

The consultant will be responsible for:

• Do a desk review including review of key project documents.
• Provide inception report including draft methodology and mentioning appropriate data collection tools and how these will be utilized during assignment.
• Responsible for field evaluation process such as data collection, interviews
• Conduct fieldwork in an ethical manner
• Responsible for drafting and finalizing the evaluation report within the agreed timelines.
• Facilitate meetings, de-briefing sessions and report sharing sessions with stakeholders in coordination with project team.

The Head of project, project team will help the Consultant for interviews and field visits and will provide the consultant with available documentation.

6.           Deliverables and Reporting Deadlines

This consultancy is expected to start by March 1^st, 2024, with approximately 45 days of overall consultancy period. Consultant is requested to remain available for reviews and improvements until the piece of work is validated by the project team.

Proper workplan with exact timeline will be developed by the consultant depending on the methodology however it is expected to be as following deliverables are expected to be produced by the Consultant: –

• Inception report (not more than12 pages) pages for the main text without front page, table of contents and annexes) (2 days)
• Project team to provide feedback on the IR shared (2 days).
• Consultant to submit final IR (2 days).
• Traveling, Methodology and data collection tools including FGD and KII guide. (15 days)
• Debriefing notes outlining the most important preliminary findings and recommendations (2–4 pages) (After field mission immediately) (1 day)
• Data analysis and PowerPoint presentation of preliminary findings. (5 days)
• Draft report (minimum of 15 pages and a maximum 35 pages, excluding executive summary, table of content and annexes). (7 days)
• Presentation of the draft report to stakeholders. (1 day).
• Project Team & stakeholders to provide feedback and comment on the Drafted report (4 days).
• Final Report (minimum of 15 pages and a maximum 35 pages, excluding executive summary, table of content and annexes). Executive summary of evaluation report has to be handed over also as an additional document in a format to be provided by the team. (5 days)
• Photos: The Consultant should provide a digital file with photos of the evaluation, including photos related to the evaluation process (e.g., of group discussions, interviews, final workshop).

7.           Confidentiality

• All documents and data acquired from documents as well as during interviews and meetings are confidential and to be used solely for the purpose of the evaluation.
• The deliverables as well as all material linked to the evaluation (produced by the Consultant or the organisation itself) is confidential and always remains the property of the contracting party/Welthungerhilfe.

8.           Expertise of the Consultant

At the minimum, the consultant must possess the following:

• Advanced degree in social work, rural development, NGO management, organizational development, fundraising or related fields.
• Over 5 years’ proven experience undertaking surveys and reporting.
• Have previous evaluation expertise, technical knowledge on the major evaluation topics, OECD DAC Criteria
• Experience with gender-responsive/transformative PME, other relevant cross-cutting topics will be an added advantage.
• Excellent organizing, facilitating, presentation and communication skills.
• Excellent report writing skills.
• Experience of working development context, particularly with Indian NGOs
• We will use the following criteria to assess the offers received:
• Proposed approach Coherence and understanding TOR Proposed feasible workplan, Quality of proposal (presentation, writing skills and style)
• Proposed financials/budget.
• Education qualification of consultant
• Experience in leading evaluations in development sector for International NGOs/Institutional Donors/National level NGOs.
• Example of previous reports at least 2-quality of reports
• Consultant fee payment will be paid in two instalments: First Instalment 30% submission of the inception report and the remaining 70% as the final instalment. The first instalment will be paid after completion and validation of the inception report, including methodology and data collection tools, and final instalment will be paid after validation of final report with all required reporting tools.  

9.           Application

Applications should be submitted via e-mail to the e-mail addresses below:

parmarthcsojhansi@gmail.com with a copy to aparna.lall@welthungerhilfe.de

Please include the following in the application: –

• Your CV (max 3 pages)
• Your understanding of the ToR and proposed approach, overall design and workplan for conducting the evaluation (max 5 pages)
• Proposed financial budget for the assignment-fees per working day (plus the respective GST, if applicable), the number of working days proposed and other costs clear breakdown of each item.
• Copies of 2 previous evaluation reports you have conducted. 

Applications will be accepted until 20^th February 2024.e.o.d.   

Job Email id: parmarthcsojhansi(at)gmail.com