Concern Worldwide in the Democratic Republic of Congo (DRC), as the agency responsible for leading the DRC WASH Consortium, is seeking a Consultant or consultancy firm to conduct the final evaluation of the Consortium project. The evaluation should serve the purposes of learning for the Consortium, UK AID, and the WASH sector more broadly, and accountability to external stakeholders. The DRC WASH Consortium was established in July 2013, with the objective of providing sustainable access to water, hygiene and sanitation in over 600 villages in rural DRC. Funded by UK AID, the Consortium is comprised of five international NGOs: Concern Worldwide as lead agency, ACF, ACTED, CRS and Solidarités International. The Consortium project interventions, now in their final year, are currently implemented in two provinces, Central Kasai and Tanganyika.
Overview of the evaluation:
The overall purpose of the assignment is to evaluate the success of the project in delivering on the terms outlined in the project logical framework, in the broader framework of UK AID WASH business case in DRC 2034451 . A Value for Money analysis will provide insight into the quantity and quality of the project results, comparing with appropriate reference benchmarks. As a project mandated with a particular additional focus on learning for the sector, the process should also evaluate the success of small-scale pilot projects undertaken as part of the larger project. Additional evaluation of cross-cutting project themes and of the governance of the Consortium will provide a complementary broader assessment of the design, execution, and management of the project. Overall, the evaluation should emphasise the valued added -if any- by the Consortium to the WASH landscape in DRC and beyond, and any key lessons WASH sector actors may draw from the Consortium experience in rural WASH in DRC.
Evaluation of project results (approx. 35% of workload)
- Based on the OECD-DAC criteria of relevance, effectiveness, efficiency, impact, and sustainability , the Consultant will evaluate progress against the outcomes and outputs of the Consortium as outlined in the project’s logframe:
- IMPACT: Improved health and productivity through reduced morbidity and mortality resulting from waterrelated diseases in rural communities in the DRC.
- OUTCOME: Sustainable and integrated environmental and household health and sanitation which is adopted and managed by communities and integrated with local governance and service provision institutions.
- OUTPUT 1: Individuals demonstrate knowledge of the economic, social, health and environmental advantages of improved water, sanitation and hygiene for their communities at community and household level
- OUTPUT 2: Functioning governance institutions and service providers with increased capacity engage in WASH provision at the micro level
- OUTPUT 3: Representative, accountable and responsive Community Committees are established by community members
- OUTPUT 4: Communities have sustained and improved access to and availability of potable water
- OUTPUT 5: Communities have improved and sustained access to sanitation facilities
- OUTPUT 6: Increased coordination, participation and planning at the macro, meso and micro levels between consortium members and governance structures, service providers and other stakeholders in the WASH sector
- OUTPUT 7: The Consortium produces and disseminates evidence for sustainable, community based solutions to WASH needs in the DRC Within the OECD-DAC framework, the Consultant will put special emphasis on the questions: “Are the results sustainable? (Will the outputs and outcomes lead to benefits beyond the life of the existing project?)”; and “How might we do things better in the future? (Which findings may have relevance for future programming or for other similar initiatives elsewhere?)”
Value for Money analysis (25%) Based on UK AID’s Value for Money Framework (VfM) of economy, efficiency, effectiveness, and costeffectiveness, the Consultant will carry out a fine-tuned analysis of the Consortium financial and operational performance and will assess the full extent to which the project represents good VfM in relation to the quality and quantity of the expected and achieved results. The Consultant will focus particularly on Efficiency and Effectiveness. The Consultant will use similar projects in DRC and in other countries as VfM benchmarks, or other internationally recognised benchmarks, as appropriate.
Evaluation of cross-cutting themes (20%) The Consultant will evaluate the success of the project also according to the following cross-cutting aspects included in the project outline:
- The “economic approach” of the Consortium, i.e. the simplified version of the Life-Cycle Costs Approach that the Consortium has developed and mainstreamed across all of its intervention areas and that is at the core of the Consortium;
- The improved evidence base for WASH projects at the DRC level the Consortium has provided, particularly regarding the relations with and influence on the “National Programme Healthy Schools and Villages” and the contributions to sectoral sharing and learning;
- Other themes are: consistent and effective monitoring and evaluation framework; considerations of gender and equity to inform project implementation; work towards an exit strategy to foster sustainability of results; and accountability to all types of project participants.
Evaluation of pilot projects (10%) Based on the OECD-DAC criteria as indicated above, the Consultant will evaluate the success of small-scale pilot projects carried out as part of the Consortium overall project:
- Integrated emergency preparedness and response to cholera;
- Development of a knowledge management and learning network at provincial level;
- Development of capacity of local governments to plan and manage WASH investments;
- Development of approaches to support user voice and accountability with service providers;
- Support to development of local private sector (supply chains of handpump spare parts);
- Integration of nutrition-sensitive programming into rural WASH interventions. By the time the assignment takes place, those pilot projects will be mostly completed and key data about their scope and results will be available to the Consultant.
Evaluation of Consortium governance (10%) Concern leads the Consortium through management and governance mechanisms such as the Coordination Unit, the Governance Board and Technical Working Groups. A Governance Agreement stipulates the roles and responsibilities of all Consortium agencies and governance bodies, and Sub-grant Agreements stipulate the financial relations between each agency and the lead agency. The Consultant will analyse this governance structure and evaluate its appropriateness and success.
Methodology: The evaluation will be completed no later than the third quarter of 2018. The preferred indicative start date is 1st June 2018. The detailed methodology for the evaluation will be developed by the Consultant and approved by Concern Worldwide as part of the assignment deliverables. The methodology must uphold UK AID’s ethical principles for research and evaluation . At a minimum, the evaluation should draw on:
- Existing data available, including quantitative data collected by the Consortium itself as part of baseline, endline, and post-endline M&E surveys; financial information to support the VfM analysis; and qualitative information included in reports, studies and publications by the Consortium;
- Interviews, workshops, focus group discussions with key stakeholders in Kinshasa (predominantly qualitative);
- Interviews, workshops, focus group discussions with key stakeholders, potentially in our two provinces of intervention (Tanganyika and Kasai Central). These should include the views of direct project participants (men and women).
- It is anticipated that this part of the evaluation will be predominantly qualitative; however, the Consultant may propose to collect additional quantitative data if necessary in addition to the data already available.
- Inception report, including detailed methodology and schedule of the evaluation (5-10 pages excluding annexes);
- Intermediate report, including provisional findings and proposed outline of final report (10-15 pages excluding annexes);
- Final report as per approved outline (20-40 pages excluding annexes);
- Oral presentation of the evaluation findings and recommendations to the Board of the Consortium and/or to UK AID, in DRC (in English);
- Presentation of the evaluation findings and recommendations through one or two 1-hour webinars (one in English, one potentially in French) co-hosted by Concern Worldwide and addressed to Concern Worldwide DRC and/or Head Office personnel.
- Note: All reports should be written in English, with their executive summaries in English and French. However, evaluation work will mostly be undertaken in French. The dissemination of the recommendations of the final report will be the responsibility of Concern Worldwide. Selection requirements Individual Consultants as well as consultancy firms are invited to apply.
- Competence in a broad range of qualitative and quantitative research methods;
- Sound experience in Value for Money analysis;
- Experience in evaluating WASH development projects in Sub-Saharan Africa;
- Experience in evaluating UK AID-funded projects or projects;
- Excellent written English and ease with French as working language;
- Ability to carry out fieldwork in remote locations of DRC;
- Adaptability in dealing with practical constraints that may effect established workplans;
- A highest degree of work ethics, cultural sensitivity and respect for all parties involved in the evaluation.
- Experience in writing reports in French;
- Familiarity with OECD/DAC evaluation framework;
- Experience in DRC.
Instructions to bidders
- Please submit your offer by 12th March 2018 to [email protected]
- The proposal should contain a technical offer and a financial offer:
Technical offer, 20 pages max:
- Company profile if applicable (history of the organisation, list of assignments recently completed in the domain; any other information as appropriate);
- Up to date CV at least of the lead Consultant, explaining how they meet the required profile;
- Technical proposition detailing proposed methodology, schedule including period of availability and resources (approximately 11-13 calendar weeks of work are anticipated from start to end of the assignment, inclusive of fieldwork in DRC and remote work);
- At least one example report from similar work which demonstrates evidence of the skills and experience required.
Financial offer, 3 pages max:
- Detailed list of all expenses expected to be incurred by the Consultant, including all cost-items and daily rates;
- The detailed list of all expenses will specify cost item descriptions, number of units, unit costs and total costs, and will as much as possible avoid lump sums;
- The financial offer will be submitted in Euro by using the template provided.