Job Number: 502419 | Vacancy Link
Work Type : Consultancy
The Government of Viet Nam on 15 March 2016 requested assistance from international partners for its relief efforts, prioritizing support to ensure safe drinking water, sanitation and hygiene practices and nutritional support in drought-affected areas and enhanced monitoring of potential disease outbreaks.
UNICEF led the development of funding proposals on emergency WASH and nutrition, formulated in collaboration and integrated with communication for development and under the framework of the joint Government-United Nations Emergency Response Plan launched in June 2016. Since then, US$4,000,000 has been mobilized to provide critical live-saving humanitarian assistance to approximately 360,000 of the most vulnerable people, including 100,000 children and 140,000 women in 10 target provinces in the Central Highlands, South Central and Mekong Delta regions (Ben Tre, Binh Thuan, Ca Mau, Dak Lak, Gia Lai, Hau Giang, Kon Tum, Ninh Thuan, Soc Trang and Tra Vinh). The nutrition component of assistance seeks to reach 123,200 pregnant/lactating women, 83,835 children aged 6-23 months and an estimated 7,480 SAM cases, while the WASH component seeks to reach 78,000 households including 100,000 children.
In the lower middle-income country context of Viet Nam, the humanitarian-development nexus is critically important as natural hazards exacerbate chronic and persistent vulnerabilities such as poverty, nutrition, water and sanitation. The National Conference on Child-Centered Disaster Risk Reduction (15 December 2016, Ninh Thuan) confirmed that the on-going emergency response – the first time GoV reached out to the international community for support since the reunification – has yielded important lessons learnt and set the strategic direction for child-centered DRR in Viet Nam linking it to Government’s National Socio-Economic Development Plan at the national and subnational levels. The vision and positioning paper jointly prepared by Ministry of Agriculture and Rural Development and UNICEF was largely validated as an apt framework for child-centered DRR in Viet Nam, outlining the strategic cooperation within the framework of the GoV-UNICEF Country Programme 2017-2021.
“An Real Time Evaluation (RTE) is a participatory evaluation that is intended to provide immediate feedback during fieldwork. An RTE provides instant input to an ongoing operation and can foster policy, organizational and operational change to increase the effectiveness and efficiency of the overall disaster response”.
This real time evaluation (RTE) main purpose is primarily learning and secondarily accountability. It is intended to be a support measure for learning in action. Its’ aims is to generate findings, conclusions and recommendations on the on-going emergency. These will immediately inform strategic direction and partnerships of the child-centered DRR and risk-informed programming. They shall be used to adjust and improve planning and performance of the 2017-2021 cooperation programme between UNICEF and the Government of Viet Nam.
The evaluation will look at the following areas:
- the relevance and appropriateness of delivery of the full scope of UNICEF-supported humanitarian assistance to beneficiaries based on needs and context.
- the timely and effectiveness of the response and how the intervention has or is likely to achieve its intended, immediate results.
In light of the above purpose, primary audience of the RTE includes policy and decision-makers from the Government of Viet Nam including the Ministry of Agriculture and Rural Development (MARD), Ministry of Planning and Investment and other relevant line ministries (including Ministry of Health, Ministry of Education and Training, Ministry of Labour, Invalids and Social Affairs), provincial line departments and other partners such as Viet Nam Red Cross that have conveyed keen interest in applying the evidence on an on-going basis to improve national capacities in disaster preparedness and response. MARD and Ninh Thuan province will particularly benefit from the learning, as they lead the development of the project on child-centered disaster risk reduction within the framework of GoV-UNICEF Country Programme 2017-2021. UN agencies including UNICEF will also apply the key learning as joint result areas on disaster risk reduction are considered and discussed within the framework of One UN Strategic Plan 2017-2021. The secondary audience are development partners such as donors of CERF funds and Government of Japan that have provided substantial financial contribution, and other development partners placing priorities on issues of natural disasters and climate change.
 For further information on the characteristics of RTEs see Real-time Evaluations of Humanitarian Action – An ALNAP Guide, Cosgrave, J., Ramalingam, B. and Beck, T. (2009), http://www.alnap.org/resource/5595
The real time evaluation will:
- Identify the extent to which the overall response achieved or did not achieve key objectives including addressing in a timely and meaningful way the needs of women and children.
- Assess the relevance, coherence, effectiveness, coverage, coordination, and sustainability of the emergency response component of the GoV-UNICEF Country Programme 2017-2021 as well as within the national framework of disaster risk preparedness and response.
- Identify good practices and lessons learnt on the Emergency Programme’s design and implementation and to provide recommendations for the Government of Viet Nam-UNICEF Country Programme 2017-2021.
Scope of Work, Evaluation criteria and questions:
Scope of Work:
The evaluation will focus on the emergency response undertaken by UNICEF from April 2016 to January 2017. At geographical level it will focus both at the national level and subnational level. At least 3 out of 10 provinces supported by Emergency Programme will be selected at the subnational level for more in-depth data collection and analysis. The selected provinces are those where technical and financial resources from UNICEF have predominantly focused; and also because of their diversity, representing different regions of Viet Nam.
10 provinces supported by Emergency Programme can be categorized into:
- Gia Lai, Kon Tum, Ninh Thuan (focus provinces in the current and next Country Programme)
- Gia Lai, Kon Tum, Ninh Thuan, Tra Vinh, Ca Mau, Hau Giang (6 provinces with both emergency nutrition and WASH interventions)
- Binh Thuan, Dak Lak, Soc Trang, Ben Tre (4 provinces with only WASH interventions)
For field visit purposes, tentatively 3 provinces will be selected based on a sampling strategy that will be developed and agreed on during the inception phase.
Evaluation criteria and key evaluation questions:
The key RTE questions are:
- What worked well?
- What didn’t work well?
- How can we improve?
The evaluation is expected to answer the following questions, as well as any others proposed and agree on the initial report:
Relevance and coherence:
- How adequate was the UNICEF emergency response as a whole, and what operational results as well as positive and negative outcomes for the affected population did it achieve?
Effectiveness and Coverage:
- What are the factors that facilitate/inhibit the achievement of the objectives? What were areas that fell short of achieving the goals? Have any aspects of the programme achieved results beyond the initial expectation?
- How effectively have cross-cutting areas results been achieved?
- To what extent have the intended beneficiaries have been consulted in the planning and monitoring of UNICEF’s response?
 For example nutrition-WASH linkages, WASH-C4D complementarity, coordination between NCERWASS school WASH supplies and VNRC-led school-based DRR interventions
- How effectively has UNICEF coordinated its response with other key actors in the initial phase of the response and in the transition to early recovery? Has an inclusive and well‐managed coordination system been established early on?? What value did this add?
- How well have UNICEF’s resources, both human and financial, been managed to ensure the most timely, cost-effective and efficient response to the emergency?
- To what extent have innovative or alternative modes of delivering on the response been explored and exploited to reduce costs and maximize results? What has constrained the efficiency of the response?
- When and how have the Government and UNICEF mechanisms facilitated or challenged an efficient emergency response? How has the project operational framework (including establishment of new PMU with NIN and VIHEMA and provinces) facilitated the implementation?
Connectedness and sustainability:
- How appropriately and timely have programme areas included early recovery in the response and mainstreamed risk-informed programming?
- To what extent was the UNICEF Emergency Response aligned to the national, international and inter-agency emergency response priorities.
- To what extent is the Emergency Response linked to the Government of Viet Nam-UNICEF Country Programme 2017-2021?
- How appropriate is the UNICEF Emergency Response for a middle-income country such as Viet Nam? and contributed to setting a practice for humanitarian-development nexus as guided by the commitments of 2016 World Humanitarian Summit?
- What are the enabling as well as constraining factors that influence the sustainability of the Emergency Programme?
- What good practices of the emergency response and early recovery should be sustained at both national and sub-national levels?
NOTE: These questions are a loose set of questions that should be used as basis for the development of a proposal for bidding submission; they can be further prioritized and refined by the selected consultancy team during the inception phase.
 Including of Law on Disaster Prevention and Control, SDGs, Sendai Framework, inter-agency response to emergency and Core Commitments for Children?
Methodology and technical approach
The evaluation will employ mixed methods to triangulate qualitative and quantitative data. A deductive as well as utization focused participatory, interactive and inclusive approach with a range of stakeholders is expected. The RTE will be participatory in its approach, so as to ensure ownership and promote interaction with, and feedback from, the UNICEF response team in country. A full methodological proposal that will contribute to peer-to-peer learning and accountability is expected as part of the inception report.
Quantitative and qualitative data will be collected from at least 3 out of 10 UNICEF-supported provinces under the emergency programme and national level. For collecting qualitative data, the interviewees and focus group participants will be selected on the basis of gender and participatory perspectives. The sampling design will be further discussed prior to implementation of the study.
The evaluation data collection tools may include:
- Desk review
- A survey
- In-depth interviews with key informants, focus group discussion, and consultations with key stakeholders at the national and sub-national levels (including relevant partners, UNICEF, other relevant UN agencies and development partners), observation.
The evaluation will be conducted by an international individual consultant. The consultant can sub-contract national consultant(s) within the proposed budget. The team will develop an evaluation matrix providing explicit linkages between data sources, data collection methods and analysis methods.
The team is to adhere to the Norms and Standards for Evaluation in the UN System (www.unevaluation.org); Ethical Guidelines for UN Evaluators; UNICEF’s revised Evaluation Policy (E/ICEF/2013/14, 18 April 2013); UNICEF Procedure for Ethical Standards in Research, Evaluation and Data Collection and Analysis and UNICEF-Adapted UNEG Evaluation Reports Standards.
Activities, Task, deliverables and timeframe
The team of consultants are expected to undertake the following tasks:
Task, Deliverable, Timeframe:
1. Conduct desk review, interviews at national level, and inception workshop with key stakeholders to agree on the workplan and methodology, Desk review and inception report, 3 days off-site and 3 days on-site: 3-10 February 2017.
2. Undertake first field data collection in 1 provinces, Initial findings from the field trip, 4 days on-site: 13-24 February 2017.
3. Undertake second field data collection in 2 province, Summary of key findings and recommendation, 8 days on-site: 27 February – 3 March 2017.
4. Develop a draft report, Draft evaluation report, 7 days off-site: 6-17 March 2017.
5. Present the preliminary findings at conference, Power Point Presentation, Meeting minutes, 1 days on-site: 28-29 March 2017.
6. Finalize the evaluation report incorporating inputs from the participants, Final evaluation report with key recommendations, 2-page summary of key findings and recommendations, 4 days off-site: 2-7 April 2017.
Total: 30 working days
Note: Start date and detailed timeframe would be discussed and finalized between the consultant and UNICEF.
Desk review and inception report – The desk review and initial report will be a scoping exercise for the RTE and will include the proposed methodologies, data collection and reporting plans with draft data collection tools such as interview guides, the allocation of roles and responsibilities within the team, a timeframe with firm dates for deliverables, and the travel and logistical arrangements for the team.
Debriefings / feedback to management at all levels: The team will report its preliminary findings to the field and Hanoi.
Draft report: A draft report identifying key findings, conclusions, recommendations and lessons for the current and future report, will be submitted by the team leader within two weeks of the evaluation team’s return from the field.
Final report: The final report will contain a short executive summary (no more than 1,000 words) and a main body of the report (no more than 10,000 words) covering the background of the intervention evaluated, a description of the evaluation methods and limitations, findings, conclusions, lessons learned, clear recommendations. Recommendations should be specific and feasible. The report should also contain appropriate appendices, including a copy of the ToR, cited resources or bibliography, a list of those interviewed and any other relevant materials. The final RTE report will be submitted one week after receipt of the consolidated feedback from UNICEF. 2-page summary highlighting the key findings and recommendations will also be developed to inform high-level policy dialogue.
Direct supervisor of this consultancy is the Head of the Emergency Programme. The consultant team will work closely with Representative, Planning, Monitoring and Evaluation Unit. and Emergency Team, and in close consultations with UNICEF programmes, operations and communication team, UN Disaster Risk Management Teams and relevant Government partners.
In addition, management and governance arrangements for the evaluation will be established with a view to maximizing the credibility and hence utility of the evaluation.
Qualifications and experience required:
In view of the purpose, scope, focus of the evaluative work, UNICEF is looking for the individual consultant with the following qualifications:
International consultant (team leader, should a national consultant be sub-contracted):
- Must hold at least a Master’s Degree in related field (Social Sciences, Public Administration, Economics, Political Sciences)
- At least 7 years of recognized experience in conducting or managing/leading evaluations, research or review of development programmes, and experience as team leader of evaluation team and as main writer of evaluation reports
- At least 10 years progressively responsible experience including evaluative and analytical work on humanitarian performance at an organization or interagency level for an organization comparable to UNICEF;
- Exposure to UNICEF’s humanitarian work, including in middle-income country context;
- Knowledge of current evaluative and analytical literature on the humanitarian sector in general;
- Excellent and proven research skills including development and application of analytical frameworks and tools and production of analytical papers;
- Familiarity with the social and human rights-based approach internationally and the Convention on the Rights of the Child.
- Excellent research and analytical skills and experience, especially in facilitating key informant interviews and focused groups discussions with various groups of stakeholders (particularly children).
- Good skills in grasping the very complex project situation in a short time frame.
- Excellent analysis skills in writing evaluation reports with constructive and practical recommendations. Good audience‐oriented communication, teamwork and presentation skills.
- Language: Excellent knowledge of written and spoken English.
The international consultant can sub-contract national consultant(s) within the proposed budget. The International Consultant will be fully responsible for recruitment of the National Consultant and be fully responsible for all negotiations, decisions and deliverables. Should this be the case, the national consultant should have the following qualifications:
National consultant (team member):
- Must hold at least a Master’s Degree in relevant social science field (Social Sciences, Public Administration, Economics, Political Sciences);
- At least 5-7 years progressively responsible experience including evaluative and analytical work on humanitarian performance at an organization or interagency level for an organization comparable to UNICEF;
- Significant knowledge of current evaluative and analytical literature on the humanitarian sector in general;
- Proven experience and skills on research, especially in facilitating key informant interviews and focused groups discussions with various groups of stakeholders (particularly children); data collection and processing, data analysis and production of analytical research reports for different international development agencies preferably UN system in the field of social development.
- Demonstrated familiarity with the Vietnamese institutional and political context;
- Familiarity with the rights-based approach and the Convention on the Rights of the Child.
- Good observation and analytical skills in grasping the very complex project situation in a short time frame. Excellent skills in writing reports. Good audience‐oriented communication, teamwork and presentation skills.
- Experience in participatory approach is an asset. Excellent communication and facilitation skills and ability to manage diversity of views in different cultural contexts.
- Language: Excellent knowledge of written and spoken English and Vietnamese.
Technical evaluation criteria and relative points
Technical Criteria, Technical Sub-criteria, Maximum Points
Overall Response: Completeness of response, 10, Overall concord between TOR/RFP and proposal, 5
Company and Key Personnel: Qualifications and experience of proposed team leader and team member, 20
Proposed Methodology and Approach
Understanding of the TOR objectives in the proposal, 5
Evaluation design as per TOR objectives, 20
Innovative approaches proposed, 10
TOTAL MAXIMUM: 70
Weighted ratio between the technical and the price criteria: (70:30)
Only those proposals that score 50 points on the technical proposal will be shortlisted.
To view our competency framework, please click here.
Interested candidates are kindly requested to apply online and submit the following documents:
1. Technical proposal including 2-pages outlining the approach and methodology.
2. Financial Proposal: The consultant must prepare a financial proposal with breakdown of cost including the consultancy fee, per-diems, all travel and transportation costs and other ancillary costs including the costs of sub-contracting the national consultant (if any) (1 page).
3. Three Referees with details of similar consultancy assignments.
4. The Consultant must annex a copy (or provide web-link) of 1 similar piece of research performed previously by the Consultant.
5. The Consultant must complete and submit a P-11 form (UN Personal History Form)
Closing date for receipt of applications is 20 January 2017 at 18:00 hours Viet Nam Time.
UNICEF is committed to diversity and inclusion within its workforce, and encourages qualified female and male candidates from all national, religious and ethnic backgrounds, including persons living with disabilities, to apply to become a part of our organisation.
Opening Date 13 Jan 2017 SE Asia Standard Time
Closing Date 20 Jan 2017 SE Asia Standard Time