Job ID
22602
Job Title
NGOs Capacity Development Impact Evaluation Consultant
To work for
Confidential
Country
Syria
City
Damascus
Field of Work
Quality Control - HR/QM - Administrative
Job Type
Project Based
Military service
Finished or Exempted (For male)
Minimum Education Level
Bachelor/ License Degree
Responsibilities
Context:
Partnerships are central to 2030 agenda of sustainable goals and essential for delivering on the vision and outcomes in UNDPs strategic plan. UNDP has been the key partner for attainment of NGOs in Syria prior and during the crisis, strategic partnerships had proven active and effective with different entities (Gov, Semi Gov, institutions, NGOs and CBOs).
In Syria, and throughout the crisis, local NGOs, FBOs and CBOs showed a high sense of responsibility and immediate action in addressing the local needs mainly in availing the basic commodities such as food and non-food items.
It is foreseen for UNDP to have even greater role in the aftermath of the crisis, the role can be strongly enforced by larger partnerships in terms of scope quality.
However, the NGO sector in Syria, which was mainly focused on charity and philanthropic approaches and interventions, is currently facing mounting challenges in fulfilling a more advanced role in project management, early recovery and livelihoods sector, among others. Challenges include lack of specialized technical capacity, weak internal management and structures, limited capacity for executing large-scale projects, difficult legal environment, complex operational and security contexts. As such, there is a need to improve the NGOs; management skills, strengthen their capacities to cooperate with one another, and promote for more active engagement with the supported communities in terms of planning, development of interventions and their implementation.
Through the last two years, UNDP NGOs Capacity Development Programme had implemented wide range of Capacity Development activities targeting the Syrian NGOs to develop their institutional and individuals; skills and knowledge, these activities include:
- Specialized Interactive Training Workshops comprehend eighteen managerial, financial and technical topics, that were convened based on capacity needs assessment of NGOs from accessible governorates
- Multidimensional On-the-job coaching and mentoring that address the capacity weaknesses of targeted NGOs in more focused manner. The coaches convened Institutional Capacity Gap Analysis for each of the targeted NGOs, then the mentors supervise the assigned NGO key staff through the process of developing the NGO’s strategy, organizational structure, Job Descriptions, KPIs, Accounting tree …etc based on the NGO characteristics and the standard guidance and templates needed
- Networking between the NGOs nationwide by twinning / exchange visits / study tours activities to enhance the capacities of the Syrian NGOs by organizing study tours that provide the participants with the opportunity to interact with other Syrian and Lebanese counterparts in an atmosphere conducive for knowledge sharing and the identification of best practices,
- and to help create common grounds for Syrian and Lebanese NGOs to share their experiences and build future relationships and networks
Objectives of the Assignment
UNDP intends to undertake an independent evaluation to assess its programme supporting engagement and capacities of the national NGOs covering the period 2016-2019. The evaluation must provide evidence-based information that is credible, reliable and useful.
The evaluation is necessary to account for several important processes, including changing the context from crisis to post crisis, and the changing nature and volume of support channelled to the Syrian NGO. The purpose of this evaluation is to inform UNDP as well as key stakeholders on the best programming strategy and approach and for future support to CSOs. The results of this evaluation will be used to inform next phase of the project.
The evaluator is expected to follow participatory and consultative approach ensuring close engagement with relevant national counterparts.
The evaluator needs to assess to what extend the interventions were aligned with the strategy and with UNDP country programme, as well as to what extend gender equity mainstreaming in the programme.
A special focus will be paid to UNDPs implementing partners. Reporting and data should be disaggregated by gender, age, disability as well as ethnicity and wealth to the extend possible.
The evaluation will use the OECD/DAC evaluation criteria of relevance, effectiveness, efficiency, sustainability and impact, as defined in the UNDP Handbook of Planning Monitoring and Evaluation for Development Results . The final report should comply with the UNEG Quality Checklist for Evaluation Reports .
The evaluation should be able to:
- Assess the level of progress made towards achieving the outcome of the programme
- Capture lessons learnt and best practices form the implementation of the project with special focus on consolidated results, including outcomes and impact of the different interventions (at the three levels of the strategy (individual skills and knowledge Institutional level; enabling environment).
-Provide concrete and actionable recommendations (strategic and operational), taking into consideration the previous phases of the project.
- Provide a comprehensive roadmap for the project, based on evaluation findings, conclusions and recommendations.
Partnerships are central to 2030 agenda of sustainable goals and essential for delivering on the vision and outcomes in UNDPs strategic plan. UNDP has been the key partner for attainment of NGOs in Syria prior and during the crisis, strategic partnerships had proven active and effective with different entities (Gov, Semi Gov, institutions, NGOs and CBOs).
In Syria, and throughout the crisis, local NGOs, FBOs and CBOs showed a high sense of responsibility and immediate action in addressing the local needs mainly in availing the basic commodities such as food and non-food items.
It is foreseen for UNDP to have even greater role in the aftermath of the crisis, the role can be strongly enforced by larger partnerships in terms of scope quality.
However, the NGO sector in Syria, which was mainly focused on charity and philanthropic approaches and interventions, is currently facing mounting challenges in fulfilling a more advanced role in project management, early recovery and livelihoods sector, among others. Challenges include lack of specialized technical capacity, weak internal management and structures, limited capacity for executing large-scale projects, difficult legal environment, complex operational and security contexts. As such, there is a need to improve the NGOs; management skills, strengthen their capacities to cooperate with one another, and promote for more active engagement with the supported communities in terms of planning, development of interventions and their implementation.
Through the last two years, UNDP NGOs Capacity Development Programme had implemented wide range of Capacity Development activities targeting the Syrian NGOs to develop their institutional and individuals; skills and knowledge, these activities include:
- Specialized Interactive Training Workshops comprehend eighteen managerial, financial and technical topics, that were convened based on capacity needs assessment of NGOs from accessible governorates
- Multidimensional On-the-job coaching and mentoring that address the capacity weaknesses of targeted NGOs in more focused manner. The coaches convened Institutional Capacity Gap Analysis for each of the targeted NGOs, then the mentors supervise the assigned NGO key staff through the process of developing the NGO’s strategy, organizational structure, Job Descriptions, KPIs, Accounting tree …etc based on the NGO characteristics and the standard guidance and templates needed
- Networking between the NGOs nationwide by twinning / exchange visits / study tours activities to enhance the capacities of the Syrian NGOs by organizing study tours that provide the participants with the opportunity to interact with other Syrian and Lebanese counterparts in an atmosphere conducive for knowledge sharing and the identification of best practices,
- and to help create common grounds for Syrian and Lebanese NGOs to share their experiences and build future relationships and networks
Objectives of the Assignment
UNDP intends to undertake an independent evaluation to assess its programme supporting engagement and capacities of the national NGOs covering the period 2016-2019. The evaluation must provide evidence-based information that is credible, reliable and useful.
The evaluation is necessary to account for several important processes, including changing the context from crisis to post crisis, and the changing nature and volume of support channelled to the Syrian NGO. The purpose of this evaluation is to inform UNDP as well as key stakeholders on the best programming strategy and approach and for future support to CSOs. The results of this evaluation will be used to inform next phase of the project.
The evaluator is expected to follow participatory and consultative approach ensuring close engagement with relevant national counterparts.
The evaluator needs to assess to what extend the interventions were aligned with the strategy and with UNDP country programme, as well as to what extend gender equity mainstreaming in the programme.
A special focus will be paid to UNDPs implementing partners. Reporting and data should be disaggregated by gender, age, disability as well as ethnicity and wealth to the extend possible.
The evaluation will use the OECD/DAC evaluation criteria of relevance, effectiveness, efficiency, sustainability and impact, as defined in the UNDP Handbook of Planning Monitoring and Evaluation for Development Results . The final report should comply with the UNEG Quality Checklist for Evaluation Reports .
The evaluation should be able to:
- Assess the level of progress made towards achieving the outcome of the programme
- Capture lessons learnt and best practices form the implementation of the project with special focus on consolidated results, including outcomes and impact of the different interventions (at the three levels of the strategy (individual skills and knowledge Institutional level; enabling environment).
-Provide concrete and actionable recommendations (strategic and operational), taking into consideration the previous phases of the project.
- Provide a comprehensive roadmap for the project, based on evaluation findings, conclusions and recommendations.
Qualifications
Scope of work
Evaluation criteria and Methodology:
The methodology described in this section is UNDPs suggestion that will likely yield the most reliable and valid answers to the evaluation questions. However, final decision about the specific design and methods for evaluation should emerge from the consultation among the NGOs Engagement Analyst and the assigned evaluator and related stakeholders.
The evaluator is expected to define the information that the evaluation intends to generate, Evaluation pillars are as follows with some guiding questions of concern to be considered by the evaluator under each pillar.
RELEVANCE: The evaluator assesses the degree to which the capacity development interventions responsive to the NGOs context and problems.
Are the adopted capacity development methodologies, topics of training and coaching and the results aligned to the context of NGOs working in the crisis and post crisis context? To what extend has the programme ensured buy-in or political will for the uptake and use of project outputs.
- How has the programme been able to identify and address the NGOs needs and priorities?
- To what extend the implementation modalities have been responsive to immerging needs of the NGOs during the crisis?
- Were the implemented activities contribute to the sustainability of the NGOs work in the after math of the crisis?
- How well has the project addressed the Gender inclusion, women s equality and empowerment? How well gender perspectives have been mainstreamed into the design and implementation of the project?
- How well have the archived results addressed the interests and rights of NGOs serving marginalized and vulnerable groups (PWD, Orphans, Females headed households; etc.).
EFFECTIVENESS: the evaluator will assess the context to which the training interventions results have been achieved. In evaluating effectiveness, it is useful to consider: 1) if the planning activities are coherent with the overall objectives and project purpose; 2) the analysis of principal factors influencing the achievement or non-achievement of the objectives. Under this evaluation criterion the evaluator should, inter alia:
- Was the project effective in focussing on sustainable and stabilized civic sector.
- What have been the main challenges faced by the project and how has the project has sought to overcome them? The evaluator needs to describe and analyse current challenges to implementing transition to longer term interventions.
- What unforeseen and foreseen factors have contributed to achieving (or not achieving) the intended outputs.
- Have the different interventions (training; coaching; exchange visits contributed to supporting beneficiaries from the NGOs? If yes how and why?
- How effective was the benefitted NGOs selection/ targeting?
- Has the project systematically included knowledge management (evaluation, Reviews, etc.) for relevant interventions during implementation? If yes how?
- Has the project managed risks effectively? Refer to the risk analysis matrix as part of the project document and how it was put into action?
EFFICIENCY: measures how economically resources or inputs are converted to results. An initiative is efficient when it uses resources appropriately and economically to produce the desired outputs. Under this evaluation criterion the evaluator should, inter alia:
- How economically have inputs, such as expertise and time, been converted to results?
- To what extend has the project been effective in avoiding duplication, what kind of measures took place for this purpose?
- How do the implementation modalities impacted upon the results achieved (with focus on timely responsiveness by the project management?
IMPACT: the evaluator will provide credible observations regarding the impact. The assessment of the project s impact should take into consideration existing and relevant studies. Under this evaluation criterion the evaluator should inter alia:
- What are benefits to beneficiaries that can be directly attributed to the project?
- What have been direct or indirect, intended or unintended changes that can be attributed to the NGOs support?
SUSTAINABILITY: The evaluator will assess the project capacity to produce benefits over time. In evaluating the project sustainability, it is useful to consider to what extent interventions benefits will continue and benefit the targeted NGOs.
- What is the likelihood that the benefits resulted at the individual level from the previous trainings will be reflected on the performance of the trainees and consequently on their NGOs performance?
- What is the likelihood that the benefits resulted at the institutional level from the previous Mentoring and Coaching will be reflected on the targeted NGOs performance?
The expert may suggest a different evaluation methodology and adopt upon the NGOs Programme Analyst approval.
Final product/Deliverables
Indicative timeline for evaluator main tasks in close coordination with the NGOs engagement and capacity development analyst:
Deliverable - Duration - Milestone - Due Amount
Review all documentation related to the project, including the UNDPs NGOs capacity development strategy, annual reports, training and coaching reports. - 2 weeks
Design the evaluation tools including questionnaires, structured and semi-structured interviews to the approval of UNDP
3 Weeks - 7 May, 2020
Convene at least 20 interviews and a survey for the key actors and stakeholders, including: UNDP NGOs unit staff, MoSAL representatives, UNDP portfolios
Convene survey for a representative sample of NGOs received coaching and mentoring services, Service providers management and staff, as well as Trainees.
2 Months - 30 June, 2020
Draft a comprehensive evaluation report (in English with a summary in Arabic) to be presented to UNDP - One month
Finalize and deliver the report with all annexes including data set, questionnaires, interviews documents, as well as with key findings, lessons learnt and recommendation for future interventions.
3 weeks - 30 Aug, 2020
Evaluation criteria and Methodology:
The methodology described in this section is UNDPs suggestion that will likely yield the most reliable and valid answers to the evaluation questions. However, final decision about the specific design and methods for evaluation should emerge from the consultation among the NGOs Engagement Analyst and the assigned evaluator and related stakeholders.
The evaluator is expected to define the information that the evaluation intends to generate, Evaluation pillars are as follows with some guiding questions of concern to be considered by the evaluator under each pillar.
RELEVANCE: The evaluator assesses the degree to which the capacity development interventions responsive to the NGOs context and problems.
Are the adopted capacity development methodologies, topics of training and coaching and the results aligned to the context of NGOs working in the crisis and post crisis context? To what extend has the programme ensured buy-in or political will for the uptake and use of project outputs.
- How has the programme been able to identify and address the NGOs needs and priorities?
- To what extend the implementation modalities have been responsive to immerging needs of the NGOs during the crisis?
- Were the implemented activities contribute to the sustainability of the NGOs work in the after math of the crisis?
- How well has the project addressed the Gender inclusion, women s equality and empowerment? How well gender perspectives have been mainstreamed into the design and implementation of the project?
- How well have the archived results addressed the interests and rights of NGOs serving marginalized and vulnerable groups (PWD, Orphans, Females headed households; etc.).
EFFECTIVENESS: the evaluator will assess the context to which the training interventions results have been achieved. In evaluating effectiveness, it is useful to consider: 1) if the planning activities are coherent with the overall objectives and project purpose; 2) the analysis of principal factors influencing the achievement or non-achievement of the objectives. Under this evaluation criterion the evaluator should, inter alia:
- Was the project effective in focussing on sustainable and stabilized civic sector.
- What have been the main challenges faced by the project and how has the project has sought to overcome them? The evaluator needs to describe and analyse current challenges to implementing transition to longer term interventions.
- What unforeseen and foreseen factors have contributed to achieving (or not achieving) the intended outputs.
- Have the different interventions (training; coaching; exchange visits contributed to supporting beneficiaries from the NGOs? If yes how and why?
- How effective was the benefitted NGOs selection/ targeting?
- Has the project systematically included knowledge management (evaluation, Reviews, etc.) for relevant interventions during implementation? If yes how?
- Has the project managed risks effectively? Refer to the risk analysis matrix as part of the project document and how it was put into action?
EFFICIENCY: measures how economically resources or inputs are converted to results. An initiative is efficient when it uses resources appropriately and economically to produce the desired outputs. Under this evaluation criterion the evaluator should, inter alia:
- How economically have inputs, such as expertise and time, been converted to results?
- To what extend has the project been effective in avoiding duplication, what kind of measures took place for this purpose?
- How do the implementation modalities impacted upon the results achieved (with focus on timely responsiveness by the project management?
IMPACT: the evaluator will provide credible observations regarding the impact. The assessment of the project s impact should take into consideration existing and relevant studies. Under this evaluation criterion the evaluator should inter alia:
- What are benefits to beneficiaries that can be directly attributed to the project?
- What have been direct or indirect, intended or unintended changes that can be attributed to the NGOs support?
SUSTAINABILITY: The evaluator will assess the project capacity to produce benefits over time. In evaluating the project sustainability, it is useful to consider to what extent interventions benefits will continue and benefit the targeted NGOs.
- What is the likelihood that the benefits resulted at the individual level from the previous trainings will be reflected on the performance of the trainees and consequently on their NGOs performance?
- What is the likelihood that the benefits resulted at the institutional level from the previous Mentoring and Coaching will be reflected on the targeted NGOs performance?
The expert may suggest a different evaluation methodology and adopt upon the NGOs Programme Analyst approval.
Final product/Deliverables
Indicative timeline for evaluator main tasks in close coordination with the NGOs engagement and capacity development analyst:
Deliverable - Duration - Milestone - Due Amount
Review all documentation related to the project, including the UNDPs NGOs capacity development strategy, annual reports, training and coaching reports. - 2 weeks
Design the evaluation tools including questionnaires, structured and semi-structured interviews to the approval of UNDP
3 Weeks - 7 May, 2020
Convene at least 20 interviews and a survey for the key actors and stakeholders, including: UNDP NGOs unit staff, MoSAL representatives, UNDP portfolios
Convene survey for a representative sample of NGOs received coaching and mentoring services, Service providers management and staff, as well as Trainees.
2 Months - 30 June, 2020
Draft a comprehensive evaluation report (in English with a summary in Arabic) to be presented to UNDP - One month
Finalize and deliver the report with all annexes including data set, questionnaires, interviews documents, as well as with key findings, lessons learnt and recommendation for future interventions.
3 weeks - 30 Aug, 2020
Specific Vacancy Requirements
Core Competencies
a. Corporate Responsibility and Teamwork:
- Demonstrates commitment to UNDP s project goals.
- Plans, prioritizes and delivers tasks on time;
b. Results-Orientation:
- Plans and ensures quality results to meet established goals.
Functional Competencies
a. Communication:
- Formulates written information clearly and persuasively;
- Presents information in a clear and articulate manner.
b. Job Knowledge and Expertise:
- Strong analytical skills;
- Advanced writing skills,
Education: Phd. or equivalent in HR Management, Economics, Management or any related field in social science
Experience: Minimum of 5 years of relevant experience in working with NGOs.
- Extensive knowledge in research and assessments (i.e. tools development,
sampling, data collection and analysis).
- Extensive knowledge in analytical reporting.
- Good knowledge of the work of NGOs, with approvals and access to Syrian
governorate.
- Good public relations background.
Language Requirements: Proficiency in Arabic, working knowledge of English is an asset
a. Corporate Responsibility and Teamwork:
- Demonstrates commitment to UNDP s project goals.
- Plans, prioritizes and delivers tasks on time;
b. Results-Orientation:
- Plans and ensures quality results to meet established goals.
Functional Competencies
a. Communication:
- Formulates written information clearly and persuasively;
- Presents information in a clear and articulate manner.
b. Job Knowledge and Expertise:
- Strong analytical skills;
- Advanced writing skills,
Education: Phd. or equivalent in HR Management, Economics, Management or any related field in social science
Experience: Minimum of 5 years of relevant experience in working with NGOs.
- Extensive knowledge in research and assessments (i.e. tools development,
sampling, data collection and analysis).
- Extensive knowledge in analytical reporting.
- Good knowledge of the work of NGOs, with approvals and access to Syrian
governorate.
- Good public relations background.
Language Requirements: Proficiency in Arabic, working knowledge of English is an asset
Salary and Benefits
Negotiable
About us
Consultancy Company
Required employees number
1
Posted On
Mar 26, 2020
Expiry Date
Apr 15, 2020
Photo
Required
CV Language
English