Purpose and Scope of Assignment
The Terminal Evaluation (TE) report will assess the achievement of project results against what was expected to be achieved during Phase 1 (including the response to Covid-19, for the period 2014-2024), and draw lessons that can both improve the sustainability of benefits from the programme. The TE is expected to aid in the enhancement of UNDP Nature, Climate, Energy, Chemicals and Waste programming, with particular relevance to the empowerment of Indigenous Peoples and the SDG objective to Leave No-One Behind (LNOB) as part UNDP management response to IEO LNOB evaluation.
The TE report promotes accountability and transparency and assesses the extent of project accomplishments. The TE will be submitted to the BMUV International Climate Initiative (IKI) to inform and accompany Phase 2 of the ‘Global Support Initiative for Indigenous Peoples and Community-Conserved Territories and Areas: 30 x 30’ (PIMS 6693) which was launched at CBD COP15 in Dec 2022 (22M EUR), and will be running from 2023-2028 in alignment with the Kunming-Montreal Global Biodiversity Framework (GBF).
Main Responsibilities
TE Approach & Methodology
The TE must provide evidence-based information that is credible, reliable and useful.
The TE will review all relevant sources of information, including documents prepared during the preparation phase, including the BMUV proposal development, UNDP Social and Environmental Screening Procedure (SESP), the Project Document, BMUV biannual reports, project budget revisions, lesson learned reports, national strategic and legal documents, and any other materials that consider useful for this evidence-based evaluation. The incumbent will review the IKI Indicators and project-level tracking tools (i.e., ICCA Security Index and SGP database) before undertaking the TE field missions to target participating countries.
The TE is expected to follow a participatory and consultative approach ensuring regular engagement with the ICCA GSI project team (Programme Manager and Programme Associate); UNDP Vertical Fund oversight and quality assurance colleagues; UNOPS focal point(s) for the programme; GSI global partners (ICCA Consortium, UNEP WCMC, IUCN); SGP Central Programme Management Team (CPMT) and National Coordinators (NCs); government counterparts; UNDP Country Office(s); direct beneficiaries and other stakeholders.
The engagement of stakeholders will be vital to undertake a successful TE. Stakeholder involvement should include interviews with stakeholders who have project responsibilities, including but not limited to executing agencies, senior officials and task team/component leaders, key experts and consultants in the subject area, the project board, project beneficiary partners, SGP National Steering Committee (NSC) members including a representative from academia, local government and CSOs. Additionally, the incumbent is expected to conduct field missions to three of the following six countries (to be confirmed): Ecuador, Malaysia, Madagascar, Mongolia, Panama or Tanzania, including the small-grant project sites in the target countries (for the Mid-Term Review (MTR) of the ICCA GSI, conducted in 2020 subject to Covid-19 restrictions, the following country assessments were conducted in Colombia, Morocco, Senegal and Vietnam, and are not as a consequence proposed for country visits as part of the Terminal Evaluation). In case of language considerations pertaining to the incumbent selection, alternatives from the list of 45 participating countries may be considered.
The specific design and methodology for the TE should emerge from consultations between the incumbent and the above-mentioned parties regarding what is appropriate and feasible for meeting the TE purpose and objectives and answering the evaluation questions, given the limitations of budget, time and data. The incumbent is expected to use gender-responsive methodologies and tools and ensure that gender equality and women’s empowerment, responsivity to the UN System-Wide Action Plan on Indigenous Peoples (SWAP), persons with disabilities, as well as other cross-cutting issues and SDGs, are incorporated into the TE report.
The final methodological approach, including interview schedule, field visits and data to be used in the evaluation (i.e. questionnaires, surveys, interviews, group Zoom/on-line webinars and calls) should be clearly outlined in the inception report and be fully discussed and agreed between UNDP, stakeholders and the incumbent. The final TE report should describe the full TE approach taken and the rationale for the approach making explicit the underlying assumptions, challenges, strengths and weaknesses about the methods and approach of the evaluation.
Detailed Scope of the TE
The TE will assess project performance against expectations set out in the project’s Logical Framework/Results Framework (see TOR Annex A). The TE will assess results according to the criteria outlined in the Guidance for TEs of UNDP-supported VF-financed projects (insert hyperlink). (The scope of the TE should detail and include aspects of the project to be covered by the TE, such as the time frame, and the primary issues of concern to users that the TE needs to address.
The Findings section of the TE report will cover the topics listed below. A full outline of the TE report’s content is provided in ToR Annex C.
The asterisk “(*)” indicates the criteria for which a rating is required.
Findings
1 Project Design/Formulation
- National/regional/global priorities and country driven-ness
- Theory of Change
- Gender equality and women’s empowerment
- Indigenous Peoples’ empowerment
- Social and Environmental Safeguards
- Analysis of Results Framework: project logic and strategy, indicators
- Assumptions and Risks
- Lessons from other relevant projects (e.g. same focal area) incorporated into project design
- Planned stakeholder participation
- Linkages between project and other interventions within the sector
- Management arrangements
2 Project Implementation
- Adaptive management (changes to the project design and project outputs during implementation)
- Actual stakeholder participation and partnership arrangements
- Project Finance and Co-finance
- Monitoring & Evaluation: design at entry (*), implementation (*), and overall assessment of M&E (*)
- Implementing Agency (UNDP) (*) and Executing Agency (*), overall project oversight/implementation and execution (*)
- Risk Management, including Social and Environmental Standards
3 Project Results
- Assess the achievement of outcomes against indicators by reporting on the level of progress for each objective and outcome indicator at the time of the TE and noting final achievements
- Relevance (*), Effectiveness (*), Efficiency (*) and overall project outcome (*)
- Sustainability: financial (*), socio-political (*), institutional framework and governance (*), environmental (*), overall likelihood of sustainability (*)
- Country ownership
- Gender equality and women’s empowerment
- Indigenous Peoples’ empowerment
- Cross-cutting issues (SDG leaving no-one behind, poverty alleviation, improved governance, climate change mitigation and adaptation, disaster prevention and recovery, human rights, capacity development, South-South cooperation, knowledge management, volunteerism, as relevant)
- BMUV IKI Additionality
- Catalytic Role / Replication Effect
- Progress to impact
4 Main Findings, Conclusions, Recommendations and Lessons Learned
- The TE will include a summary of the main findings of the TE report. Findings should be presented as statements of fact that are based on analysis of the data.
- The section on conclusions will be written in light of the findings. Conclusions should be comprehensive and balanced statements that are well substantiated by evidence and logically connected to the TE findings. They should highlight the strengths, weaknesses and results of the project, respond to key evaluation questions and provide insights into the identification of and/or solutions to important problems or issues pertinent to project beneficiaries, UNDP and BMUV, including issues in relation to gender equality, women’s and Indigenous Peoples’ empowerment.
- Recommendations should provide concrete, practical, feasible and targeted recommendations directed to the intended users of the evaluation about what actions to take and decisions to make. The recommendations should be specifically supported by the evidence and linked to the findings and conclusions around key questions addressed by the evaluation.
- The TE report should also include lessons that can be taken from the evaluation, including best practices in addressing issues relating to relevance, performance and success that can provide knowledge gained from the particular circumstance (programmatic and evaluation methods used, partnerships, financial leveraging, etc.) that are applicable to other BMUV IKI and UNDP interventions. When possible, the TE should include examples of good practices in project design and implementation.
- It is important for the conclusions, recommendations and lessons learned of the TE report to include results related to gender equality and empowerment of women.
The TE report will include an Evaluation Ratings Table, as shown in the ToR Annex.
Monitoring and Progress Controls
Expected Outputs and Deliverables
The incumbent shall prepare and submit:
- TE Inception Report: TE clarifies objectives and methods of the TE no later than two weeks before the planned TE country missions. The incumbent submits the Inception Report to the Commissioning Unit and project management. Approximate due date: [1 February 2024]
- Presentation: The incumbent presents initial findings to project management and the Commissioning Unit at the end of the TE country missions. Approximate due date: [30 March 2024]
- Draft TE Report: The incumbent submits full draft report with annexes within 3 weeks of the end of the TE mission. Approximate due date : [15 May 2024]
- Final TE Report* and Audit Trail: incumbent submits revised report, with Audit Trail detailing how all received comments have (and have not) been addressed in the final TE report, to the Commissioning Unit within one week of receiving UNDP comments on draft. Approximate due date: [30 June 2024]
*The final TE report must be in English. If applicable, the Commissioning Unit may choose to arrange for a translation of the report into a language more widely shared by national stakeholders.
All final TE reports will be quality assessed by the UNDP Independent Evaluation Office (IEO). Details of the IEO’s quality assessment of decentralized evaluations can be found in Section 6 of the UNDP Evaluation Guidelines (access at: http://web.undp.org/evaluation/guideline/section-6.shtml).
TE Arrangements
The principal responsibility for managing the TE resides with the Commissioning Unit. The Commissioning Unit for this project’s TE is the UNDP BPPS Vertical Funds Directorate.
The Commissioning Unit will contract the consultants and ensure the timely provision of travel arrangements and expenses within the country for the incumbent.
The annexes mentioned above are found in attachment to this vacancy