Jun 19, 2017

Afghanistan: Mid-Term-Evaluation on behalf of Welthungerhilfe Country Office Afghanistan

NGO/UN Job Vacancy



Organization: Welthungerhilfe
Country: Afghanistan
Closing date: 05 Jul 2017

Mid-Term-Evaluation on behalf of WHH Country Office *Afghanistan*

Project title:

Strengthening Food Security and Natural Resource Management in Jawzjan province in Northern-Afghanistan"

Project No.:

AFG-1177

Project holder:

Welthungerhilfe

Approved budget:

Deutsche Welthungerhilfe e.V.

Committed funds:

2.5 Mio EUR

Co-financer (line):

German Federal Ministry for Economic Cooperation and Development (BMZ Private Agencies)

Project period:

01.12.2015 – 31.10.2018

Since Dec 2015, North Regional Office of Welthungerhilfe Afghanistan in Jawzjan - in partnership with one local NGO (PRB – Partners Revitalization and Building) has been implementing a project for food insecure people in three districts (Sheberghan, Khanaqa and Aqcha) of Jawzjan province.

The project main objective is to improve the food and nutrition security in the three districts of Jawzjan. In particular the population of the three districts of Jawzjan is to be supported to regain and improve their livelihoods through activities in the area of agriculture and livestock breeding, internal production of food as well as restoration of and better handling of natural resources.

Project Overall Objective (Impact):

The food and nutrition security in the three districts of Jawzjan has improved.

Project objective (Outcome):

The population of the three districts of Jawzjan was able to restore and improve its livelihood.

Project Outputs / Expected Results:

  1. Farmers can improve their productivity, their diversity and their land management. (Availability, access and stability).

    Target Indicators:

  2. By the project end, 40% of the 800 target farmers increase their productivity by at least 20% and cultivate more different plants (exact value placement takes place after the baseline study).

  3. By the project end, at least 15% more land is irrigated for production purposes than the current land area recorded in the baseline study.

  4. In the year after the PTD (participatory technology development), 50% of the 800 target farmers use techniques for increased diversity and productivity. (Behavioural change /economic status can hinder).

  5. By the project end, at least 60% of the 800 beneficiary farmers have introduced measures to protect soil and water, such as drip irrigation, erosion protection measures, dry crops.

  6. By the project end, 18 farmers (of 24 beneficiaries from the 4 pilot units) achieve at least a 20% higher income from the processing and marketing of selected marketable products.

  7. Livestock owners can improve the productivity of livestock (availability and access).

    Target Indicators:

  8. By the project end, at least 50% of the 1,200 beneficiaries adopt improved management practices and receive better advisory services.

  9. In the year after the implementation of the FFS, 50% of the 1200 FFS graduates apply improved (including environmentally friendly) practices in livestock farming.

  10. By the project end, the livestock owners have restored a total of two hectares of private pastureland.

  11. By the project end, local veterinary assistants deliver services to 600 or 50% of the trained livestock owners.

  12. By the project end, 1,200 (800 male and 400 female) livestock owners have access to medicine and vaccines.

  13. By the project end, at least 8 monitoring reports and at least 8 financial and narrative reports have been submitted by the implementation partner – all of them in accordance with international standards, accurate and in time.

  14. Women (of child-bearing age) can ensure better health and nutrition in the household (use and utilisation).

    Target Indicators:

  15. By the project end, at least 40% of the 432 beneficiary households (HH = 7 members, according to UN) show a generally better nutritional diversity (use of more than 4 food groups), "improved food consumption score" based on the results of the baseline study.

  16. In the year after the training, at least 60% of the 432 beneficiary households continue to care for their kitchen gardens.

  17. In the year after the training, at least 30% of the 432 beneficiary households use SLM methods (mulching, composting, collecting of rainwater).

  18. In the year after the training, 40% of the 432 target households continue to use at least one food preservation method.

  19. At the end of each training course cycle, at least 90% of the 432 women know about nutrition at infant age and in early childhood and 60% apply this knowledge.

  20. At the end of the project, the hygiene in at least 60% of the addressed 432 households has improved (handwashing with soap, water storage, use of toilets).

    Communal facilities and local authorities can better manage and administer the natural resources together (stability).

Target Indicators:

  1. At least 24 functioning NRMCs, at least 30 teachers and students (male and female) of the Institute for Agriculture and Livestock, as well as ten members of the DAIL and DRRD have improved capacities and can better manage and administer the natural resources.

  2. By the project end, 24 NRMCs have administrative plans and processes (including financial plans/processes), in order to improve the usage and ownership structures of restored natural resources.

  3. By the end of the first year of the implementation, 24 villages create an inventory of their natural resources and multiple-year natural resources plans.

  4. By the end of the first year of the implementation, 24 villages create an inventory of their natural resources and multiple-year natural resources plans.

  5. By the project end, 24 villages produce management plans (including financial plans, if necessary), in order to preserve the restored natural goods.

  6. By the project end, 24 villages, civil society organisations and local authorities understand the community-based NRM and their roles in regard to the NRM.

  7. 24 NRMCs and CDCs present their management plans to the responsible ministries, which link the NRM projects with management structures at a higher level.

  8. Ten members of the DAIL and DRRD as well as at least 30 teachers and students (male and female) of the Institute for Agriculture and Livestock Breeding have participated together in four (theoretical and practical) training course meetings about the handling of natural resources and the knowledge increase, such as the linking of science and management, leads to a better understanding and appropriate national planning.

Project Partner:

The activities under result2 (livestock management) are being implemented in partnership with “Partners Revitalization and Building (PRB)” in three districts of Jawzjan province, and Welthungerhilfe is responsible for implementation of three other results which are being implemented in the same mentioned area.

Objective of the Mid-Term Evaluation:

The project holder would like to conduct a mid-term evaluation of the full project. The results will be used by the project holder to improve the work during the remaining half of the project and, pending on observations and recommendations, possibly also guide on whether re-planning or planning adjustments have to be made for the remaining time of the project. The evaluation results will be shared with the donor.

2 Task description

The main tasks for the evaluation team are drafted below. The suggested structure of the report is attached as an annex.

2.1 Questions of specific interest for Welthungerhilfe and its partners

The objective of this Mid-Term evaluation is to provide a comprehensive assessment of the project and an opportunity to critically assess administrative and technical strategies and issues. The evaluation gives recommendations to improve the potential of the Project to achieve expected outcomes and objectives within the project timeframe.

The evaluation aims to determine:

  1. To analyse the design of the project; and evaluate the effectiveness and efficiency of the projects implementation by WHH and partner (PRB) within the agreed contractual conditions, time- frame, work-plan, log frame, and budget.

  2. To analyse the level of coordination and cooperation between WHH, and its partner (PRB) and find out the gaps, shortcoming, weaknesses and strength points.

  3. To analyze that how the intervention improved food security of target groups in the targeted area so far….

  4. To identify and record lesson learn, best practices, strengths and provide recommendations for improvement.

2.2 Criteria for the assessment of the project/ Questions of special interest

For assessment of the project, the evaluation team uses the OECD/DAC criteria of relevance, effectiveness, efficiency, impact and sustainability (see annex 4).

In addition to the OECD/DAC criteria, the evaluator or team should analyse any other pertinent issues that need addressing or which may or should influence future project direction. Based on the observations and findings, the evaluator should come up with clear recommendations for the remaining time of the project.

Relevance: To what extent is the project suited to:

  • Is the Project addressing the right target group in the targeted area and likewise, is the project meet the priorities and needs of target group in the intervention area?

  • Are the Welthungerhilfe relevant standards, procedures and donor priorities considered?

  • Are the activities and outputs of the project consistent with the project primary goal and the attainment of the objectives?

  • Are the activities and output of the project consistent with the intended impacts and effects?

    Effectiveness: To what extent has the project achieved it’s below stated purpose?

  • Farmers have improved access to irrigation water and enhanced their skills in agricultural production techniques, to what extent the intervention increased/will be increased their production and productivity and improved their livelihood.

  • Livestock holders and women have improved their skills through livestock management and kitchen gardening, to what extent the skills applied/will be applied in their daily life/livelihood.

  • To what extent the project helped/will help the target groups food & nutrition security and their livelihood extension.

  • Is the project improved the natural resource management in the area of intervention, to what extent the community NRM plans coordinated with line departments, and to what extent the community NRM plans integrated into provincial annual plan.

  • Are the project results (outputs) achieved/will be achieved in term of quantity and quality, and to what extent the project outcome achieved/will be achieved?

  • To what extend the accountability and transparency considered in the project.

  • What were the major factors influencing the achievement or non-achievement of the objectives?

Efficiency:

  • How cost efficient were the project activities?

  • Were the project objectives detailed above achieved/will be achieved on time?

  • Was the project implemented in the most efficient way?

Impact: What are the positive and negative changes produced by the project, directly or indirectly, intended or unintended?

  • What outcome (positive, negative) can be observed and what impacts expected?

  • What recommendations for the future programme can be made on the basis of the “lessons learnt” and “good practices” in all part of the project, particularly on strengthening partnership?

Sustainability: Assessment on whether the project will be environmentally as well as financially sustainable? Whether the benefits of the project activities are likely to continue after donor funding has been withdrawn.

  • To what extent are the benefits of the project expected to continue once the donor funding has ceased?
  • What are the major factors, which have so far influenced the achievement or non-achievement of sustainability of the programme or project

2.3 Description of context and project

With regard to questions and criteria the evaluation team describes the following: context, status quo of the relevant professional discourse, important actors, the project, experiences of similar projects on the country or international level. This chapter provides information for the analysis in the chapter “relevance.”

2.4 Evaluation design and methodology

As part of the assignment, the successful evaluator will apply a mixture of different methodologies, including primary data collection and review of existing resources:

  1. A desk review of all project-related documents, reports (narrative, financial and monitoring reports), review of proposal and budget and contract with donor and between WHH and its two implementing partners,

  2. Field data collection on a sample of outcomes (selection to be discussed by the evaluator with the project team) to verify data collected to date,

  3. Structured interview with direct & indirect beneficiaries with consideration of sufficient sample size. (Quantitative approach),

  4. Focus group discussions with beneficiaries including girls, boys, men and women, parents, and teachers,

  5. Key informants interview with community representative, relevant government officials and key staff. (Quantitative & Qualitative approach).

As part of the assignment, the evaluator will provide a detailed planning on proposed methodologies. WHH will review the planned methodologies proposed by the evaluator and provide feedback before the evaluation process begins. We would also like the evaluator to suggest any particularly innovative or interesting methodologies they may employ.

A critical assessment and discussion of the project’s strengths and challenges is welcome. Welthungerhilfe is ready to learn from mistakes. The study design should follow international standards concerning accuracy and reliability of data.

2.5 Reporting and documentation

  1. Minutes of the kick-off meeting (a “lighter” form of an inception report), documenting decisions, specifications, agreed dates for field visits, reporting etc. emerging from the meeting.

  2. Debriefing paper, at the end of the field mission that outlines the most important findings of the evaluation, 1-2 pages

  3. Evaluation report, at the latest four weeks after the field mission, 30-45 pages maximum, plus annexes.

  4. Draft management response; integration of the recommendations into Welthungerhilfe’s “management response” form, together with the final version of the evaluation report.

Details of the reports and documentations are included as annex 1.

3 Timetable and phases of the evaluation

Evaluation to begin in first half of August 2017 (time-frame to be discussed with evaluator), and work in the field to be undertaken around an approximately 28 days’ timeline with the final report to be submitted by September 15, 2017 at the latest.

4 Profile of the evaluation team

The evaluator should meet the following criteria:

  1. An advanced degree or equivalent experience in Agriculture, Natural resource management and/or relevant academic field.

  2. At least 5 years of experience working on and evaluating livelihood, food & nutrition security, and natural resource management projects.

  3. Knowledge of livelihood, Food security/Natural resource management sectors in Afghanistan.

  4. Knowledge of partnership models and assessing their effectiveness, especially in a North-South relationship

  5. Clear, effective writer in English

  6. Experience of working with participatory methodologies

5 Quality Check of the evaluation report

Welthungerhilfe will check the quality of the evaluation report. The applied grid is documented as an annex.

The technical proposal for the content of the evaluation must at least contain:

  1. Methodology: detail of the following should be presented

  2. Type of study design

  3. Sampling technique

  4. Data collection technique

  5. Methods of data compilation, analyzing and interpreting

  6. Understanding of the TOR

  7. Organizational experience and capacity to undertake the assignment

  8. The physical input (e.g. computer, printer, fax, telephone and internet access) which would be used by the team of consultant

  9. Work schedule

  10. Composition of the whole evaluation team including data collectors and supervisors

Financial part

The offer should contain the costs of personnel (lead and assistant consultant, enumerators, supervisors, etc) and inputs (stationary, photocopying, etc). Costs for unforeseen expenses should not be included in the calculation.

When preparing budget, the following to be considered;

  • Soft and hard copies of relevant documents will be provided by WHH
  • Transportation will be provided by WHH
  • WHH staff will facilitate community entry
  • Laptop to be provided by the evaluator

Preferred budget structure:

Item

Total Cost (AFN / USD)

Evaluator’s Fee: XX days @ XX AFN / USD Total = XXXX USD/AFN

Other costs (please specify)

Total

7 Proposal evaluation

The evaluation will be done in two stages. During the first stage, the technical part of the proposal will be evaluated and rated. The technical part and the financial part will get 60% and 40% of the evaluation.

8 Termination

If the Client finds that the CONSULTANT is not discharging its duties according to this terms of reference; it may at any time unilaterally terminate the contract and holds the consultants liable for all damages, financial and otherwise including advance payments.

9 Reimbursement and support for proposal preparation:

The cost of preparation of the financial and technical proposals is neither reimbursable nor can be considered as a direct cost of the project.

Annexes

  • Annex 1: Structure of reports and documents

  • Annex 2: Management Response to Project Evaluation

  • Annex 3: Quality check of the evaluation report (Welthungerhilfe)

  • Annex 4: Information about DAC Criteria


How to apply:

Consulting firms or individual freelancing evaluator that fulfill the requirement shall submit as PDF:

  1. Application letter, signed by lead applicant;

  2. Financial and technical proposal with schedule;

  3. Detailed CV of the consulting team;

  4. References

Please note that applications in other format than PDF and applications with an application letter lacking a signature will not be considered.

These should be submitted to afg.kab.hr@welthungerhilfe.de by 5pm July 5, 2017.