Jun 20, 2017

Greece: Consultancy - External Evaluation of ECHO funded Refugee Response Greece

NGO/UN Job Vacancy



Organization: Save the Children
Country: Greece
Closing date: 27 Jun 2017

Save the Children is the world's leading independent organization for children, working in over 120 countries around the world. It’s a child rights based organization guided by a Child Safeguarding Policy wherein it aims to ensure that anyone associated with the organization behaves appropriately towards children, never abuses the position of trust that comes with being a part of the Save the Children family, and will respond appropriately to issues of child abuse and the sexual exploitation of children. Save the Children’s mission is to inspire breakthroughs in the way the world treats children, and to achieve immediate and lasting change in their lives. Save the Children envisions a world in which every child attains the right to survival, protection, development and participation.

Since the beginning of 2015, Greece has been the entry point into Europe for more than 1 million refugees and migrants seeking safety and security. For over a year Save the Children International has remained one of the few organizations present at every step of the refugee or migrant child’s journey into Europe; from programs in conflict affected states in the Middle East, Central and South Asia and the Horn of Africa (including Syria, Iraq, Afghanistan, Somalia and Pakistan), across the Balkan region (currently, Greece, FYROM, Serbia and Croatia), into destination countries across northern Europe (including Germany, Denmark, Sweden, Austria and others).

Background

During 2016, 87% of the arrivals came from the world’s top-ten refugee producing countries. As of October 2016, the majority of People of Concern (PoC) came from Syria (47%)[1], followed by Afghanistan (25%) and Iraq (15%). Whilst in 2016 the number of refugees and migrants arriving by sea to Greece has not reached the levels of those in 2015 (168,457 arrivals to date compared to over 856,700 arrivals in 2015), substandard living conditions and risks for PoCs have been exacerbated by the closure of the Greece-FYROM border and the implementation of the EU Turkey Statement in March 2016.

Objective of the programme

In response to the refugee crisis Save the Children (SC) has implemented a one-year ECHO funded project with the aim to meet urgent needs, to alleviate suffering, restore dignity and protect refugee and migrant children and their families in mainland Greece The two main sites for the ECHO project are in Western Thrace and Attica region.

The overall objective for the programme is; ‘To support and protect refugee and migrant children and their families in mainland Greece.’ With a specific objective to provide access to refugee and migrant children and their caregivers to protection, education and health services.

The programme targets refugees and migrants from various countries, that are currently residing in Greece and are likely to continue their stay after the EU-Turkey Statement. This Statement was issued in March 2016, turning the refugee and migrant situation in Greece from transient to a more static situation where people remain in Greece for longer periods of time in order to e.g. seek asylum. The programme is based on an integrated child-centered approach focusing on Child Protection (CP), Education, and Health and Nutrition (IYCF-E), whilst building capacities of national partner NGOs and aiming to target 7,500 children and caregivers

A flexible approach has been crucial for SC to respond to needs as they arise in a rapid manner, in recognition of the fast evolving context of the situation over the implementation period. An integrated child centered programme package is being implemented, consisting of Child and Youth Friendly Spaces (CYFS), case management for vulnerable families and children, including PSS, legal aid and referral to appropriate services as well as emergency alternative care facilities (shelters) for unaccompanied children (UAC). Shelters for unaccompanied children provide care, protection and critical, basic services for unaccompanied boys, including food, health, informal education, cultural and recreational activities, communication support to maintain family links, and legal information and assistance. The integrated child centered approach also comprises mother and baby areas (MBAs), temporary classrooms and community mobilization teams. Furthermore, SC aim to provide training and capacity development related to child protection, education in emergencies and health and nutrition for SC staff, partner NGOs, volunteers and other key stakeholders.

Before start of the evaluation, all relevant project documentation will be shared in order to provide a proper insight in the programme, its beneficiaries and areas of intervention.

Purpose and objectives of the Evaluation

In order to assess and gain further insights into what extent Save the Children Greece has been able to support and protect refugee and migrant children and their families in mainland Greece, through the activities under the ECHO programme, Save the Children Greece is planning an external evaluation.

The external evaluation will have two main purposes.

1) To understand the extent to which the programme has realized achievements related to the programme objectives. This is achieved by assessing the programme against the OECD DAC criteria for Humanitarian Aid.

2) To draw key learnings related to coordination, implementation and value added from the findings. The desired results of the evaluation are to provide best practices, lessons learnt, and recommendations that may be drawn from the findings.

For both objectives, the primary audience is staff from DG ECHO involved in the DG’s refugee response inside the European Union. This staff consists of Brussels-based staff involved in contract management and policy-making and Athens-based Technical Assistants. The secondary audience is Save the Children, other ECHO Partners (NGOs/UNHCR/IOM, etc) and other key stakeholders in the Greek Government. Overall, the evaluation and its report should inform the audiences of the successes, the challenges and relevant learning for future responses. The first objective of the external evaluation is to assess the overall achievements of the programme by analyzing our achievement according to a set of OECD DAC criteria. The selected set of OECD DAC criteria are in line with the objectives of the programme.

The key evaluation questions:

How and to what extent has Save the Children Greece been able to support and protect refugee and migrant children and their families in mainland Greece, through providing refugee and migrant children and their caregivers with access to protection, education and health & nutrition services?

Breaking this down into more specific questions, related to the outputs under the ECHO programme:

1. How and to what extent have refugee and migrant children, including unaccompanied children, benefitted from access to child protection case management, psychosocial support and recreational activities provided by Save the Children and its partners? How did partner NGOs and other key stakeholders benefit from child protection training and capacity development benefit?

2. How and to what extent have refugee and migrant children benefitted from access to relevant emergency education opportunities provided by Save the Children and its partners?

3. How and to what extent have refugee and migrant children and their families benefitted from access to appropriate health and nutrition services provided by Save the Children and its partners?

4. Optional: To what extent have partner agencies and local non-governmental organizations been strengthened by and gained/learned from sector-based coordination and capacity development activities.

The answer to the research questions should be found via the application of the OECD DAC criteria, as such that the OECD DAC criteria will be the framework for the methodology. In order to provide answers to the research questions different combinations of 2 or more of the OCED DAC criteria, relevant to the research questions at hand, should be applied.

1. Effectiveness - Gaining insights in to what extent the wider programme objectives have been achieved and to understand which parameters/determining factors have positively and/or negatively influenced the achievement of the objectives.

2. Relevance - Assessing whether the programme activities and wider objectives are in line with local needs and priorities, and to what extent the programme activities and wider objectives have met the needs of beneficiaries.

3. Efficiency – Assessing to what extent activities in our programme have achieved its purpose. For example, through assessing if the activities have reached the target population and in a timely manner. Did the activities achieve what they were set out to achieve?

4. Coordination – Closely linked to effectiveness, coordination will look more thoroughly at how other actors have been involved in, or have had an effect (positive or negative) on achieving the wider programme objectives. How have actors, such as the government and partners been involved in, our decision making process for example.

5. Coverage – Linked with effectiveness, coverage will assess who was supported by the programme’s intervention. Who has really received support? Looking in more detail at socio-demographic indicators such as gender, ethnicity and other relevant categories.

6. Optional: Impact – this criterion will be looked at from within parameters of a humanitarian intervention and answer the question as to whether the intervention strategy worked. Did it have the intended impact of supporting and protecting refugee and migrant children and their parents through access to protection, education and health & nutrition.

Secondly, the findings from the assessment through these pre-determined criteria and evaluation questions will be used to draw up key learnings related to coordination, implementation and value added. These will result in best practices, lessons learned, and recommendations based on the key findings.

Scope of the Evaluation

The external evaluator is expected to conduct a participatory evaluation providing for meaningful involvement by Partners, beneficiaries, and other interested parties as applicable. The evaluation will maintain focus on the two objectives outlined above – assessment of achievement of the programme through an assessment against OECD DAC Criteria for Humanitarian Aid and to deliver lessons learned and key recommendations based on the findings.

Evaluation Design and Methodology

The detailed evaluation design is to be created by the external evaluation team, however the following guidance should be taken into account:

  • Sampling method is to be decided by the evaluation team, as long the final sample to be evaluated includes all Partners, municipalities, and sectors of the Action. Also, there should be meaningful and safe participation of children and young people.
  • Data collection methods and pace is to be decided by the evaluation team, but should take into account the timeframe and level of access. One-on-one interviews, discussion groups, key informant interviews, and workshops are recommended.
  • Access will be given to previously collected data and information such as Monitoring data, Monthly monitoring reports, interim reports etc. in line with needs.
  • Due to the huge variety of languages spoken amongst refugee and migrant children and their families in mainland Greece, support with translations will be provided.

Timeframe: Start : June 18th 2017

Finalised by: July 31st 2017

Total chargeable working days: 30

Field visits and data collection period scheduled between June 25th and July 14th

Deliverables

1. Inception report with a detailed work plan and methodology for the evaluation

2. Presentation of the methodology and work plan.

3. Draft and final evaluation reports with executive summary, reference materials/ links, annexure, photos etc.

4. Presentation of key findings and Lessons Learned session.

5. All data collected through the assessment in digitalized format, including possible databases, which remains property of Save the Children once the assessment is conducted.

Requested experience:

  1. MSc or higher level education in Social Sciences, Development Studies, International Relations or related.
  2. At least 5 years of experience in research and evaluations in humanitarian contexts.
  3. Extensive experience in the evaluation of ECHO-funded programmes, working with OECD-DAC criteria and development of sound methodologies and how to contextualize and operationalize these criteria.
  4. Demonstrated knowledge of implementing data collection methods, both quantitative and qualitative, and sound data analysis.
  5. Ability to independently process research data and capable to make outcomes understandable to a wide audience through report writing and presentations.
  6. Knowledge of/familiarity with the European refugee crisis and specifically with the refugee response and context in Greece.
  7. Knowledge of/familiarity with Save the Children’s humanitarian response programming.
  8. Selected candidates need to have academic levels of writing in English. Speaking Greek is an asset.

Interested bidders should submit the following:

  1. A brief proposed methodology for how the work will be undertaken (max 2 page). Outlining how to apply the proposed OECD DAC criteria to assess the research questions. It should also include a clear overview of suggested methodologies for data collection.
  2. A succinct work plan and schedule of activities within proposed timeline.
  3. A budget (in EUR) setting out the full cost for the external evaluation, including: a. the daily cost and number of days. b. all other expected costs for the External Evaluation, e.g. transport, accommodation, translations etc.
  4. A CV and an outline of how the bidder meets the skill requirements.
  5. A sample of an output from previous relevant evaluation previously delivered.
  6. Two references.
  7. A letter confirming that the bidder can carry out the external evaluation in the timeframe as stated in the Terms of Reference (ToR).

[1] All numbers from UNHCR portal on the refugee response http://ift.tt/1FP7kXz (13 OCT 2016 figures)


How to apply:

Required:

The successful bidder should be able to:

  1. Work in the EU without further visa arrangements.

  2. Provide a recent Police check /DSB check.

DEADLINE: proposals should be submitted by 18.00 GMT on June 27th 2017 to Save the Children MEAL Advisor in Greece, Simone van Dijk e-mail: simone.vandijk@savethechildren.org

Submissions to this call for proposals will be assessed based on the technical quality (50%) requested skills (30%) and the proposed budget including value for money (20%).

It is expected that this work will be contracted during the week commencing 3rd of July 2017, and for data collection activities to start mid-July. Save the Children reserves the right to negotiate the proposals and budgets with the bidder before offering a contract.

Interested bidders should submit the following:

  1. A brief proposed methodology for how the work will be undertaken (max 2 page). Outlining how to apply the proposed OECD DAC criteria to assess the research questions. It should also include a clear overview of suggested methodologies for data collection.
  2. A succinct work plan and schedule of activities within proposed timeline.
  3. A budget (in EUR) setting out the full cost for the external evaluation, including: a. the daily cost and number of days. b. all other expected costs for the External Evaluation, e.g. transport, accommodation, translations etc.
  4. A CV and an outline of how the bidder meets the skill requirements.
  5. A sample of an output from previous relevant evaluation previously delivered.
  6. Two references.
  7. A letter confirming that the bidder can carry out the external evaluation in the timeframe as stated in the Terms of Reference (ToR).