Contract to Conduct Endline Evaluation on Worker WellBeing Project

NGO Jobs / UN Jobs Vacancy

Organization: CARE USA
Closing date: 23 Mar 2021

CARE is seeking a consultant(s) to conduct an end-line evaluation of the Worker Well-Being Project in order to provide final report to the donor, capture details on impact and analyze lessons learned to be applied to future programming. Background CARE is a humanitarian non-governmental organization committed to working with poor women, men, boys, girls, communities, and institutions to have a significant impact on the underlying causes of poverty. CARE seeks to contribute to economic and social transformation, unleashing the power of the most vulnerable women and girls. The Made by Women (MbW) strategy seeks to ensure women in the garment industry have access to decent jobs, are free from violence and harassment and can give voice to their rights at work. Since 2016, Made by Women has been working in 11 countries across Asia and Africa to bring about positive changes in the lives of women garment workers. For more information, please refer to our 2019 Impact Report. The Worker Wellbeing Project in Bangladesh, Indonesia and Vietnam is a 3.5-year project running from January 2018 through June 2021. The purpose of the Worker Wellbeing Project is to improve wellbeing for garment workers through access to dignified working conditions, legal and social protections and gender equitable relationships. Through this project, CARE aims to equip and empower workers to improve their own working conditions and hold the readymade garment industry more accountable for workers’ rights. This empowers workers to raise their collective voice and advocate with factory owners and management for more gender equality, career advancement, and greater access to employee benefits like health services, maternity leave, and accurate overtime compensation. The Worker Wellbeing Project is led and implemented by CARE, working with 17 factories across the three countries and has four expected outcomes as outlined below: 1. Garment workers have an organized voice and social dialogue platform through which they can promote respect for their rights and improved well-being. 2. Employers have a positive outlook towards worker empowerment and gender equality and take action to promote them, enable and engage in social dialogue and respond appropriately to workers’ demands. 3. Local Authorities and Service providers provide accessible, gender responsive services to women garment workers. Governments regulate and effectively implement regulations to ensure respect for women workers’ rights in the garment industry. 4. Men and boys adopt positive gender norms that enable the economic empowerment and wellbeing of women workers. To achieve the goal, the Worker Wellbeing Project implements the following key activities, aligned with the project’s overall purpose and outcomes: TERMS OF REFERENCE 2 • Formation of Empowerment, Knowledge and Transformative Action (EKATA) groups of women garment workers. EKATA groups formulate action plans and implement collective action in their homes, communities and workplaces. • Training and capacity building for EKATA leaders and members • Support for collective action of EKATA groups, including co-research, small grants, community outreach events, engagement with local authorities and service providers, and dialogues with employers and landlords. • Merging and networking of EKATA groups into broader networks and movements of women workers. • Engaging men and boys sessions • Activities in factories (Bangladesh only) - leadership training for workers, gender sensitization training for managers and supervisors, facilitation and capacity building for worker-management committees. • Advocacy, including research and analysis, coalition building, campaigning and technical assistance; particularly in relation to ILO Convention 190 and the Vietnam Labor Code 2019 and Guiding Decree. Purpose, Objectives, and Rationale The endline evaluation will be conducted to assess change and impact resulting from the Worker Wellbeing Project in Bangladesh, Indonesia and Vietnam. The evaluation intends to explain how access to dignified working conditions, legal and social protections and gender equitable relationships can lead to improved worker wellbeing in the garment sector. The evaluation will also explore the different activities that can lead to improved worker wellbeing in the garment sector across the three different countries. The endline evaluation is planned to take place in Bangladesh, Indonesia and Vietnam from March 2021 to June 2021. The evaluation is looking not only for intended outcomes, but also evidence of unintended outcomes (both positive and negative). The objectives of the evaluation are as follows: 1. To provide an objective assessment of the achievements and results, weaknesses and strengths of the project. 2. To document evidence, lessons learned and good practices of project implementation to inform future programming. 3. To evaluate the quality and effectiveness of program delivery – this will cover both CARE and its implementing partners – by looking into the strengths and weaknesses of activity implementation and program management; quality of outputs and their appropriateness and perceived value to target communities; and identifying factors that appear to enhance or detract from the quality. 4. To present evidence of changes (intended and unintended, positive and negative) associated with activity interventions and outputs; assess how well the observed changes reflect the Key Performance Indicators (KPI) and Log Frame (LF); and identify factors in the implementation or context that impede or promote the observed and intended changes. Intended Users and Use The evaluation findings and process will be used as evidence in CARE’s final reporting of the project to the donor. The evaluation report will also provide learning to benefit employers, local authorities and service providers and worker’s organizations as they develop wellbeing programmes for garment workers. Findings from the evaluation will also be used by CARE Bangladesh, CARE Indonesia, CARE Vietnam and CARE TERMS OF REFERENCE 3 International as we continue to learn from and develop our Dignified Work portfolio and promote women’s economic justice around the world. Evaluation Criteria and Questions The endline evaluation will attempt to answer the following questions: 1. To what extent have EKATA and the Women in Factories models supported meaningful participation of women garment workers in decision-making about their living and working conditions and led to improved worker wellbeing? What changes has this led to in their living and working conditions and to what extent can these be attributed to the project activities? 2. To what extent has the project facilitated men and boys in homes, communities and workplaces to support the meaningful participation of women garment workers in decision-making about their living and working conditions and develop more gender equitable relationships? 3. How and to what extent has the project contributed to changes in public policy and/or strengthened duty-bearer responsiveness to the rights and needs of women garment workers in their workplaces, communities and homes? 4. Which particular activities in the project made a difference? How can we explain why some activities work well, or better than others? How does interaction between activities relate to the project outcomes? What was the influence of other factors in the project? 5. What is the long-term sustainability of this project? The endline evaluation also seeks to understand the gender implications of the Worker Wellbeing project, so research tools and frameworks should be designed to integrate the following gender analysis questions: 1. How has the project affected women and men in different ways? 2. How has the project affected relations between women and men in the target group, and in their wider communities and workplaces? 3. How have the roles, status and aspirations of women and men affected the project activities? To what extent have roles, status and aspirations of women and men changed over the course of the project? 4. To what extent do men and boys, including managers and supervisors in factories, demonstrate gender equitable attitudes towards women garment workers? CARE’s MEL principles and standards All deliverables in this evaluation are required to meet CARE’s standards and principles of evaluation. The evaluation should always respect the security and dignity of the stakeholders with whom CARE works, incorporating gender and power elements throughout the evaluation – at design, implementation, analysis and reporting stages. To gain a better understanding of potential differences in gender and power elements, evidence should be able to be disaggregated by sex, age and other relevant diversity, etc. TERMS OF REFERENCE 4 CARE’s principles of evaluation are summarised below: Evaluation design, implementation and analysis should also uphold principles of responsible data management and ethical standards held by CARE International. CARE’s primary ethical principles and practice in evaluation are summarised below, including but not limited to: Principle Practice Respect for all persons • Informed consent obtained and documented • Voluntary participation/ no coercion • Protection of participants’ privacy Beneficence/ Do No Harm • Procedures with the least risk should always be used • Risks reasonable in relation to benefit • Confidentiality maintained Justice • Select participants equitably • Avoid exploitation of vulnerable populations • Practice data minimization • Practice gender inclusivity Approach and Methodology The endline evaluation will use a mixed methods approach. The contractor will be responsible for defining and carrying out the overall evaluation approach. This will include specification of the techniques for data collection and analysis, structured field visits and interactions with project participants and the evaluation team. Evaluation tools, methodology and findings should be reviewed and validated with various stakeholders and approved by the programme managers for Worker Wellbeing at CARE Bangladesh, CARE Indonesia and CARE Vietnam. Methodologies used for this research should be both participatory and inclusive. Both quantitative and qualitative data should be collected, based on the type of data needed for the comprehensive evaluation. The consultant(s) will be responsible for defining and coordinating the overall research approach, which will include specification of the techniques for data collection and analysis, project management of data collection across three countries, and managing each of the national evaluation teams. Evaluation tools, methodology and findings should be reviewed and validated with various stakeholders and approved by relevant staff at CARE prior to implementation. Applicants should demonstrate how the evaluation will be carried out against travel and other constraints due to COVID-19, including considerations of data collection technology; approaches to phone interviews; oversight of data quality; access of populations to mobile phones etc. Note that different approaches will be considered, ranging from entirely remote data collection to a mix of in-person and remote data collection if CARE’s Evaluation Principles ❶ Evaluation is conducive to Accountability. ❷ Evaluation is conducive to Learning and potentially to Multiplying Impact. ❸ Evaluation balances purpose, methodological rigor and capacity. ❹ Evaluation considers ethical implications and is conducive to gender equality. ❺ Evaluation findings are dynamic and lead to action. ❻ Evaluation contributes to CARE’s global evidencing efforts. TERMS OF REFERENCE 5 the applicant has on-the-ground research capacity in the countries of interest (preferred). CARE will provide a set of resources to support data collection, based on our experience to date with research during the COVID19 pandemic. Primary Data The collection of primary data will involve a mix of qualitative and quantitative methods including surveys, structured and semi-structured interviews and focus-group discussions. CARE is also interested in theorybased, qualitative evaluation methods such as outcome harvesting and most significant change, though these methods would need to be included within an overall mixed-methods approach. To answer the key evaluation questions, data will be collected using purposively selected samples from intervention sites, and participants will be selected from both direct and indirect targeted groups. Some of the key stakeholders that must be targeted through the primary data collection include: • EKATA group members • In-factory training participants and worker-management committee members (Bangladesh) • Managers and supervisors • Men and boys who have participated in project activities in workplaces and communities • Worker’s organizations • Local authorities and service providers • Relevant government ministries and departments The data collection process will include: Qualitative data collection conducted with key stakeholders. Within each targeted location, several participants will be selected for Key Informant Interviews (KII), Focus-Group Discussion (FGDs) and other theory-based methods to better understand the effectiveness of key interventions in the project. Quantitative data collection will be conducted with a random sample of all participants of training sessions and EKATA groups as they are direct participants in the project. The method will use primarily surveys to triangulate qualitative data collected through interviewing. Secondary Data The process will include: a desk review of existing literature, including project proposal, reports, baseline reports, mid-term pre- and post-training results, and other relevant quantitative and qualitative secondary data to establish and assess the outcomes of the project. Roles, Responsibilities, and the Evaluation Timeline CARE’s preferred structure for the evaluation team is to have a lead evaluator responsible for overall design and management of the evaluation, working either from a project country or remotely, and national evaluators in each of the three project countries (Bangladesh, Indonesia and Vietnam) who can lead contextualization of data collection tools and data collection itself (directly and/or through enumerators) in consultation with CARE’s offices in the respective countries. The lead evaluator will coordinate directly with the CARE contract holders at the Regional Management Unit and with focal points from CARE offices in each country, while national evaluators will work primarily with focal points from the CARE office in their country. During data collection and analysis, the primary roles of CARE program staff and any implementing partner with direct stake in the project, are as informants and reviewers. They may review and provide comments on TERMS OF REFERENCE 6 data collection tools, instruments, and all other deliverables before they are finalized. They must not collect primary data, or participate in translation, analysis, or interpretation of the data. The following table delineates the proposed evaluation timelines and milestones during the evaluation process. All work must be completed by 15 June 2021 at the latest. Table 1. Evaluation timeline and milestones. Evaluation Activities February 2021 March 2021 April 2021 May 2021 June 2021 Recruitment of evaluation consultants complete X X Review of baseline reports and other program documents X Determining sample size, including inclusion and exclusion criteria for each target group in project sites X Design of research tools (surveys, interview guides) X Pre-testing and refine of survey tools X Selection and training of data collection/ field staff X Data collection / field work, including: Interviews, FGD, Survey, Collecting project documentation X X Quality Control - monitoring and supervision; data reporting X X Data analysis and report of findings X X Dissemination of program evaluation findings X Required External Response to Terms of Reference A technical and cost proposal based on this Terms of Reference (ToR) is requested from the consultant or consulting firm. The proposal should contain: 1. Detailed plan of action for field work indicating staff-days required and how the team will approach data collection given constraints of COVID-19 2. Specific roles and responsibilities of the team leader, supervisory chain and other core members of the evaluation team. 3. Schedule of key activities preferably in a format such as a Gantt chart. 4. Detailed budget with justification. The external evaluation proposal should include a reasonable detailed budget to cover all costs associated with the evaluation. This should be submitted by major activities and line items for CARE’s review and decision. This includes a break-down of the cost to contract external evaluation team members, international and local travel, and in-country lodging and per diem. Other related costs that might be in the budget include expenditures for hiring local personnel (drivers, translators, enumerators and other local technical experts), translating reports, and renting meeting rooms for presentations/workshops. 5. Updated CV of Team Leader and other core members of the Evaluation Team 6. A profile of the consulting firm (including a sample report if possible) Expectations Final Evaluation Report Deliverables The consultant will submit to CARE International the following: 1. Final English version of all research tools, including interview and FGD guides and surveys 2. Final endline schedule, and training materials used and provided to enumerators during training sessions TERMS OF REFERENCE 7 3. Management and supervision of data entry (only if un-able to do electronic data collection) 4. All datasets and data collection report, inclusive of a detailed description of the sample (number of respondents disaggregated by tool type, sample point, and respondent-specific identifiers such as gender, age and conditions), issues faced during data collection, entry, and cleaning, and solutions used (including any changes in protocols), and a description of the databases generated. The analysis of data quality should be included in the data collection report. 5. All materials from the data collecting processes, including and but not limited to, reports, photos, videos, presentations, outline, and project documents from implementing partner and trade unions. The consultant will submit the following three documents to CARE as part of the final reporting requirements: 1. Final Project Evaluation Report – structured to meet donor requirements 2. Process document to capture learning The final project evaluation report must include: • A Title: A title that conveys the name of the project, location, implementation period, as well as the main impact or key finding of the report. • An executive summary that focuses both on process as well as impact that is no more than 2 pages in length and is formatted so that it can be printed as a stand-alone 2-pager about the project. • A display of impact early in the report, including 3-5 key impacts/findings and a table summarizing baseline/endline data per indicator: What changed because of the program? What happened in the world, and why did it matter? These are the most significant accomplishments, supported by solid evidence. Each impact should be written as one or two sentences. Lay out the main impact findings and values from baseline to endline per indicator (preferably in the form of a table summarizing baseline and endline values for each indicator). • A clear methodology section: the methodology should explain the evaluation questions, and how the methodology chose appropriately answers those questions. It should also contain key ethical considerations and a description of how the evaluators protected participants and personally identifiable information. • 3-5 key lessons learned: These should be short, actionable, and the most important aspects of what the program/analysis found. They need to be relevant and new for people outside of the direct program. They should also include highlights of what to improve in the future • 3-5 bullets describing how the project got to impact/3-5 recommendations: It is important to have non-jargon descriptions of what a project did to get to impact. These are highlights of the most effective, relevant, and scalable approaches and tools. If this is an analysis and not an evaluation, then this section should be 3-5 key recommendations for what the project/program/initiative should do based on your findings. Shareable Evidence: Evidence collected by the external evaluation from the conclusions and recommendations must be submitted along with the final report. All datasets, qualitative interviews, and underlying data are owned by CARE and are included in final deliverables. Sources of all evidence must be identified and conclusions must be based only on evidence presented in the report, and recommendations must directly correspond to the conclusions. Budget Note that the contract for this consultancy will be effective from the Asia Regional Office in Thailand and accordingly withholding taxes applicable as per Thai law will be deducted from the fees, which can go up to 15%. TERMS OF REFERENCE 8 Annexes Annex 1. Data Disclosure The external evaluator should deliver, at minimum, all files including: quantitative data sets (raw and refined products), transcripts of qualitative data and others in an easy to read format, and maintain naming conventions and labelling for the use of the Worker Wellbeing project and key stakeholders. All documents should be compliant with the following conditions: • CARE requires that the datasets that are compiled or used in the process of external evaluation are submitted to CARE when the evaluation is completed. • Data must be disaggregated by gender, age and other relevant diversity, etc. • Datasets must be anonymized with all identifying information removed. Each individual or household should be assigned a unique identifier. Datasets which have been anonymized will be accompanied by a password protected identifier key document to ensure that we are able to return to households or individuals for follow up. Stakeholders with access to this document will be limited and defined in collaboration with CARE during evaluation inception. • In the case of textual variables, textual datasets or transcripts please ensure that the data is suitable for dissemination with no de-anonymizing information UNLESS these are case studies designed for external communication and suitable permission has been granted from the person who provided the data. In these circumstances, please submit, with the case study, a record of the permission granted, for example a release form1 . • Where there are multiple datasets (for example both tabular and textual datasets) identifiers must be consistent to ensure that cases can be traced across data lines and forms. • CARE must be provided with a final template of any surveys, interview guides, or other materials used during data collection. Questions within surveys should be assigned numbers and these should be consistent with variable labelling within final datasets. • Formats for transcripts (for example: summary; notes and quotes; or full transcript) should be defined in collaboration between CARE and the external evaluator at the evaluation inception • In the case of tabular datasets variable names and variable labels should be clear and indicative of the data that sits under them. Additionally, the labelling convention must be internally consistent and a full codebook/data dictionary must be provided. • All temporary or dummy variables created for the purposes of analysis must be removed from the dataset before submission. All output files including calculations, and formulae used in analysis will be provided along with any Syntax developed for the purposes of cleaning. • We require that datasets are submitted in one of our acceptable format types. • CARE must be informed of and approve the intended format to be delivered at evaluation inception phase. Should this need to be altered during the project CARE will be notified and approval will be needed for the new format. • The external evaluator will be responsible for obtaining all necessary permissions, approvals, insurance, and other required permits needed for data collection. These include required permits related to data collection from human subjects, including necessary ethical review board approvals (ERB) and health and accident insurance for evaluation team members. Proposals should be submitted by email to by 5pm (Bangkok time) on 18 March 2021 with “MbW Endline Evaluation” as the subject line

How to apply:

Please send email to

Apply to Job


Popular posts from this blog

Head Anticipation Hub (m/f/d)

Escuintla Associate, Guatemala

Consultant - Market System Development & Value Chain Development