ANNOUNCEMENT – NEW GENERAL SECRETARY, AFRICA ALLIANCE OF YMCA
November 20, 2018
Show all

Consultant for End of Project Evaluation

Terms of Reference: Final Evaluation

Name of Project being Evaluated: A Real Man Is

1.     Introduction:

The Africa Alliance of YMCAs is the umbrella body for Young Men’s Christian Association (YMCA) National Movements in Africa. We have in our network YMCA National Movements in 24 countries. Our vision is to Empower Young People for the African Renaissance. From Subject to Citizen (S2C) is our youth empowerment model that seeks to give youth a voice, space and ability to influence change in their community. We do this by providing Power Spaces where young people experience self-discovery, unlock their potential and connect with opportunities. S2C and Power Spaces are further implemented in 4 key thematic areas: Transformative Masculinity, Economic Renaissance, Youth Justice and Civic Action. We work closely with our member movements and provide them with Technical Support for Youth Programming and organisational sustainability.

2.     Programme Background

The ARealManIs Programme (ARMI) was initiated in 2016 as a project under our Transformative Masculinity thematic area. In both Zambia and Kenya, masculinity is commonly associated with, and proved through, dominance and control of women. A transformed masculinity aims at enabling men to better handle the social and economic challenges they face, so as to influence them as partners, friends and community members, who take responsibility to stop violence against women.

The #ARMI project therefore aims at empowering young men to end Violence against Women through building transformative participation of young men in the civic sphere. The approaches of the programme engenders positive role modeling and leadership of men and boys to address the societal root causes of VAW which influence hegemonic masculinity so as to change beliefs, values and behavior which contribute to the high prevalence rates of VAW. The approaches adopted are multifaceted including masculinity workshops, community and workplace engagement, intergenerational and gender dialogues as well as edutainment. The project further seeks to prevent domestic violence, cyber-violence, violence in the community and any other harmful practices with the focus to strengthen institutional responses. The project further pursues how Information Communications and Technology contributes to cyber violence and the extent which it feeds into the physical environment as influencer and address the regulation of policy and development thereof to protect woman and girls within the social media and wider online virtual world.

3.    Project Strategy:

The overall goal of ARMI is that women and girls are safe and better protected from physical and sexual violence by engaging men and boys in the campaign to end Violence against Women

Outcomes Key Activities Outputs
1.  Social norms adjusted to have men and boys as active participants in the fight against  VAW2.  New media and ICT integrated in campaigns policy, practice and laws stop VAW3.   Networks private sector companies, and organisations engaging men and boys are                 strengthened as a platform for ending VAW Training and capacity-building through Masculinity Sessions in schools and communitiesCommunity Outreach meetings  and dialogues for the promotion of Gender and Intergenerational discussions to facilitate awareness and to promote social responses by duty bearers of public officers Workplace capacity-building sessions with HR Practitioners for the purposes of alignment and policy development on Anti-Sexual Harassment in the Workplace   Workplace sessions for awareness and address of Sexual Harassment in the Workplace with employeesConduct Research studies on ICT and Sexual Harassment in the Workplace Implement new media and social media based campaign on VAW and ICTMedia training on reporting of VAW   Facilitate Radio interviews and discussion to promote the #ARMI project    Men and boys have knowledge on masculinity that supports protection of women and physical and sexual violenceMen and boys have skills to be role models shaping initiatives on gender youth and VAW in project areasYoung men and boys influence traditional leaders religious leaders and duty bearers to implement laws and policies related to VAWYoung people and state actors have increased knowledge on ICTs impact on propagating VAWNetworks of CSOs, religious organisations and private companies participate in and support the #ARealManIs CampaignPrivate sector companies adapt/develop anti-sexual harassment policies in their work place

3.1 #ARMI Project Scope:

The project was implemented in January 2016 and ends in December 2018. The project is active in the final year of the programme.

 3.2 Primary Beneficiaries:

The project aims to reach 2500 Women and Girls as primary beneficiaries inclusive of: 

  • Female scholars
  • Female employees
  • Female community members
  • Female political activists/human rights defenders
  • Lesbian, bisexual, transgender women and girls in general
  • Women/girls with disabilities
  • Women/girls living with HIV and AIDS
  • Secondary Beneficiaries: 

The project aims as reaching 3500 Men and boys inclusive of

:

  • Civil society organizations (including NGOs)
  • Community-based groups/members
  • Educational professionals (i.e. teachers, educators)
  • Scholars
  • Faith-based organizations
  • General public/community at large
  • Government officials (i.e. decision makers, policy implementers)
  • Health professionals Journalists/Media Legal Officers

The project is implemented in Kenya (Kilifi and Mombasa – Coast Province) and Zambia (Lusaka -Central Province and Kitwe -Copperbelt Province) in partnership with Kenya YMCA, Zambia YMCA and PAWA254 and AAYMCA is the lead partner.

The ARMI Project total funding received is $395,250 which has been funded by the UN Trust Fund to End Violence Against Women.  

4.1  Purpose of the evaluation

The purpose of the evaluation is to assess the A Real Man Is project overall implementation over the three-year period to determine the efficiency, relevancy, impact, effectiveness and sustainability. It will further purpose to provide the AAYMCA with an objective, unbiased qualified, independent assessment of the project goal achievement and developmental scope of the ARMI project. The project evaluation is also part of the mandatory close-out requirements of the funded project by the UN Trust Fund to End Violence Against Women.

4.1 Evaluation objectives and scope

The results and recommendation of this evaluation will be used as a knowledge-based best   practice guide to inform VAW projects from project design and practical intervention approaches to results chains; and to further give practical recommendations into follow-ups of actions for developmental processes in terms of project ownership, partnership, VAW and gender status and interventions as well improvements and strengthening. The scope of engagement will include implementing partners

4.1.1 Scope of Evaluation:

The evaluation timeframe will cover the entire project duration (January 2016 to December 2018) within the project sites of Kenya YMCA and Zambia YMCA and inclusive of collaborating partner activities viz PAWA254 and implementing partner AAYMCA.

The project evaluation will target the project primary and secondary beneficiaries as well as broader stakeholders including community leaders, network partners established and public officials.   

4.2 Evaluation Learnings

Key learnings from the evaluation will be applied to inform future programme development but also to serve as a tool for key stakeholder collaboration, engagement and for cross-section programmes in the assessment of multi-level approaches in the field of ending VAW, for learning purposes  

4.3 Evaluation questions and criteria

The evaluation questions will serve to determine the effectiveness, relevance, efficiency, impact and sustainability of the ARMI project in structured approach as outlined in the table below:

Evaluation Criteria   Mandatory Evaluation Question
Effectiveness A measure of the extent to which a project attains its objectives / results (as set out in the project document and results framework) in accordance with the theory of change. To what extent were the intended project goal, outcomes and outputs (project results) achieved and how? 1.1   Did the project have the right mix of activities to address the various project scope areas and community dynamics ? In addressing this question please assess the extent to which the project directly benefited the targeted beneficiaries. At project goal level this refers to primary beneficiaries (women and girls) an at outcome level, secondary beneficiaries (such as men and boys). Please include a table on the number of beneficiaries reached as an annex. If the project was focused on policy or legislation change, please assess the extent to which the project was successful in advocating for that change and whether this is likely to positively benefit women and girls. In all cases please address whether the project achieved results in accordance with the expected theory of change or not.
Relevance The extent to which the project is suited to the priorities and policies of the target group and the context. To what extent do the achieved results (project goal, outcomes and outputs) continue to be relevant to the needs of women and girls?To what extent has the project identified the extent to which VAWG is perpetuated in the project areas and thereby adopted the relevant approaches? Did the project identify a needs-specific intervention in addressing violence against women within a localized context? In addressing this question please assess the extent to which the project strategies and activities were relevant and appropriate to the needs of women and girls and whether the project was able to adjust to any changes in the context and needs of the primary beneficiaries during the project.
Efficiency Measures the outputs – qualitative and quantitative – in relation to the inputs. It is an economic term which refers to whether the project was delivered cost effectively.  To what extent was the project efficiently and cost-effectively implemented? 3.1   To what extent did the project workplans details the activity budget allocations and review with substantive   basis for cost-effectiveness? In addressing this question, you may wish to consider whether the activities were delivered on time and to budget and whether activities were designed to make best use of resources (e.g. were cost comparisons made between different intervention/activity types before decisions taken?). Also consider whether the project has been managed well to make best use of human and financial resources.
Sustainability Sustainability is concerned with measuring whether the benefits of a project are likely to continue after the project/funding ends. To what extent will the achieved results, especially any positive changes in the lives of women and girls (project goal level), be sustained after this project ends? 4.1    To what extent does the project promote the continued involvement and inclusiveness of male participation? In addressing this question, you may need to assess the likelihood for sustainability (given that the evaluation is conducted at the end of the project when longer-term sustainability cannot yet be assessed). For example, what steps have been taken to institutionalize the project, build capacity of stakeholders or secure benefits for rights holders through accountability and oversight systems?
Impact Assesses the changes that can be attributed to a particular project relating specifically to higher-level impact (both intended and unintended). To what extent has the project contributed to ending violence against women, gender equality and/or women’s empowerment (both intended and unintended impact)?   In addressing this question, you may have to repeat some evidence and analysis from question one on effectiveness, however this question should specifically identify any changes in the situation for women and girls in relation to specific forms of violence and look at both intended and unintended change for both women and girls targeted by the project and those not (if feasible).
Knowledge generation Assesses whether there are any promising practices that can be shared with other practitioners. To what extent has the project generated knowledge, promising or emerging practices in the field of EVAW/G that should be documented and shared with other practitioners? How are practical are the products in term so relevancy   In addressing this question, it must be clear that the knowledge generated is new, innovative, builds on evidence from other projects or has potential for replication or scale up in other projects or contexts. It should not include generic lessons or knowledge that has already been frequently documented in this context.
Gender Equality and Human Rights   Cross-cutting criteria: the evaluation should consider the extent to which human rights based and gender responsive approaches have been incorporated through-out the project and to what extent. Practically this could mean: incorporating an assessment of human rights and gender responsiveness throughout the evaluation questions above – if not obvious; ensuring the evaluation approach and methods of data collection are gender responsive (e.g. women and girls must feel safe to share information); specify that the evaluation data must be disaggregated by sex and other social criteria of importance to the project’s subject.  

 4.4 Evaluation design and methodology

  1.  Proposed evaluation design

The evaluation will use a retrospective and intermediate posttest (single-group design to compare project baseline and ending findings.

Findings will include both quantitative and qualitative data assessment

  •  Data sources

An endline assessment will be conducted with the trained facilitators, youth, community members, partners and other key stakeholders and feed into the project final evaluation.

The AAYMCA will lead the process of Evaluation planning with respective project site coordinators and further arrange with the project coordinators to:

  • Organise meetings, interviews, visits, workshops as requested by the consultant.
  • Provide transport and logistical practicality for the visits.
  • Provide a translator for English/local language requirements when necessary.  

 Additional sources of data for the evaluation will include:

  • Partner project reports and pre/post questionnaires from training sessions
  • Project reports
  • Stakeholder interviews including project and partner staff, county government officials, UN Women and identified key individuals

3) Proposed data collection methods and analysis

  • The Consultant will visit project sites and conduct interviews with key informants as part of the facilitation of the endline assessment
  • The AAYMCA and partners will provide documentation and monitoring/report data
  • Secondary data records and sources will also be used
  • Baseline surveys will also be used in support of the endline assessment and final evaluation  

 4) Proposed sampling methods

Project sites for random sampling will include 1 community forum, 2 schools and 2 workplace stakeholders in each of the 4 project sites of Kenya and Zambia project 

The AAYMCA who leads the process will select the key informants which will be discussed with the Consultant.

          5) Field Visits

The Consultant, after prior arrangement with each stakeholder and informant, will       be based in Kenya, Kilifi for 2 days and Mombasa for 2 days

  In Zambia, the Consultant will be based in Kitwe for 3 days and in Lusaka for 3 days. During the field visits, the Consultant will meeting with project staff, facilitators, teachers, students and scholars, community members, religious leaders,company HR representatives and local government.

  • Evaluation ethics  

The evaluator/s must put in place specific safeguards and protocols to protect the safety (both physical and psychological) of respondents and those collecting the data as well as to prevent harm. This must ensure the rights of the individual are protected and participation in the evaluation does not result in further violation of their rights. The evaluator/s must have a plan in place to:

  • Protect the rights of respondents, including privacy and confidentiality;
  • Elaborate on how informed consent will be obtained and to ensure that the names of individuals consulted during data collection will not be made public;
  • If the project involves children (under 18 years old*) the evaluator/s must consider additional risks and need for parental consent;
  • The evaluator/s must be trained in collecting sensitive information and specifically data relating to violence against women and select any members of the evaluation team on these issues.
  • Data collection tools must be designed in a way that is culturally appropriate and does not create distress for respondents;
  • Data collection visits should be organized at the appropriate time and place to minimize risk to respondents;
  • The interviewer or data collector must be able to provide information on how individuals in situations of risk can seek support (referrals to organizations that can provided counseling support, for example)

The Consultant will further be responsible for:

  • Review of relevant documents at project and programme level  
  • Development of evaluation questions based on the above review and a strategy for the analysis and proposes a work plan for the evaluation.
  • Work closely with AAYMCA, Kenya YMCA M Zambia YMCA and 
  • Conducting a debriefing with the AAYMCA Coordinator and the key project     coordinators from the partners. 
  • Key deliverables of the Consultant and timeframe

The Consultant will be required to adhere to framework of key deliverables with specific actions and timelines that is agreed upon between the Consultant and the AAYMCA.  The following table will indicate the key deliverables:

No. Deliverable Deadlines of Submission to UN Trust Fund M&E Team Deadline  
1 Evaluation Inception Report This report should be submitted by the evaluator within 2-4 weeks of starting the assessment. The inception report needs to meet the minimum requirements and structure specified in this guideline for UN Trust Fund’s review and approval.  By 7 December    2018
2 Draft Evaluation Report In accordance with the timeline agreed with the evaluator hired by the grantee, however it is recommended that the report is submitted between 1 month and 2 weeks before the final evaluation is due. The Draft Report needs to meet the minimum requirements and structure specified in this guideline for UN Trust Fund’s review and approval. By 15 January 2018
3 Final Evaluation Report  No later than 2 months after the project end date. The Final Report needs to meet the minimum requirements and structure specified in this guideline for UN Trust Fund’s review and approval. By 15 February 2019  
  • Management arrangements of the evaluation 

The Consultant will work on an evaluation workplan with timeframes as indicated in the table below:

Activity Number of Days Dates
Review of documentation (proposal reports, baseline study 3 days Immediate after signing of the contract (30 November 2018)
Development of the evaluation methodology and planning (meetings, group discussions, survey questionnaires 2 days 05 December 2018
Field visits (meetings and group sessions) 10 days (5 days in each project country 10 December 2018
AAYMCA and PAWA254 meetings 1 day (based in Nairobi in the same building 12 December  2018
Debrief development with meeting 1 day 13 December  2018
Draft report and review 3 days 15 January 2018
Final report 3 days 15 February 2018
     

Consultant Final Evaluation Report criteria:

The AAYMCA will be require the Consultant to adopt the following quality standards for the final evaluation report:

•         English is the preferred language for the report and it has to be written in professional, transparent and without ambiguity   

•         The Executive Summary should be a concise chapter (not exceeding two pages), highlighting the evaluation mandate, approach, key findings, conclusions and recommendations

•         The presentation of information should be well-structured, clearly documented with evidence – based findings and recommendations. 

•         The information in the report has to address priority or strategic information needs

•         The report must contain gender equality and human rights perspectives

Consultant Qualifications and Experience Required

•         Master degree in Development Studies, Social Studies and/or other related fields, with five years hands-on experience of social research

•         At least three years’ experience in the international development sector in Africa with a working knowledge and experience of gender, human rights and masculinity

•         Demonstrable experience of conducting research using qualitative and quantitative tools (questionnaires, interviews, focus groups, case studies, etc.)

•         Excellent analysis and report writing skills

•         Strong communication and interpersonal skills especially with vulnerable groups

•         Experience of engaging with a range of external actors, including interacting with senior government officials and NGOs

•         Excellent written and spoken English

•         Experience of working on youth-focused or health projects

Application Procedure:

Qualified candidates should submit the following information:

  • A Cover letter
  • A Technical proposal which shall include the following:
  • Brief explanation about the lead and associate consultants with particular emphasis on previous experience in this kind of work
  • Understanding of TOR and the task to be accomplished
  • Proposed methodology
  • Draft work/implementation plan
  • Budget as per scope of work to be undertaken
  • Copies of reports of previous work conducted.
  • A personal capacity statement  
  • Applications are to be submitted for attention Stacey Hoys at stacey@africaymca.org
  • Deadline for applications: 30 November 2018.

Leave a Reply

Your email address will not be published. Required fields are marked *