The ARealManIs Programme (ARMI) was initiated in 2016 as a project under our Transformative Masculinity thematic area. In both Zambia and Kenya, masculinity is commonly associated with, and proved through, dominance and control of women. A transformed masculinity aims at enabling men to better handle the social and economic challenges they face, so as to influence them as partners, friends and community members, who take responsibility to stop violence against women.
The #ARMI project therefore aims at empowering young men to end Violence against Women through building transformative participation of young men in the civic sphere. The approaches of the programme engenders positive role modeling and leadership of men and boys to address the societal root causes of VAW which influence hegemonic masculinity so as to change beliefs, values and behavior which contribute to the high prevalence rates of VAW. The approaches adopted are multifaceted including masculinity workshops, community and workplace engagement, intergenerational and gender dialogues as well as edutainment. The project further seeks to prevent domestic violence, cyber-violence, violence in the community and any other harmful practices with the focus to strengthen institutional responses. The project further pursues how Information Communications and Technology contributes to cyber violence and the extent which it feeds into the physical environment as influencer and address the regulation of policy and development thereof to protect woman and girls within the social media and wider online virtual world.
3. Project Strategy:
The overall goal of ARMI is that women and girls are safe and better protected from physical and sexual violence by engaging men and boys in the campaign to end Violence against Women
|1. Social norms adjusted to have men and boys as active participants in the fight against VAW2. New media and ICT integrated in campaigns policy, practice and laws stop VAW3. Networks private sector companies, and organisations engaging men and boys are strengthened as a platform for ending VAW||Training and capacity-building through Masculinity Sessions in schools and communitiesCommunity Outreach meetings and dialogues for the promotion of Gender and Intergenerational discussions to facilitate awareness and to promote social responses by duty bearers of public officers Workplace capacity-building sessions with HR Practitioners for the purposes of alignment and policy development on Anti-Sexual Harassment in the Workplace Workplace sessions for awareness and address of Sexual Harassment in the Workplace with employeesConduct Research studies on ICT and Sexual Harassment in the Workplace Implement new media and social media based campaign on VAW and ICTMedia training on reporting of VAW Facilitate Radio interviews and discussion to promote the #ARMI project||Men and boys have knowledge on masculinity that supports protection of women and physical and sexual violenceMen and boys have skills to be role models shaping initiatives on gender youth and VAW in project areasYoung men and boys influence traditional leaders religious leaders and duty bearers to implement laws and policies related to VAWYoung people and state actors have increased knowledge on ICTs impact on propagating VAWNetworks of CSOs, religious organisations and private companies participate in and support the #ARealManIs CampaignPrivate sector companies adapt/develop anti-sexual harassment policies in their work place|
3.1 #ARMI Project Scope:
The project was implemented in January 2016 and ends in December 2018. The project is active in the final year of the programme.
3.2 Primary Beneficiaries:
The project aims to reach 2500 Women and Girls as primary beneficiaries inclusive of:
The project aims as reaching 3500 Men and boys inclusive of
The project is implemented in Kenya (Kiliﬁ and Mombasa – Coast Province) and Zambia (Lusaka -Central Province and Kitwe -Copperbelt Province) in partnership with Kenya YMCA, Zambia YMCA and PAWA254 and AAYMCA is the lead partner.
The ARMI Project total funding received is $395,250 which has been funded by the UN Trust Fund to End Violence Against Women.
4.1 Purpose of the evaluation
The purpose of the evaluation is to assess the A Real Man Is project overall implementation over the three-year period to determine the efficiency, relevancy, impact, effectiveness and sustainability. It will further purpose to provide the AAYMCA with an objective, unbiased qualified, independent assessment of the project goal achievement and developmental scope of the ARMI project. The project evaluation is also part of the mandatory close-out requirements of the funded project by the UN Trust Fund to End Violence Against Women.
4.1 Evaluation objectives and scope
The results and recommendation of this evaluation will be used as a knowledge-based best practice guide to inform VAW projects from project design and practical intervention approaches to results chains; and to further give practical recommendations into follow-ups of actions for developmental processes in terms of project ownership, partnership, VAW and gender status and interventions as well improvements and strengthening. The scope of engagement will include implementing partners
4.1.1 Scope of Evaluation:
The evaluation timeframe will cover the entire project duration (January 2016 to December 2018) within the project sites of Kenya YMCA and Zambia YMCA and inclusive of collaborating partner activities viz PAWA254 and implementing partner AAYMCA.
The project evaluation will target the project primary and secondary beneficiaries as well as broader stakeholders including community leaders, network partners established and public officials.
4.2 Evaluation Learnings
Key learnings from the evaluation will be applied to inform future programme development but also to serve as a tool for key stakeholder collaboration, engagement and for cross-section programmes in the assessment of multi-level approaches in the field of ending VAW, for learning purposes
4.3 Evaluation questions and criteria
The evaluation questions will serve to determine the effectiveness, relevance, efficiency, impact and sustainability of the ARMI project in structured approach as outlined in the table below:
|Evaluation Criteria||Mandatory Evaluation Question|
|Effectiveness A measure of the extent to which a project attains its objectives / results (as set out in the project document and results framework) in accordance with the theory of change.||To what extent were the intended project goal, outcomes and outputs (project results) achieved and how? 1.1 Did the project have the right mix of activities to address the various project scope areas and community dynamics ? In addressing this question please assess the extent to which the project directly benefited the targeted beneficiaries. At project goal level this refers to primary beneficiaries (women and girls) an at outcome level, secondary beneficiaries (such as men and boys). Please include a table on the number of beneficiaries reached as an annex. If the project was focused on policy or legislation change, please assess the extent to which the project was successful in advocating for that change and whether this is likely to positively benefit women and girls. In all cases please address whether the project achieved results in accordance with the expected theory of change or not.|
|Relevance The extent to which the project is suited to the priorities and policies of the target group and the context.||To what extent do the achieved results (project goal, outcomes and outputs) continue to be relevant to the needs of women and girls?To what extent has the project identified the extent to which VAWG is perpetuated in the project areas and thereby adopted the relevant approaches? Did the project identify a needs-specific intervention in addressing violence against women within a localized context? In addressing this question please assess the extent to which the project strategies and activities were relevant and appropriate to the needs of women and girls and whether the project was able to adjust to any changes in the context and needs of the primary beneficiaries during the project.|
|Efficiency Measures the outputs – qualitative and quantitative – in relation to the inputs. It is an economic term which refers to whether the project was delivered cost effectively.||To what extent was the project efficiently and cost-effectively implemented? 3.1 To what extent did the project workplans details the activity budget allocations and review with substantive basis for cost-effectiveness? In addressing this question, you may wish to consider whether the activities were delivered on time and to budget and whether activities were designed to make best use of resources (e.g. were cost comparisons made between different intervention/activity types before decisions taken?). Also consider whether the project has been managed well to make best use of human and financial resources.|
|Sustainability Sustainability is concerned with measuring whether the benefits of a project are likely to continue after the project/funding ends.||To what extent will the achieved results, especially any positive changes in the lives of women and girls (project goal level), be sustained after this project ends? 4.1 To what extent does the project promote the continued involvement and inclusiveness of male participation? In addressing this question, you may need to assess the likelihood for sustainability (given that the evaluation is conducted at the end of the project when longer-term sustainability cannot yet be assessed). For example, what steps have been taken to institutionalize the project, build capacity of stakeholders or secure benefits for rights holders through accountability and oversight systems?|
|Impact Assesses the changes that can be attributed to a particular project relating specifically to higher-level impact (both intended and unintended).||To what extent has the project contributed to ending violence against women, gender equality and/or women’s empowerment (both intended and unintended impact)? In addressing this question, you may have to repeat some evidence and analysis from question one on effectiveness, however this question should specifically identify any changes in the situation for women and girls in relation to specific forms of violence and look at both intended and unintended change for both women and girls targeted by the project and those not (if feasible).|
|Knowledge generation Assesses whether there are any promising practices that can be shared with other practitioners.||To what extent has the project generated knowledge, promising or emerging practices in the field of EVAW/G that should be documented and shared with other practitioners? How are practical are the products in term so relevancy In addressing this question, it must be clear that the knowledge generated is new, innovative, builds on evidence from other projects or has potential for replication or scale up in other projects or contexts. It should not include generic lessons or knowledge that has already been frequently documented in this context.|
|Gender Equality and Human Rights||Cross-cutting criteria: the evaluation should consider the extent to which human rights based and gender responsive approaches have been incorporated through-out the project and to what extent. Practically this could mean: incorporating an assessment of human rights and gender responsiveness throughout the evaluation questions above – if not obvious; ensuring the evaluation approach and methods of data collection are gender responsive (e.g. women and girls must feel safe to share information); specify that the evaluation data must be disaggregated by sex and other social criteria of importance to the project’s subject.|
4.4 Evaluation design and methodology
The evaluation will use a retrospective and intermediate posttest (single-group design to compare project baseline and ending findings.
Findings will include both quantitative and qualitative data assessment
An endline assessment will be conducted with the trained facilitators, youth, community members, partners and other key stakeholders and feed into the project final evaluation.
The AAYMCA will lead the process of Evaluation planning with respective project site coordinators and further arrange with the project coordinators to:
Additional sources of data for the evaluation will include:
3) Proposed data collection methods and analysis
4) Proposed sampling methods
Project sites for random sampling will include 1 community forum, 2 schools and 2 workplace stakeholders in each of the 4 project sites of Kenya and Zambia project
The AAYMCA who leads the process will select the key informants which will be discussed with the Consultant.
5) Field Visits
The Consultant, after prior arrangement with each stakeholder and informant, will be based in Kenya, Kilifi for 2 days and Mombasa for 2 days
In Zambia, the Consultant will be based in Kitwe for 3 days and in Lusaka for 3 days. During the field visits, the Consultant will meeting with project staff, facilitators, teachers, students and scholars, community members, religious leaders,company HR representatives and local government.
The evaluator/s must put in place specific safeguards and protocols to protect the safety (both physical and psychological) of respondents and those collecting the data as well as to prevent harm. This must ensure the rights of the individual are protected and participation in the evaluation does not result in further violation of their rights. The evaluator/s must have a plan in place to:
The Consultant will further be responsible for:
The Consultant will be required to adhere to framework of key deliverables with specific actions and timelines that is agreed upon between the Consultant and the AAYMCA. The following table will indicate the key deliverables:
|No.||Deliverable||Deadlines of Submission to UN Trust Fund M&E Team||Deadline|
|1||Evaluation Inception Report||This report should be submitted by the evaluator within 2-4 weeks of starting the assessment. The inception report needs to meet the minimum requirements and structure specified in this guideline for UN Trust Fund’s review and approval.||By 7 December 2018|
|2||Draft Evaluation Report||In accordance with the timeline agreed with the evaluator hired by the grantee, however it is recommended that the report is submitted between 1 month and 2 weeks before the final evaluation is due. The Draft Report needs to meet the minimum requirements and structure specified in this guideline for UN Trust Fund’s review and approval.||By 15 January 2018|
|3||Final Evaluation Report||No later than 2 months after the project end date. The Final Report needs to meet the minimum requirements and structure specified in this guideline for UN Trust Fund’s review and approval.||By 15 February 2019|
The Consultant will work on an evaluation workplan with timeframes as indicated in the table below:
|Activity||Number of Days||Dates|
|Review of documentation (proposal reports, baseline study||3 days||Immediate after signing of the contract (30 November 2018)|
|Development of the evaluation methodology and planning (meetings, group discussions, survey questionnaires||2 days||05 December 2018|
|Field visits (meetings and group sessions)||10 days (5 days in each project country||10 December 2018|
|AAYMCA and PAWA254 meetings||1 day (based in Nairobi in the same building||12 December 2018|
|Debrief development with meeting||1 day||13 December 2018|
|Draft report and review||3 days||15 January 2018|
|Final report||3 days||15 February 2018|
Consultant Final Evaluation Report criteria:
The AAYMCA will be require the Consultant to adopt the following quality standards for the final evaluation report:
• English is the preferred language for the report and it has to be written in professional, transparent and without ambiguity
• The Executive Summary should be a concise chapter (not exceeding two pages), highlighting the evaluation mandate, approach, key findings, conclusions and recommendations
• The presentation of information should be well-structured, clearly documented with evidence – based findings and recommendations.
• The information in the report has to address priority or strategic information needs
• The report must contain gender equality and human rights perspectives
Consultant Qualifications and Experience Required
• Master degree in Development Studies, Social Studies and/or other related fields, with five years hands-on experience of social research
• At least three years’ experience in the international development sector in Africa with a working knowledge and experience of gender, human rights and masculinity
• Demonstrable experience of conducting research using qualitative and quantitative tools (questionnaires, interviews, focus groups, case studies, etc.)
• Excellent analysis and report writing skills
• Strong communication and interpersonal skills especially with vulnerable groups
• Experience of engaging with a range of external actors, including interacting with senior government officials and NGOs
• Excellent written and spoken English
• Experience of working on youth-focused or health projects
Qualified candidates should submit the following information: