An Evaluation of the Aboriginal Youth Leadership Program

Transcription

1 1 An Evaluation of the Aboriginal Youth Leadership Program Prepared for: Canada World Youth May 25, 2015

2 2 Apex Consultants Christine Sheppard Evaluation Manager Tin Vo Qualitative Design Specialist Michael Mackinley Quantitative Design Specialist Darly Dash Community Developer Shilpa Soni Ethical and Cultural Advisor

3 3 Presentation Overview Brief overview of the Aboriginal Youth Leadership Program Evaluation Approach and Questions Evaluation Matrix Proposed Methodology Challenges & Mitigation Strategies Cultural & Evaluation Competencies

4 4 Canada World Youth Increase the ability of youth to participate actively in the development of just, harmonious, and sustainable societies 43 years of experiential & transformative learning 37,000 youth participants 1,000,000 hours of community development projects

5 5 Programs for Aboriginal Youth 79 Aboriginal youth in [CWY] gave me the tools to understand my own cultural context better, and it helped me make sense of the differences we face in relation to mainstream Canadian culture Debrief sessions + External Evaluation Cultural Pride Bridge gap between Aboriginals and non-aboriginals Leadership capabilities Multi-disciplinary network

6 6 Aboriginal Youth Leadership Program Asset Based Approach Aboriginal knowledge & culture Community organizations & partnerships Regional, national & international cooperation Various funding sources Knowledge Skills Strategies Academic & Employment Goals

7 7

8 8 ALYP Stakeholders Private donors & sponsors Policy Centres CWY Academic Centres Aboriginal communities Aboriginal Youth First Nation, Metis, Inuit Research Centres AYLP Program Staff United Nations Evaluation Advisory Committee (EAC)

9 9 Activities To Date & Future Plans Activities To Date: Labrador Aboriginal Youth Abroad to Parakuyo (exchange) World Conference of Indigenous Peoples (UN event) Aboriginal Youth & Confederation (youth forum) Future Plans: Develop curriculum Offer an abroad exchange, internships & conferences Strengthen multi-disciplinary network

10 10 Key Factors Internal Funding Partnerships External Conflicting CWY opportunities Societal stigma Labour force needs Political context

11 11

12 12 Evaluation Objectives Process & Implementation evaluation Participatory & Capacity Building Empowerment Appreciative Inquiry Training

13 13 Evaluation Questions Relevance Design Impact Implement

14 14 Section 1: Relevance 1.2 How appropriate is AYLP to address the needs of Aboriginal youth and communities? Indicators Data Source Methods Youth Feedback Youth Participants Sharing Circle

15 15 Section 2: Design 2.2 Is the theory of change clear and logical between activities, outputs, and outcomes? Indicators Data Source Methods Developed theory of change Program Docs Grey/published lit. Doc/ Lit review

16 16 Section 3: Implementation 3.3 Based on lessons learned, what would you do differently in the future? Indicators Data Source Methods Identified lessons learned AYLP Staff Youth Participants Sharing Circles Key Informant

17 17 Section 4: Impact* 4.4 To what extent is the program facilitating youth remaining or returning to their Aboriginal communities? Indicators Data Source Methods % of participants remaining/ returning Youth Participants Participatory rubric

18 18

19 19 Data Collection Phases Phase 1 (7 days) Review of literature and documents (Q: 1.3, 2.1, 2.2) Phase 2 (14 days) Key informant interviews (Q: 3.1, 3.2, 3.3) Phase 3 (21 days) Capacity building day (Q: 1.1, 1.2, 2.3, )

20 20 Phase 3: Capacity Building Day Matrix questions 1.1, 1.2, 2.3, Engage Aboriginal youth in developing rubric Discuss experiences through sharing circles Limitations Time and resource intensive Strengths Rich data, build relationships and capacity for future work

21 Capacity Building Day Agenda 21

22 22 Example Rubric Question Aboriginal culture is not reflected in the curriculum Aboriginal culture is in a minimal amount in the curriculum Aboriginal culture is reflected somewhat, but not completely Aboriginal culture is generally reflected in the curriculum, but exceptions are obvious Aboriginal culture is fully reflected in the curriculum

23 23

24 24 Challenges Mitigation Strategies Culture Sharing Circles, Aboriginal youth representation Literacy Readability assessment, storytelling techniques, visual agenda Language Visual agenda, translator services Historical Context Strengths-based, Appreciative Inquiry approach

25 25

26 26 4 R s Framework Respect Relevance Reciprocity Responsibility

27 27 Competencies for Canadian Evaluation Practice Apex Consultants reflects the 5 Professional Competencies set by the Canadian Evaluation Society Reflective practice Technical Practice Situation al Practice Manageme nt Practice Interpers onal practice

28 28 Competencies: Reflective Practice Respects all stakeholders Apex has proposed making revisions to our evaluation through collaboration with an EAC Extending our invite to program staff and remote youth (via Skype) to increase stakeholder participation Pursues professional networks and self development to enhance evaluation practice Attend annual meetings at the Canadian Evaluation Society & American Evaluation Association. Complete cultural competency training

29 29 Thank you Contact Us Today APEX Consultants Ltd. 321 Main St., Forest City, XY 3C2 B1A Tel: