[Mourer]

By using the Conclusions reached by interpreting the Evaluation of previous iterations of the programs and applying them on newer iterations and then evaluating what those changes did or didn’t do.

[Kathe]

Building equity considerations into all aspects of program design, development, and evaluation is critical to improving our programming and our work with youth!

Our team recently developed and shared a resource on Best Practices for Planning & Facilitating Anti-Oppressive Focus Groups, summarizing each step of the planning and facilitation process and highlighting specific equity considerations.

You may also want to check out a series of guides developed by the W.K Kellogg Foundation on Doing Evaluation in Service of Racial Equity: Debunk Myths, Diagnose Biases and Systems, and Deepen Community Engagement.

What resources support your work to advance equity through program evaluation?

[Lulu]

Given program evaluation is an on-going, dynamic process, it allows us to pause and rework on evaluation methods as we go. For example, a qualitative analysis of a focus group might inform us that there are certain questions that might not have worked as we had anticipated. Consequently, measures can be taken to reformulate/rewrite the evaluation questions for the next rounds of feedback sessions in order to better improve the programming of the given youth program.

[Caroline]

Absolutely, Lulu! And you bring up an excellent point here- evaluating our programs can simultaneously allow us to “evaluate our evaluations”. Are we asking the right questions? Are we using the right methods? Sometimes an unexpected learning curve can happen that enables us to rework evaluation components for the future!

[Kathe]

Using evaluation to ‘improve’ youth programs (rather than just ‘prove’ that they work!) is core to YouthREX’s Framework for Evaluating Youth Wellbeing.

If you haven’t already, you can take our FREE 10-week online certificate course exploring the main concepts, approaches, and practices relevant to conducting evaluation of youth sector programs and initiatives, Program Evaluation for Youth Wellbeing. Registration for our next cohort of learners closes on Wednesday, October 26th, and the certificate will open on October 31st. The best part? All course content is available to you at once so that you can work through the modules at your own pace!

Have you already taken this certificate with us? Great! Maybe you want to strengthen your skills and learn how to manage, analyze, and visualize quantitative data? Even better! Registration for our FREE Using Spreadsheets in Program Evaluation certificate course (which runs online for four weeks, beginning November 21st) doesn’t close until Wednesday, November 16th, so there’s lots of time for you to decide to join us this fall!

Unsure which certificate is right for you? Looking for other resources to support your program evaluation? Get in touch with our Learn team!

[Kathe]

YouthREX recently participated in an online event hosted by the National Youth Council of Ireland, “Rethinking Impact: Legacy and Evaluation in a Global Youth Work Context”, during which we discussed how we can broaden definitions of ‘evaluation’ and move beyond ‘impact’ to thinking about ‘legacy’. You can learn the key takeaways and watch a recording of the presentations. 🙂

[Sophia]

Improving youth programs and evaluation is critical to hearing from the youth themselves. Allowing them to use their voice and have their voice count, be heard and taken into consideration when evaluating programs for youth is very important. Through their lens and views other youth will feel comfortable to share their thoughts and feelings. Having youth evaluate and give input critical to understanding what works and doesn’t work. When youth are involved in planning, evaluation and programming the outcome will hopefully be more positive and this is the true stages of “improving” rather than just “prove”. Collection of voices coming to together expressing their views/ issues is better than being talked to about your issues and views and not being taken into consideration your experience, living through the sitaution.

[Kelly]

In thinking of evaluation, I believe it encompasses a full analytical review of the practices and policies that are existing. If done effectively, with strong valid and reliable findings respective to relatable factors, then there would not only be a ‘proving’ of practice/policy effectiveness but also a restructuring and remodeling of the agency as whole. Ideally, major structural biases or malpractices would be highlighted necessitating potential role changes or changes in program directives from the top of the agency down. Evaluation can prompt major internal reviews that would hopefully result in more meaningful consistent change moving forward.

[Khadijah]

Yes that is true! Although I think a lot of evaluation usually happens ad-hoc – i.e. for a specific program – and is usually activated because of funder needs. But I agree that its impossible to separate out one specific program from the entire organization and evaluate it on its own terms – what’s needed is that whole-system review and a willingness to actually respond to the findings of that review. Have you done a full-scale evaluation of an entire organization – i.e. as either the organization being reviewed or as an evaluator?

[Lulu]

That’s such a great point, Khadijah!