Prérequis : Ce cours est de niveau intermédiaire. Les participants devront avoir une connaissance de base de l'évaluation, ainsi qu'une certaine expérience de l'utilisation de MS Excel et MS Word.

Cet atelier de niveau intermédiaire présente des techniques d'analyse de données qualitatives telles que les résultats d'entrevues. À la fin de l'atelier, les participants seront en mesure de mener ces types d'analyses de façon claire et systématique. L'atelier passera en revue les principales techniques à l'aide de MS Excel. Un aperçu général des logiciels d'analyse qualitative assistée par ordinateur sera également donné. Les techniques clés seront présentées, étape par étape, à l'aide d'un cas réel. Les personnes inscrites à l'atelier seront invitées à apporter leurs ordinateurs portables pour appliquer directement les techniques. Un fichier leur sera remis. Celles sans ordinateur pourront également assister et suivre le processus sur l'écran principal. Entre autres, les meilleures pratiques en matière de quantification des données à l'aide de pourcentages et de proportions seront discutés, tout comme les pours et les contres de la quantification de données qualitatives.

Simon Roy (il/lui) est associé principal de Goss Gilroy Inc. Simon a effectué des centaines d'évaluations depuis 1995. Simon est également professeur adjoint à l'Université d'Ottawa en évaluation de programmes. Il a présenté plusieurs ateliers lors de conférences de la SCÉ, dont une version anglaise de cet atelier à la conférence SCÉ 2022. Simon détient le titre d'évaluateur qualifié et un doctorat en sociologie (Université Paris 10, 1995). Il est membre du conseil d'accréditation de la SCE.

Pascale Latulippe est une consultante sénior chez Goss Gilroy Inc. Elle détient plusieurs années d'expérience dans le secteur gouvernemental ainsi que dans des organismes à but non lucratif, et dispose d'une formation approfondie en conception, mise en oeuvre, et analyse de recherches reposant à la fois sur des méthodes quantitatives et qualitatives. Pascale est titulaire d'un diplôme d'études supérieures en évaluation de programmes et d'une maîtrise en développement international.

Prerequisite: This workshop requires a basic understanding of evaluation (i.e., logic models, theories of change, evaluation plans). However, participants need to have a general understanding of their organization's evaluation capacity - evaluation approach, resources, processes, and level of buy-in. This workshop is intended for those working in evaluation, who wish to improve evaluation and performance measurement thinking in their organization.

This intermediate level workshop presents the concept of corporate evaluation and performance measurement strategies and explores how participants may apply elements to their own organizations. The concept will be defined -- including reviewing frameworks, examples, and relevance to different organizations, especially in the context of transformation as seen through shifting politics, resources, and priorities. In a series of interactive exercises, participants will assess their organization's readiness, and build a basic action plan tailored to their work environment's context and needs, key strategy elements, and their own role within their organization. The intention is to develop tangible ideas on how participants can contribute to their organization's evaluation and performance measurement capacity. Participants will be invited to bring their laptops to access the templates, although those without a computer can also follow the exercises manually.

Karolina is a PhD candidate in the Public Health Sciences program at the University of Waterloo with 9 years experience in evaluation and performance measurement. Her research focuses on evaluating mental health and addiction systems to improve access to care. Karolina obtained her Bachelor of Health Sciences and MSc in Health Systems at the University of Ottawa (2013, 2016), and has since worked at several national and international non-profit and governmental organizations.

Prerequisite: This workshop is aimed at those new to building evaluation data dashboards using Microsoft's Power BI. No prior experience is necessary, but familiarity with Excel would be useful.

Data Dashboards are hot these days. Everyone wants them. They hold tons of data, are dynamic and interactive, and they get all the attention. They're like the popular kids at the high school dance.  Just like the popular kids, dashboards can seem inaccessible. Viewers have challenges knowing what to pay attention to on a busy dashboard, and creators often have a hard time learning a new piece of powerful software.  Microsoft's Power BI dashboard software can be difficult to learn when you're first starting out. This workshop takes you from complete Power BI novice to knowing how to make a simple dashboard  - connecting to data, making simple visuals, and making a dashboard that immediately answers the questions your stakeholders have about the data.   Workshop material will be at ces2023.substack.com  IMPORTANT! Participants will build a dashboard, and they should have a recent version of Power BI Desktop installed on their laptop.

Joseph Travers of Travers Data teaches and designs data visualization, reporting, and data dashboards to organizations across Canada and the United States. Joe is also a Power BI Design and Training Consultant with Evergreen Data and focuses on teaching Power BI to organizations to help them make data dashboards effective, easy, and efficient for their staff, management, and other stakeholders.

Prerequisite: Learners should be familiar with evaluation methods and have basic skills in Microsoft PowerPoint and Excel.

Aligned to Evaluation in a Changing World, specifically to Sub-theme 3's 'What should change in evaluation practice?' the half-day workshop teaches participants how to become better communicators of evaluation findings. The communication our findings needs to change to become more clear, succinct and impactful. Effective data visualization helps us to do so. We will focus on infographics to communicate insights. Orientating infographics in data visualization, we shift briefly to the science of why we should use infographics in communicating to our audiences. We will focus on a step-by-step process to create infographics, including design elements of graphics (incl. charts); colour; and font. These provide the visual cues to our most important element: data. Participants will learn to create better charts using simple techniques and efficiencies. We then put these elements together with examples and look at resources and tools for infographic production.

Dr. A. Sidiq (Sid) Ali, CE is a multi-award-winning data visualization expert. He has produced infographics for CES National and his infographics work has been featured in the Canadian Government Executive Magazine. He has also been a guest blogger on Stephanie Evergreen's Better Data Visualization blog. Sid does not have a background in graphics design or art; he learned better data visualization through attending workshops, reading books and being part of a better data visualization community.

Prérequis : Pas de prérequis.

La session sera une occasion de renforcement de capacités sur des outils et méthodes participatifs adaptés à des ados et jeunes dans un   contexte culturelle et sociale africain en pleine transformation. L'avantage des outils que vous allez expérimenter durant cette session est qu'ils permettent aux ados et jeunes de mieux s'exprimer et de donner plus de contenu et de réflexion sur leur vie, ce qui est crucial dans l'évaluation et l'amélioration des programmes les concernant.  En leur donnant plus de voix et de pouvoir ces méthodes égalisent et/ou décolonisent ainsi le processus d'évaluation,  le rendant moins extractif, dominé par l'évaluateur. La session permettra  de réfléchir sur des mécanismes d'échanges entre jeunes évaluateurs de la diaspora africaine au Canada et des réseaux d'évaluation africains, ainsi que les liens avec l'écosystème d'évaluation noir et afro-centrique au Canada.

Ian Hopwood est. ancien Chef d'Evaluation à l'UNICEF (1997-2000), Enseignant à Sciences Po, Paris, UCAD Dakar, collaborateur de l'Initiative CLEAR, Membre de la Commission d'Evaluation et de Suivi des Politiques et Programmes Publics du Sénégal, Membre du Comité Scientifique de la Revue Afrique d'Evaluation, et Président d'Honneur de SenEval où il appuie particulièrement les Groupes Thématiques Evaluation, Enfance, Jeunesse et Evaluateurs Emergents.

Susan Igras, MPH, has designed and evaluated programs to improve adolescent/youth sexual and reproductive health, gender equality, and social wellbeing.  With particular expertise in participatory methodologies and community-centered design focused on addressing social determinants of health, she has trained/facilitated capacity-building workshops in Africa and the US. Until recently she was Research Instructor & Senior Technical Advisor at Georgetown University's Institute for Reproductive

M Ndiaye est spécialiste en suivi évaluation de projet, Co-coordonnateur groupe Thématique Evaluations Enfance et Jeunesse de SenEval. M Ndiaye est aussi Enseignant-chercheur en géographie urbaine à l'Université Gaston Berger à Saint Louis, Sénégal.

Coumba Touré  a plus de 20 ans d'expérience dans le design, la facilitation et l'évaluation de programmes pour la justice sociale.  Elle est Présidente du Conseil d'administration de TrustAfrica.org et ambassadrice de Africans Rising. Féministe, elle dirige un collectif d'art et d'education Falia et écrit et publie livres pour enfants. Elle est aussi conteuse.

Prerequisite: Basic understanding of evaluation.

Community engagement is essential to build trust and rapport needed to engage in genuinely participatory evaluation. This interactive workshop will facilitate knowledge sharing among the presenters and participants. Facilitators will help participants understand the qualities, values, and specific capabilities evaluators can develop to foster community relationships. We will share and practice methods to engage with community members and discuss participatory evaluation methods that reflect the voices of participants. Leverage points for engaging the community throughout the evaluation process ((collaborative evaluation design, data collection, analysis, and information dissemination strategies) will be shared.

Dr. Susan Wolfe, a Community Psychologist, has over 36 years of community evaluation experience. Her interests are collaborative community-based work focusing on collaborations and health equity. She has presented at numerous national and international conferences, published in peer reviewed journals, and won several professional awards. She is the co-author of Guidebook to Community Consulting: A Collaborative Approach to be published by Cambridge University Press with Dr. Ann Price.

Dr. Price, a community psychologist, has over 20 years of evaluation experience. Ann conducts evaluations in many areas including mental health, substance abuse, foster care, and public health. Ann helps community collaboratives use data to inform systems level change and be more effective. She presents regularly at conferences, including the AEA Annual Conference and Summer Institute. She is the co-author of Guidebook to Community Consulting: A Collaborative Approach with Dr. Susan Wolfe.

Prerequisite: Attendees need no prior knowledge of the specific content area in order to participate fully and effectively in the workshop. The information or skills will be new for those who enroll.

Unaddressed conflict can challenge even the most skilled evaluators - especially in the context of dynamic environments and historical injustices. Lack of conflict management and negotiation skills can create barriers to the successful completion of evaluation projects. Many conflicts and tensions can be prevented through effective negotiation at the contracting and design stages of evaluations, as well as throughout the evaluation process. Through a hands-on, experiential approach using real-life examples, participants will learn practical applications of conflict resolution and negotiation skills as they apply in program evaluation. Attendees will assess and reflect on their approach to handling conflict in order to further develop their evaluation-practice skills.

Jeanne Zimmer, PhD, is an adjunct professor at the Jimmy and Rosalynn Carter School for Peace and Conflict Resolution at George Mason University, where she developed and teaches three graduate-level courses, including Conflict Assessment and Program Evaluation: Evaluating Peacebuilding and Conflict Resolution Efforts, Conflict Mediation in Diverse Settings, and Designing Circle Processes to Repair Harm, as part of the Contemporary Dispute Resolution Certificate.

Sandra Ayoo is a professor of Educational Research Methodology at the University of North Carolina Greensboro. She is an evaluation teacher, researcher, and practitioner who is passionate about promoting program evaluation as a field of professional practice. Her scholarship focuses on professionalization, evaluator professionalism, and meta-evaluations with the goal of enhancing the pre-service training of evaluators and promotion of equity, diversity, and inclusion in the field of evaluation.

Prerequisites: To meaningfully participate, learners should have some beginner experience with qualitative methods for evaluation (e.g., conducting interviews and focus groups, analyzing qualitative data, designing interview guides). Student and early-career evaluators should have some experiences designing (or observing the process of designing) evaluation plans. No experience with arts or arts-based methods is required. No artistic skill is necessary. Terrible art is welcome!

Data don't just live in the head. Our knowing is intertwined with place, memory, senses, imagination, and history. Yet, mainstream Western data collection techniques often fail to engage diverse ways of knowing and being. Evaluators need tools to elicit meaningful feedback through stimulating, joyful, and multi-sensory techniques. This fun and timely workshop offers foundational concepts and tools for arts-based data collection and evaluation planning. Focusing on embodied wisdom, content explores practical solutions to Zoom and survey-fatigue that result in low participation rates, unreliable data, and harmful patterns of data extraction. Hands-on activities, case studies, short dynamic lectures, and discussion bolster evaluator competencies and encourage participants to build a theoretical and practical understanding of two methods: collage and body mapping. No artistic skill or experience with arts-based methods needed. Some qualitative experience will be an asset.

For 16 years, Jennica has worked to advance ethical and reflexive practice, meaningful measurement, and evaluation utilization. She is finishing her PhD on arts-based methods and knowledge translation. Jennica has worked on health, education, government, and non-profit/community evaluations. Originally from Brampton ON, Jennica lives in Vancouver and is the co-founder of consulting firm, AND implementation. Outside work, Jennica can be found diving and befriending cuttlefish.

Originally from Toronto, Maya now lives in Vancouver BC. Her practice is grounded in creative and transformative techniques that counter extractive data practices. Maya is passionate about bringing play, joy, and whimsy into meaningful and ethical evaluation. Driven by the questions 'what if' and 'how' Maya works with communities and organizations to imagine and implement solutions with learning, growth, and humility. She is the co-founder of the evaluation consulting firm.

Prerequisites: Foundational understanding of evaluation through taking courses such as CES Essential Skills Series or equivalent and/or realistic understanding of how organizations/systems operate, particularly utilization-focused and developmental evaluation. Open to learning collaboratively and sharing experiences in being involved in evaluation through the lens of an evaluator, public sector/ not-for-profit/ civil society systems'/ organizations' policy/program areas.

Glocally competent evaluator integrate evaluative thinking across levels to support a focus on the ultimate beneficiary individuals without losing sight of the complex and interdependent systems and the global context in which they live. Build your competencies to 'zoom in and out' with global and local perspectives as we walk you through how evaluators can support social innovators to make local to global connections, evaluate the extent to which the work is making lives better, and Learning as We Go to get to where you want to be. Workshop begins with an overview of the principles and processes involved in GLOCAL inquiry, adapted from Blue Marble Evaluation (Patton, 2020). You will be engaged in opportunities to learn experientially the competency to zoom in and out embedding evaluative thinking in the way you work to understand and take into account the interconnections between the local community level, the intervention systems that affect local communities, and globally.

Dr. Keiko Kuji-Shikatani, CESF, believes that evaluators-as-activist can contribute as stewards ensuring that generations to come will thrive in a caring, equitable and peaceful world. Devoted to supporting emerging evaluators and organizations through sharing her expertise on Learning as we go (DE) & evaluation capacity building in the public sector in Canada and internationally. Instrumental in the operationalization of the Credentialed Evaluator program which is documented in CJPE for VOPEs.

Charmagne is an independent consultant with fifteen years of program design, implementation and evaluation work across a range of fields. She specializes in qualitative research methods and utilization-focused developmental evaluation. She holds an MA in International Peace and Conflict Resolution from American University's School of International Service and is co-author of the 5th Edition of Utilization-Focused Evaluation.

Wendy Rowe, CE, MA, PhD, is a scholar and organizational consultant with 25 years of experience working professionally in Canada, United States and international countries, using models of collaboration and empowerment evaluation to enhance organizational capacities, increase program efficiency and effectiveness, and create learning organizations. Dr. Rowe is currently a professor in the School of Leadership Studies at Royal Roads University, with over 150 reports and 30 academic publications.

Prerequisites: Some experience with multiple stakeholders and group decision-making.

Access is not the same as belonging. A seat is not the same as a voice at a table built with a single norm. In seeking more voices, we, as evaluators, need to build our own capacity and facilitate others' capacity to engage. Encountering worldviews different from our own causes our bodies to respond, particularly when unaccustomed to stretching across ways of knowing, ways of being, and the existence of multiple equally-valued truths about the world. Taking time to learn and stretch can feel counter to demands of timelines and deliverables, yet it is crucial to success and creating space for more perspectives. This session is for evaluators who facilitate multi-stakeholder groups and initiatives that seek to build more equitable spaces. This session supports learning to recognize epistemic and power considerations, identify how to create 'stretching' spaces where new-to-self perspectives can be (more) valued, and navigate how to intentionally and respectfully interwoven.

Carolyn Hoessler, PhD, CE, creates meaningful effective processes for change and stakeholder engagement for local, institutional, and national professional associations and programs. Carolyn's success stems from a deep understanding of principles at play, an ability to integrate and stretch perspectives through dialogue and facilitation, and a discernment for navigating complex system to achieve change and shift norms. Has offered over 30 international/national workshops and graduate courses.

Brian Hoessler is the Founder and Principal Consultant of Strong Roots Consulting, a Saskatoon-based firm that catalyzes learning and growth through strategic planning, capacity building, and program evaluation. As a consultant, Brian has supported over 40 non-profit organizations, government agencies, and multi-stakeholder initiatives, with a focus on understanding community contexts, identifying common purpose, and centring participant and community voices.

Prerequisites: While attendees need no prior knowledge in consulting, they do need to have evaluation experience and an understanding of the critical relationship between an evaluator and a client . The material presented is practical in nature. Participants will be asked to relate to relevant experiences in the field. Key personal characteristics include intellectual capacity, self-confidence, drive, adaptability, and endurance. An interest in developing entrepreneurial and small business skills is required.

Are you dreaming of a life as an independent consultant? Do the challenges involved in  establishing a robust, rewarding consulting practice seem too intimidating to make it a reality?. Taught by two independent consultants, this practical workshop will reveal the simple but necessary skills needed to be successful. Evaluation consultants are not only evaluators but also management consultants, entrepreneurs, and small business owners. Learn some key strategies while exploring important start-up issues. Reflect on your own skills and determine if consulting is an appropriate career choice for you. Key topics include personal characteristics, marketing, business planning, setting up shop, writing proposals, managing fees and time, and maintaining work-life balance. Valuable samples, worksheets, and trade secrets will be provided. Through mini-lecture, group discussions, and independent reflection, you will address the unique issues you face and will prepare an action plan.

Gail Vallance Barrington, a CE and certified teacher, managed Barrington Research Group, Inc. for 35 years, completing over 130 evaluation studies. Books include Consulting Start-up and Management: A Guide for Evaluators and Applied Researchers (2012) and Evaluation Time: A Practical Guide to Program Evaluation (with Triana-Tremain, 2022). Awards include the CES Contribution to Evaluation in Canada and the AEA Alva and the Gunnar Myrdal Award for Evaluation Practice. She is a CES Fellow.

Dr. Vanessa Anastasopoulos is a bilingual consultant with 25 years of experience in evaluation. She owns and operates VANASTAS, which provides evaluation services for government, not-for-profit orgs, and academic institutions. Vanessa has conducted over 100 evaluation and performance measurement projects in domains such as S&T, health and social services, education, and employment, for initiatives that benefit diverse groups such as women, older adults, immigrants, and linguistic minorities.

Prerequisites: Participants should have a basic understanding of evaluation, either as a practitioner or user. They should understand what a logic model is and recognize that programs, policies, and products create impacts in complex environments. Participants may come from any field, sector, or functional role. Program designers, managers, and evaluators are welcome.

In this workshop, you will learn a new approach to scaling the social and environmental impacts of programs, policies, products, and investments. The approach is based on the book Scaling Impact: Innovation for the Public Good written by Robert McClean and John Gargani, and it is grounded in their collaborations with social innovators in the Global South. The workshop goes beyond the book, reflecting the authors' most recent thinking, and challenges participants to adopt a new scaling mindset. We introduce participants to the core concepts of the book, then participants will work in small groups to complete hands-on exercises drawn from their professional settings. The workshop is intended as an introduction, and participants will be provided with free resources to continue their learning. Participants will be able to define impact, scaling, operational scale, and scaling impact; use the four principles of scaling, address scaling risks, and apply the dynamic evaluation systems model.

Dr. John Gargani has 30 years of experience as an evaluator, researcher, writer, speaker, and teacher. He is a former President of the American Evaluation Association and a frequent international speaker on topics related to scaling, program design, and impact measurement. Currently, he is conducting research on new evaluation methods that integrate diverse understandings of impact and value.

Dr. Robert McLean is a Senior Program Specialist in Policy and Evaluation at Canada's International Development Research Centre (IDRC) and concurrently a Fellow of the Integrated Knowledge Translation Research Network (IKTRN) at the Ottawa Hospital/University of Ottawa. Rob's broad interests lie in understanding how human creativity can create a better world. He led the research on Scaling Science that underpins the book Scaling Impact: Innovation for the Public Good.

Prerequisites: Credentialed evaluators, or equivalent, will have the basic knowledge needed to get the most from this training.  Knowledge of logic models and theories of change, what they are and how to use them in evaluations, is essential.

Blue Marble refers to the iconic image of the Earth from space without borders or boundaries, a whole Earth perspective. Blue Marble Evaluation consists of principles and criteria for evaluating transformational initiatives aimed at a more equitable and sustainable world. This means transforming evaluation to evaluate transformation.  Evaluating transformation means moving from theory of change to theory of transformation. Incorporating the Blue Marble perspective means looking beyond nation-state boundaries and across sector and issue silos to connect the global and local, connect the human and ecological, and connect evaluative thinking and methods with those trying to bring about global systems transformation.  This workshop will provide a framework and tools (a Thoughtkit) for evaluating place-based systems transformation initiatives within a global systems theory of transformation framework. Participants will become knowledgeable about evaluations for systems transformation.

Former President of the American Evaluation Association (AEA) and author of 8 major evaluation books including a 5th edition of Utilization-Focused Evaluation and 4th edition of Qualitative Research and Evaluation Methods. Has keynoted CES conferences 3 times. Co-authored a book on the dynamics of social innovation and transformation with two Canadians entitled Getting to Maybe: How the World is Changed. Other books include Developmental Eval, Principles-Focused Eval & Blue Marble Evaluation.

Prerequisites: This is a workshop for graduate-level professionals, with both academic and work experience in evaluation.

An opportunity for evaluation in our changing world is to claim the important work carried out through internal evaluation. Internal evaluation, as an applied enterprise and conducted in the social environment of the organization directly influences decision making and result-based management. This two-part workshop will be presented in two parts will bring ideas from the literature for discussion and group input related to Mayne's Three-Part Model as a guide to the development of evaluation culture.  It will detail the steps, benefits, and challenges in developing and sustaining internal evaluation.  A case study of implementation of internal evaluation in a large municipality will be presented where participants will work in groups to design a plan of internal evaluation using the ideas presented and in the context of their own settings. The facilitation will include a handout which will guide the discussion and the exercises.

Kaireen Chaytor, PhD comes to evaluation from a background in adult education and has designed and delivered numerous workshops on building evaluation capacity. She is a Fellow of the Canadian Evaluation Society and an Adjunct Professor in The School of Public Administration at Dalhousie. She has been an evaluation consultant for thirty years and active in CES.  

Tyler Campbell has been with the City of Greater Sudbury for over ten years, in senior level roles and is currently the Director of Children and Social Services.  This portfolio encompasses service manager roles in the areas of Children Services, Ontario Works, and Homelessness -- an area that expanded considerably during the pandemic.    Tyler holds a Master Degree in Public Administration Management from Dalhousie University and an Honors Bachelor of Commerce degree.

Miranda Mackie has over 25 years working in the Early Learning Sector in both the non-profit and most recently in a municipal setting.  Miranda holds a BA in Psychology and an MA in Leadership Development from the University of Guelph. She has completed coursework and hours through the Coaches Training Institute and is working towards the attainment of credentials as an International Executive Coach.