Publications

Measuring Organizational Evaluation Capacity

Organizational evaluation capacity refers to the systems, processes, and practices that support evaluation within an organization. Organizations with strong evaluation capacity tend to carry out high-quality, timely evaluations, use the results to inform decision-making, and foster a culture of learning and reflection.

We developed a diagnostic tool to assess this capacity, which has been used in multiple research projects and publications. These studies aimed to measure, describe, and compare evaluation capacity across various organizations and sectors. Together, they have helped us better understand the different dimensions of evaluation capacity—and offer guidance for those looking to strengthen it.

Measuring Evaluation Capacity in Public Health

Between 2014 and 2018, we adapted our diagnostic tool to assess the evaluation capacity of Ontario public health units. This project also involved developing and testing strategies to strengthen their capacity.

Measuring organizational evaluation capacity in Ontario public health units: An empirical investigation Bourgeois, I., Simmons, L. Hotte, N., & Osseni, R. (2016) Canadian Journal of Program Evaluation, 31 (2), 165-183
Building Evaluation Capacity in Ontario’s Public Health Units: Promising Practices and Strategies Bourgeois, I., Simmons, L., & Buetti, D. (2018) Public Health, 159, 89-94. DOI
Using Action Research to Build Evaluation Capacity in Ontario: Lessons Learned Bourgeois, I., & Buetti, D. (2019) Journal of Multidisciplinary Evaluation, 33, 81-90

Evaluation Capacity in Community Organizations

We also studied evaluation capacity in the community sector, with a particular focus on Quebec-based organizations. These studies explored how evaluation literacy and use can support capacity-building.

Evaluation literacy and use in community organizations: Insights and implications for evaluation capacity building Buetti, D., Bourgeois, I., & Savard, S. (2024) Canadian Journal of Program Evaluation, 38(3), 461-477
L’étude des capacités en évaluation chez les organismes communautaires du Québec : proposition d’un cadre conceptuel et d’une grille d’analyse organisationnelle Buetti, D., and Bourgeois, I. (2019) Intervention, 150, 25-46
Modeling organizational capacities in evaluation in the community sector and implications for the Quebec context Buetti, D., Bourgeois, I., & Savard, S. (2019) Canadian Journal of Nonprofit and Social Economy Research, 10(2), 16-39

Comparing Evaluation Capacity Across Organizations

Several studies compared the evaluation capacity of different types of organizations and sectors.

Informing evaluation capacity building through profiling organizational capacity for evaluation: An empirical examination of four Canadian federal government organizations Bourgeois, I. & Cousins, J.B. (2008) Canadian Journal of Program Evaluation, 23(3), 127-146
Application of the Organizational Evaluation Capacity Self-Assessment Instrument in different organizations: Similarities and lessons learned Bourgeois, I., Whynot, J., & Thériault, É. (2015) Evaluation and Program Planning, 50, p. 47-55
Interorganizational evaluation capacity building in the public, health and community sectors Laubek, C., Bourgeois, I. (2024) Evaluation, 30(2), 190-210

Comparing Diagnostic Tools

One of our projects brought together several tools designed to assess organizational evaluation capacity and compared their features.

Capturing evaluation capacity: Findings from a mapping of evaluation capacity instruments Nielsen, S.B., Lemire, S., Bourgeois, I., & Fierro, L.A. (2024) Canadian Journal of Program Evaluation, 38(3), 430-460