Fitting feelings into frameworks : an examination of the involvement of primary stakeholders in the design and use of outcome indicators and evaluation use for development interventions : a thesis presented in partial fulfilment of the requirements for the degree of Master of International Development, Massey University, Palmerston North, New Zealand

Abstract

The aim of this thesis is to examine the involvement of primary stakeholders in the design and use of outcome indicators, and evaluation use for development interventions. It seeks to understand the characteristics of indicators developed by or with primary stakeholders, the dynamics of such involvement, and what is achieved in such practice.

The experiences and achievements recorded in eight international case examples and one local case study provide insights into the practical considerations for using participatory approaches to design outcome indicators. Although there is a traceable body of literature that provides theoretical guidance on participatory indicator design, there is very little in the way of instruction based on practice.

Primary stakeholder participation was identified as important across four phases: planning, indicator design and use, data collation, and evaluation use. It was found that primary stakeholders may be involved in the indicator design including the use phase; but are not routinely included in the planning, data collation and evaluation use phases. Findings from the eight case examples pointed to positive impacts on indicator design including the use of culturally appropriate and contextually relevant indicators, as well as participant empowerment and engagement in evaluation practice. Other findings highlighted that lack of skilled facilitators, the interplay of power dynamics and the length of time participatory evaluation practice takes may have negative impact on the engagement of primary stakeholders in the evaluative processes.

The practice of participatory indicator design is seemingly not widespread in the field of international development. While there is literature to be found that can provide some guidance on participatory evaluation practice, including design of outcome indicators, it seems that individual organisations reinvent processes for engagement on a case by case basis. The proposal is mooted that systematic capability building across the NGO sector that includes exploration on how the four phases of participatory evaluation practice can be built into organisational processes is required.