Uso de la evaluación en un contexto de múltiples agentes: el caso del plan de desarrollo rural del país vasco en el marco de la Unión Europea

María Ángeles Díez López; Beatriz Izquierdo; Eduardo Malagón

doi:10.24965/gapp.v0i4.441

Authors

María Ángeles Díez López
Beatriz Izquierdo
Eduardo Malagón

DOI:

https://doi.org/10.24965/gapp.v0i4.441

Keywords:

Use of evaluation, evaluation process, evaluation culture, participatory evaluation, European Rural Development Policy, Governance

Abstract

This paper analyses the use of the evaluation results and the process carried out in the evaluation of a rural development evaluation programme focused in a participatory evaluation model. To do this, it is used the experience of the mid-term evaluation of the Sustainable Rural Development Plan 2000-2006 in the Basque Country. The core premise of the evaluation team was that stakeholder participation would enhance evaluation use, promoting its utilisation in the decision making process in future policies. The paper is structured into two main parts: The first one describes the adequacy of the participatory evaluation model to the interest and purposes of our evaluation. The second part examines the impact of this evaluation model on the evaluation utilisation. This assessment has given us the opportunity to draw lessons that can help to improve the utility of evaluation in multi - actor contexts, favouring thus the development of governance.

Downloads

Download data is not yet available.

Author Biographies

María Ángeles Díez López

Doctora en Economía y ProfesoraTitular de Economía Aplicada de la Universidad del País Vasco. Ha sidoDirectora del Servicio de Estudios de la Sociedad para la Promoción yReconversión Industrial. Especialista en evaluación de políticas de desarrolloregional. Ha participado en numerosas evaluaciones de planes vinculados a losFondos Estructurales de la Unión Europea. Forma parte de la Junta Directiva dela Sociedad Española de Evaluación. Cuenta con numerosas publicacionesrelacionadas con estos temas.

Beatriz Izquierdo

Doctora en Sociología por laUniversidad del País Vasco. Profesora de Sociología de la Universidad deBurgos. Sus investigaciones se centran actualmente en la evaluación deprogramas y políticas de de desarrollo rural. Desde 2002 forma parte del equipoencargado de realizar las evaluaciones oficiales del Plan de Desarrollo RuralSostenible del País Vasco. Es autora de diversos artículos.

Eduardo Malagón

Doctor en Economía por laUniversidad del País Vasco y Profesor Titular de Economía Aplicada de la mismaUniversidad, donde en la actualidad es Subdirector de Calidad e InnovaciónDocente de la Escuela Universitaria de Estudios Empresariales (San Sebastián).Miembro del Instituto HEGOA de Estudios sobre el Desarrollo y la CooperaciónInternacional. Especialista enanálisis y evaluación de políticas agrarias y de desarrollo rural. Coautor dellibro Los costes de la No Agricultura enel País Vasco (Victoria-Gasteiz, Colección LUR y Gobierno del País Vasco:2006).

References

Alkin, M. C., Christie, C. A. y Rose, M. (2006), “Communicating evaluation”, en I.F. Shaw, J.C. Green y M.M. Melvin, eds., Handbook of evaluation. Policies, programs and practices. Londres: SAGE.

Bachler, J. y Michie, R. (1995), “A new era in EU Regional policy evaluation? The apraisal of the Structural Funds”, Regional Studies, 29: 745-751.

Burke, B. (1998), “Evaluating for a change: reflections on participatory methodology”, en E. Whitmore, ed., Understanding and Practicing Participatory Evaluation. San Francisco: Jossey-Bass.

Centre for European Evaluation Expertise (1996), MEANS Handbook Collection (Methods for Evaluating Structural Policies). Luxemburgo: European Commission.

Chelimsky, E. (1997), “The coming transformation in Evaluation”, en E. Chelimsky y W. R.Shadish, eds., Evaluation for the 21st Century. A Handbook. Londres: SAGE.

Chelimsky, E. (2006), “The purposes of evaluation in a democratic society”, en I.F. Shaw, J.C. Green, y M.M. Melvin, eds., Handbook of evaluation. Policies, programs and practices. Londres: SAGE.

Connell, J.P, Kubisch, A. C., Schorr, L. B. y Weiss, C. H. (1995), New Approaches to Evaluation Community Initiatives: Concepts, Methods and Context. Washington: Aspen Institute.

Cousins, J. B. y Whitmore, E. (1998), “Framing participatory evaluation”, en E. Whitmore, ed., Understanding and Practicing Participatory Evaluation. San Francisco: Jossey-Bass.

Cousins, J. B. y Shulba, L. M. (2006), “A comparative analysis of evaluation utilization and its cognate fields of inquiry: current issues and trends”, en I.F. Shaw, J.C. Green, y M.M. Melvin, eds., Handbook of evaluation. Policies, programs and practices. Londres: SAGE.

Díez, M. A. e Izquierdo, B. (2006), “La evaluación de los Fondos Estructurales de la Unión Europea”, Ekonomiaz, 60: 178-209.

Díez, M. A. (2001), “The evaluation of regional innovation and cluster policies: towards a participatory approach”, European Planning Studies, 9(7): 907-923.

Díez, M. A. (2002), “Evaluating new regional policies: reviewing the theory and practice”, Evaluation, 8: 285-305.

European Commission (2001), European Governance. A White Paper. Bruselas: Commission of the European Comunities, COM: 428-463.

European Policy Evaluation Consortium (2005), Study on the use of evaluation results in the Commission. Bruselas: European Commisssion. En línea: http://ec.europa.eu/dgs/secretariat_general/evaluation/docs/eval_results_comm_2005_en.pdf. (Consulta: 5 mayo 2008).

Feinstein, O. N. (2002), “Use of evaluations and the evaluation of their use”, Evaluation, 8: 433-439.

Fetterman, D. M. (2001), Foundations of empowerment evaluation. Londres: SAGE.

Finne, H., Levin, M. y Nilssen, T. (1995), “Trailing research. A model for useful program evaluation”, Evaluation 1: 11-31.

Forss, K., Rebien, C. y Carlsson, J. (2002), “Process use of evaluation. Types of use that precede lessons learned and feedback”, Evaluation, 8: 29-45.

Green, J. (2006), “Evaluation, democracy and social change”, en I.F. Shaw, J.C. Green, y M.M. Melvin, eds., Handbook of evaluation. Policies, programs and practices. Londres: SAGE.

Green, J. (1998), “Stakeholder participation and utilization in program evaluation”, Evaluation, 12: 25-35.

Gregory, A. (2000), “Problematizing participation. A critical review of approaches to participation in evaluation theory”, Evaluation, 6: 179-199.

Guba, E. G. & Lincoln, Y. S. (1989), Fourth Generation Evaluation. Newbury Park: Sage.

Kuhlmann, S. (1998), “Moderation of policy making? Science and Technology Policy evaluation beyond impact measurement-The case of Germany”, Evaluation, 4: 130-148.

Monnier, E. (1995), Evaluación de la acción de los poderes públicos. Madrid: Instituto de Estudios Fiscales.

Murray, R. (2002), “Citizen´s control of evaluations. Formulating and assessing alternatives”, Evaluation, 8: 81-100.

Narayan-Parker, D. (1993), “Participatory evaluation tools for managing change in water and sanitation”, World Bank Technical Paper 207. Washington DC.

Patton, M. Q. (1998), “Discovering process use”, Evaluation, 4: 225-233.

Patton, M. Q. (2001), “Evaluation, knowledge management, best practices and high quality lessons learned”, American Journal of Evaluation, 22: 329-336.

Patton, M. Q. (2008), Utilization-Focused Evaluation: The new century text. Londres: SAGE.

Plottu, B. y Plottu, E. (2009), “Approaches to participation in evaluation. Some conditions for implementation”, Evaluation, 15: 345-359.

Ray, C. (2000), “Endogenous socio- economic development in the European Union- issues of evaluation”, Journal of Rural Studies, 16: 2-14.

Rist, R. y Stame, N., eds., (2006), From studies to streams: managing evaluation systems. New Brunswick: Transactions Publishers.

Stame, N. (1999), “Small and Medium Enterprise Aid Programs: intangible effects and evaluation practice”, Evaluation and Program Planning, 22: 105-111.

Stame, N. (2006a), “Governance, democracy and evaluation”, Evaluation, 12: 7-16.

Stame, N. (2006b), “Complex policies and evaluative streams of knowledge”, en R. Rist y N. Stame, eds., From studies to streams: managing evaluation systems. New Brunswick: Transactions Publishers.

Suarez-Herrera, J. C., Springett, J. y Kagan, C. (2009), “Critical conections between participatory evaluation, organizational learning and intentional change in pluralistic organizations”, Evaluation, 15: 321-342.

Subirats, J. (2006), “Catorce puntos esenciales sobre evaluación de políticas públicas con especial referencia al caso de políticas sociales”, Ekonomiaz, 60: 18-37.

Themessl-Hubber, M. T. y Grutsch, M. A. (2003), “The shifting locus of control in participatory evaluations”, Evaluation, 9: 92-111.

Torres, R., Preskill, H. y Piontek, M. (2005), Evaluation strategies for communicating and reporting. Londres: SAGE.

Valovirta, V. (2002), “Evaluation utilization as argumentation”, Evaluation, 8: 60-80.

Viñas, V. (2009), “The European Union’s drive towards Public Policy Evaluation: the case of Spain”, Evaluation, 15: 459- 472.

Weiss, C. H. (1987), “Evaluating social programs: what have we learned?”, Society, 25 (1): 40-45.

Weiss, C. H. (1998), “Have we learned anything new about the use of evaluation?”, American Journal of Evaluation, 19(1): 21-33.

Weiss, C. H. y Bucuvalas, M. J. (1980), “Truth tests and utility tests: decisión makers’ frames of reference for social science research”, American Sociological Review, 45: 302-313.

Whitmore, E., ed., (1998), “Understanding and Practicing Participatory Evaluation”, New Directions for Evaluation, 80.