La evaluación basada en la teoría y su aplicación a la política regional: algunas reflexiones teóricas

María Ángeles Díez López

doi:10.24965/gapp.vi30-31.374

Authors

María Ángeles Díez López

DOI:

https://doi.org/10.24965/gapp.vi30-31.374

Keywords:

Evaluation regional policies, theory-based evaluation

Abstract

Since 1990, governments have put more emphasis on evaluation of regional and local policies, programmes and plans. However, evaluations results have been scarcely used and only limited lessons can be drawn from them. As a consequence, their capacity to produce and facilitate the accumulation of knowledge and learning has been restricted. The objective of this article is to summarise the problems and limitations of the current approach to evaluating these policies (mainly value for money studies) and to explore the potential of new approaches, such as theory-based evaluation. Theory-based approach provide us with a framework that allow the estimation of policy effects, but at the same time, it will help us comprehend how, when and why this policy leads to the observed effects being produced, identifying the cause and effects mechanisms that are behind policy implementation. This information is essential to increase the utility of the evaluation and improve the effectiveness of the regional policies.

Downloads

Download data is not yet available.

Author Biography

María Ángeles Díez López

Doctora en Economía y Profesora Titular de Economía Aplicada de la Universidad del País Vasco. Ha sido Directora del Servicio de Estudios de la Sociedad para la Promoción y Reconversión Industrial. Especialista en evaluación de políticas de desarrolloregional. Ha participado en numerosas evaluaciones de planes vinculados a los Fondos Estructurales de la Unión Europea. Forma parte de la Junta Directiva de la Sociedad Española de Evaluación. Cuenta con numerosas publicaciones relacionadas con estos temas.

References

ADE Enterprise PLC et al. (1999), Evaluation of Research, Technological Development and Innovation related actions under Structural Funds in Objetive 2 regions. Bruselas: Comisión Europea.

Amin, A. (1998), «Una perspectiva institucionalista sobre el desarrollo económico regional», Ekonomiaz 41: 69-89.

Asheim, B.A. (1999), «Innovation, social capital and regional clusters: on the importance of co-operation, interactive learning and localised knowledge in learning economies», en Regional Potentials in an Integrating Europe. Bilbao: Regio- nal Studies Association International Conference.

Autio, E. (1998), «Evaluation of RTD in Regional Systems of Innovation», European Planning Studies 2 (6): 131-140.

Bachtler, J. y Michie, R. (1995), «A new era in EU regional policy evaluation? The appraisal of the Structural Funds», Regional Studies 8 (29): 745-751.

Bachtler, J. y Michie, R. (1997), «The interim evaluation of EU regional development programmes: experience from Objective 2 regions», Regional Studies 9 (31): 849-858.

Barnekov, T. y Hart, D. (1993), «The changing nature of US urban policy evaluation: the case of the Urban Development Action Grant», Urban Studies 9 (30): 1469-1483.

Boekholt, P. et al. (1998), The evaluation of pre-pilot actions under Article 10. Innovative measures regarding RTP. Bruselas: Comisión Europea.

Bovaird, T. et al. (1991), «Improved performance in local economic development: a warm embrace or an artful sidestep?», Public Administration 69: 103-119.

Comisión Europea (1999), Evaluating Socio-Economic Programes, Vols. 1-6. Luxemburgo: Oficina de Publicaciones Oficiales de la Comisión Europea.

Coulson, A. (1990), «Evaluating local economic policy», en M. Campbell, ed., Local Economic Policy. Londres: Casell Educational Limited.

Connell, J. P. y Kubisch A. C. (1998), «Applying a Theory of Change approach to the evaluation of Comprehensive Community Initiatives: progress, prospects and problems» en K. Fulbright-Anderson et al. eds., New approaches to eva- luating Community Initiatives: theory, measurement and analysis. Washington D.C.: The Aspen Institute.

Connell, J.P. et al., eds. (1995), New Approaches to Evaluationg Community Initiatives: Concepts, Methods and Context. Was- hington D.C.: Aspen Institute.

Cooke, P. et al. (2000), The governance of innovation in Europe. Londres: Pinter.

Cooke, P. y Morgan, K. (1998), The associational economy. Firms, regions and innovation. Oxford: Oxford University Press.

Chen, H-T. (1994), «Theory-driven evaluations: need, difficulties and options», Evaluation Practic 1 (15): 79-82.

Chen, H-T y Rossi P. (1994), «Issues in the theory-driven perspective», Evaluation and Program Planning, 4 (12): 299-306.

Díez, M.A. (2001a), La evaluación de la política regional: propuestas para evaluar las nuevas políticas regionales. Tesis doctoral. Leioa: Servicio Editorial de la Universidad del País Vasco.

Díez, M.A. (2001b), «Propuestas para evaluar las nuevas políticas regionales», Ekonomiaz 47: 182-205.

Díez, M.A. (2002), «Evaluating new regional policies: reviewing the theory and practice», Evaluation 3 (8): 285-305.

ECOTEC (1999), The ongoing evaluation of Regional Innovation Strategies. Bruselas: Comisión Europea.

Ernst & Young (1999), Thematic Evaluation of Structural Fund Impacts on SMEs. Bruselas: Comisión Europea.

Finne, H. et al. (1995), «Trailing Reserach. A model for useful program evaluation», Evaluation (1) 1: 11-31.

Foley, P. (1992), «Local economic policy and job creation: a review of evaluation studies», Urban Studies, 3-4 (29): 557-598.

Geddes, M. (1988), «Social audits and social accounting in the UK: a review», Regional Studies 1 (22): 60-65.

Georghiou, L. (1998), «Issues in the evaluation of innovation and technology policy», Evaluation 1 (4): 37-51.

Gregory, D. y Martin, S. (1988), «Issues in the evaluation of inner city programmes», Local Economy 4 (2): 237-249.

Hart, D. (1991), «US Urban policy evaluation in the 1980s: Lessons from practice», Regional Studies 3 (25): 255-261.

Hebert, S. y Anderson A. (1998), «Applying the Theory of Change approach to two National, Multisite Comprenhensive Community Initiatives» en K. Fulbright-Anderson et al. eds., New approaches to evaluating Community Initiatives: theory, measurement and analysis. Washington D.C.: The Aspen Institute.

Higgins, T. et al. (1999), Thematic evaluation of the impacts of Structural Funds (1994-1999) on Research, technolocy Development and Innovation (RTDI) in Objective 1 and Objective 6. Bruselas: Comisión Europea.

Kuhlmann, S. (1998), «Moderation of policy making? Science and Technology Policy evaluation beyond impact measurement-the case of Germany», Evaluation 2 (4): 130-148.

Landabaso, M. (2000), «EU policy on innovation and regional development», en F. Boekema, et al. eds., Knowledge, innovation and economic growth: the theory and practice of learning regions. Cheltenham: Edward Elgar Publishing Limited.

Landabaso, M. et al. (1999), «Learning regions in Europe: theory, policy and practice through the RIS experience», 3rd International Conference on Technology and Innovation Policy: Global Knowledge Partnerships, Creating value for the 21 Century, Austin, EE.UU.

Landabaso, M. y Reid A. (1999), «Developing Regional Innovation Strategies: The European Commission as Animateur», en K. Morgan y C. Nauwelaers, eds., Regional Innovation Strategies. The challenge for less-favoured regions. Londres: The Stationery Office.

McEldowney, J.J. (1991), «Evaluation and European regional policy», Regional Studies 25: 261-265.

Milligan, S. et al. (1998), «Implementing a Theory of Change evaluation in the Cleveland Community-Building Initiative: A case study» en K. Fulbright-Anderson et al., New approaches to evaluating Community Initiatives: theory, measurement and analysis. Washington D.C.: The Aspen Institute.

Murtagh, B. (1998), «Evaluating the Community impacts of urban policiy», Planning Practice & Research 2 (13): 129-138.

Morgan, K. y Nauwelaers, C. eds., (1999), Regional Innovation Strategies. The challenge for less-favoured region. Regions, Cities and Public Policy Series, Regional Studies Association. Londres: The Stationery Office.

P&G Sociedad de Estudios (1998), Evaluation of Community measures in support of European Community Business and Innovation Centres (EC-BICs). D. G. de Política Regional. Comisión Europea.

Pawson, R. y Tilley, N. (1997), Realistic Evaluation. Londres: Sage Publications.

Rogers, P. et al. (2000), «Program Theory in Evaluation: Challenges and Opportunities», New Directions for Program Evaluation 87, San Francisco: Jossey-Bass.

Rosenfeld, S.A. (1996), «Does cooperation enhance competitiveness? Assessing the impacts of inter-firm collaboration», Research Policy 25: 247-263.

Saraceno, E. (1999), «The evaluation of local policy making in Europe», Evaluation 4 (5): 439-457.

Stame, N. (2004), «Theory-based evaluation and types of complexity», Evaluation 1 (10): 58-76.

Stame, N. (1999), «Small and medium enterprise aid programs: intangible effects and evaluation practice», Evaluation and Program Planning 22: 105-111.

Storper, M. (1997), The regional world. Territorial development in a global economy. Nueva York: The Guilford Press.

Torvatn, H. (1999), «Using program theory models in evaluation of industrial modernization programs: three case studies», Evaluation and Program Planning 22: 73-82.

Turok, I. (1990), «Evaluation and accountability in spatial economic policy: a review of alternative approaches», Scottish Geographical Magazine 106: 4-11.

Turok, I. (1991), «Policy evaluation as science: a critical assessment», Applied Economics 23: 1543-1550.

Weiss, C.H. (1995), «Nothing as practical as good theory: Exploring Theory-Based evaluation for Comprenhensive Community Initiatives for children and families» en J.P. Connell et al., New approaches to evaluating Community Initiatives: concepts, methods and contexts. Washington D.C.: The Aspen Institute.