Using Evaluation for European Management and Governance

Authors

  • Eduardo Zapico

DOI:

https://doi.org/10.24965/gapp.v0i4.440

Keywords:

EU evaluation, management by results, Governance, uncertainty, use of evaluation

Abstract

There is no doubt about the potential of evaluation for decision making. Yet, it is not clear what the real evaluation information use is. Its relevance depends on the relation of evaluation approach to the decision making model and their coherence with their context. In 1996, EU evaluation was first oriented towards efficient expenditure management. Years later, the European Governance acknowledged evaluation as a main instrument for transparency, participation, coherence, accountability and effectiveness of EU policy making. EG was justified not only to cover the democratic deficit but also a coordination deficit. Furthermore, an evaluation deficit has been identified due to the weak development of an evaluation approach able to tackle the complexity of the European context. The relevance of evaluation and its use in the EU would increase significantly if evaluation efforts were reallocated towards a decision model coherent with complexity.

Downloads

Download data is not yet available.

Author Biography

Eduardo Zapico

Doctor en Ciencias Económicas yComerciales por la Universidad Complutense de Madrid y Master in PublicAdministration por la New York University. Actualmente es Asesor en laDirección General de Presupuestos del Ministerio de Economía y Hacienda(Madrid). Entre 2005 y 2009 ha trabajado en la Dirección General dePresupuestos de la Comisión Europea. Anteriormente, trabajó en el Banco Mundial(WDC), en la OCDE (París) y en el Instituto Europeo de Administración Pública(EIPA, Maastricht). Ha desempeñado, asimismo, puestos de asesor sobre temas deevaluación de programas públicos en la Oficina Presupuestaria de la Presidenciadel Gobierno de España (1996-1998) y en la Intervención General de laAdministración del Estado. En el ámbito de los estudios sobre gestión públicaha desarrollado tareas docentes e investigadoras en diversas instituciones,entre las cuales cabe mencionar el INAP, el Instituto de Estudios Fiscales, EIPA, ESADE y las UniversidadesComplutense y Autónoma de Madrid. Entre sus numerosas publicaciones, dentro y fuera de España, destacanlas siguientes: Evaluation of govermentperformance and policy making in Spain (Wold Bank Evaluation Series, 2010),de la que es coautor junto con O. Feinstein; el libro coeditado con J. Mayne, Monitoring Performance in the Public Sector (NuevaYork: Transactions, 1998); y la obra coeditada con A. Wildavsky, National Budgeting for Economic and MonetaryUnion (Boston/Londres: Martinus Nijhoff Publishers, 1993). Es Vocal del Consejo de Redacción de larevista GAPP.

References

Argyris, C. (1982), Reasoning, Learning, and Action. San Francisco: Jossey-Bass Publishers.

Berman, P. (1980), “Thinking about programmed and adaptative implementation”, en H. Ingrand y D. Mann, eds., Why Policies Succed or Fail? Londres: Sage.

Borrás, S. (2009), “La Comisión Europea como intermediario en las redes de políticas públicas”, Gestión y Análisis de Políticas Públicas, Nueva Época, 1: 9-42

Borrás, S. y Jacobsson, K. (2004), “The open method coordination and the new governance patterns in the EU”, Journal of the European Public Policy, 11(2): 185-208.

Consejo de Ministros de la UE (2008), Results of the meeting of the Budget Committee of the Council of Ministries of the EU, 3 de octubre (no publicado).

Cronbach, J. L. et al. (1980), Toward Reform of Program Evaluation. San Francisco: Jossey-Bass.

Diamond, J. (2003), “Performance Budgeting: Managing the Reform Process”, FMI Working Paper, WP/03/33.

ECA (2006), Informe sobre la Evaluación en la Comisión Europea del año 2006. Luxemburgo: European Court of Auditors.

Eureval y Rambol (2008), Meta study on lessons from existing evaluations as an input to the review of EU spending. Bruselas: Evaluation for the European Commission.

Ernst & Young (2008), Result-Based management at thee Heart of a new public management: An Overview of public policy evaluation in Europe. París: Ernst & Young. En línea: http://www2.eycom.ch/publications/items/public_services/2008_public_policy_evaluation/2008_EY_Overview_Public_Policy_Evaluation.pdf (Consulta: abril 2010).

ECORYS Nederland BV (COWI Consortium) (2008), Study on the state of implementation of Activity Based Management in the European Commission. Informe preparado para la Comisión Europea. Bruselas: Directorate-General for Budget.

European Commission (1996), Evaluation Communications. En línea: http://europa.eu.int/comm/budget/evaluation/keydocumentsfr.html (consulta: 7 enero 2010).

European Commission (1999), Communication on Activity Based Budget – ABB. SEC 148/9, Bruselas: European Commission.

European Commission (2000), Evaluation Communications. En línea: http://europa.eu.int/comm/budget/evaluation/keydocumentsfr.html (consulta: 7 febrero 2010).

European Commission (2001a), Communication on Implementing Activity Based Management in the Commission. SEC 1197/687. Bruselas: European Commission.

European Commission (2001b), European Governance: A White Paper. Bruselas: Commission of the European Comunities, COM: 428. En línea: http://ec.europa.eu/governance/white_paper/en.pdf.

European Commission (2001c), “Report of the Working Group «Evaluation and transparency»”, en European Governance: A White Paper. Bruselas: Commission of the European Comunities, COM: 428.

European Commission (2002a), Reglamento Financiero de la UE, Regulación del Consejo 1605/2002. Bruselas: European Commission.

European Commission (2002b), Communication from the Commission on Impact Assessment. Bruselas: Commission of the European Comunities, COM: 276.

European Commission (2004), Evaluating EU Activities: A Practical Guide for the Commission Services. Bruselas: European Commission. En línea: http://europa.eu.int/comm/budget/evaluation/keydocumentsfr.htm (Consulta: 7 febrero 2010).

European Commission (2005a), Better Regulations for Growth and Jobs in the European Union. Bruselas: Commission of the European Comunities, COM: 97.

European Commission (2005b), How the e-Europe OMC worked: Implications for the Coordination of Policy under 2010. Bruselas: European Commission. En línea: http://ec.europa.eu/dgs/information_society/evaluation/data/pdf/studies/2005_omc_Finalrep.pdf (Consulta: 7 febrero 2010).

European Commission (2007a), Evaluation Communication. Bruselas: European Commission. En línea: http://europa.eu.int/comm/budget/evaluation/keydocumentsfr.htm (Consulta: 7 febrero 2010).

European Commission (2007b), Evaluation in the Commission: Reporting on Evaluation Capacity 2006. Documento de trabajo interno. Bruselas: Directorate General Budget.

European Commission (2007c), Using evaluation results in the Activity Statements of the PDB. Internal Study 2007. Bruselas: Directorate General Budget.

European Commission (2008a), Multiannual Evaluation Report. Bruselas: European Commission. En línea: http://europa.eu.int/comm/budget/evaluation/keydocumentsfr.htm (Consulta: 7 enero 2010).

European Commission (2008b), Reglamento Financiero 1605/2002 del Consejo de Ministros de la Unión Europea. Bruselas: European Commission. En línea: http://europa.eu.int/comm/budget/evaluation/keydocumentsfr.htm (Consulta: 7 febrero 2010).

European Commission (2008c), IAB Report for the year 2008, Commission Staff working document, SEC 55. Bruselas: European Commission. En línea: http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=CELEX:52009SC0055:EN:NOT (Consulta: 7 febrero 2010).

European Commission (2008d), Incorporating evaluation results in AMPs and Activity Statements.. Documento interno: A01(2008)D 51673. Bruselas: Secretariat General and General Directorate for Budget

European Commission (2009), Evaluation Quality Assessment Framework, Secretary General. Bruselas: European Commission. En línea: http://ec.europa.eu/dgs/secretaría t_general/evaluation/docs/how_quality_asses_0206_en.pdf (Consulta: 7 febrero 2010).

European Commission (2010), Working Methods of the Commission 2010-2014. En línea: http://myintracomm.ec.europa.eu/NewsPortal/Documents/workingmethods_en.pdf (Consulta: 7 febrero 2010).

European Parliament (2008), Study on the Administrative reforms of the Commission in relation to ABB/ABM. Committee on Budgets, Bruselas: European Parliament.

EPEC (2005), Study on the use of Evaluation results in the Commission. Bruselas: European Policy Evaluation Consortium.

Feinstein, O. y Puetz, D. (2000), “Synthesis and Overview”, en O. Feinstein y R. Picciotto, Evaluation and Poverty Reduction. Washington: The World Bank.

Feinstein, O. (2007), “Evaluación pragmática de políticas públicas”, Información Comercial Española, 836: 19-31

Guba, E. G. y Lincoln, Y.S. (1989), Fourth Generation Evaluation. Londres: Sage.

International Monetary Fund (IMF) (2005), Performance Budgeting: linking results and Funding. En línea: http:/www-int.imf.org/depós/fad/pdrp/conference/perf_budget/index.html (Consulta: 7 febrero 2010).

Jordana, J., Mota, F. y Noferini, A. (2009), “La política de Cohesión Europea en dos regiones españolas: Configurando las redes de políticas y el capital social”, Gestión y Análisis de Políticas Públicas, Nueva Época, 1: 87–122.

Leeuw, F. y Furubo, J. (2008), “Evaluation Systems”, Evaluation, 14(2): 157-169.

Lorenzo, O., Kawaleck, P. y Ramdani, B. (2009), “The Long Conversation: Learning How to Master Enterprise Systems”, California Management Review, 52(1).

Majone, G. (1991), “Cross-National Sources of regulatory policy making in EU and US”, Journal of Public Policy, 11(1): 79-106

Metcalfe, L. (1993), “Public Management: From Imitation to Innovation”, Australian Journal of Public Administration, 52(3): 174-189.

Metcalfe, L. (1995), “La Comision Europea como una organizacion-red”, Gestión y Análisis de Políticas Públicas, 4: 25 - 36.

Metcalfe, L. (2001), “Reforming European Governance: Old Problems or New Principles?”, International Review of Administrative Sciences, 67: 415-443.

Metcalfe, L. (2004), “European Policy Management: Future Challenges and the Rol of the Commission”, Public Policy and Administration, 19(3): 77-94.

OECD (1996), Budgeting for Results: Perspectives on Public Expenditure Management. París: OECD.

OECD (2002), Overview of Results Focused Management and Budgeting in OECD Member Countries. Paris: OECD.

OECD (2007), Performance Budgeting in OECD Countries. Paris: OECD.

Patton, M. Q. (1997), Utilization Focused Evaluation. Londres: Sage

Pawson, R. (2002), “Evidence Based Policy: The Promise of `Realist Synthesis´”, Evaluation, 8(3): 340-358.

Perrin, B. (2002), “How to –and How Not to– Evaluate Innovation”, Evaluation, 8(1): 13-28.

Pollitt, C. y Bouckaert, G. (2000), Public Management Reform: A comparative Analysis. Oxford: Oxford University Press.

RAND Europe (2005), “ERAnets Evaluation of Networks of collaboration among participants in the IST Research and their evolution to collaborations in the ERA”. Informe final. Bruselas: DG Information Society.

Radej, B., Golobic, M. y Cernic, M. (2010), “Beyond New Public Management doctrine in policy impact evaluation”, Working paper 1/2010 Slovenian Evaluation Society: 1–25.

Renda, A. (2006), Impact Assessment in the EU: The State of the Art and the Art of the State. Bruselas: Centre for European Policy Studies.

Rieper, O. (1997), “Intergovernmental Evaluation of an EU-Funded Regional Development Program in Denmark”, en O. Rieper y J. Toulemonde, eds., Politics and Practices of Intergovernmental Evaluation. New Brunswick: Transaction Publishers.

Robertson, C. (2008), “Impact assessment in the EU”, EIPA Scope: 17-20 En línea: http://www.inmetro.gov.br/IVWAC/apresentacoes/avaliacao_de_impactos_regulatorios.ppt#326,1,Impact Assessment in the European Union (Consulta: mayo 2010).

Robinson, M. (2007), Performance Budgeting - Linking Funding and Results. Palgrave: McMillan.

Rist, R. y Stame, N. (2006), Evaluative Knowledge Management: from Studies to Streams. New Brunswick: Transaction Publishers.

Scharpf, F.W. (2002), Governing in Europe: Effective and Democratic? Oxford: Oxford University Press.

Stake, R. (1980), “Program evaluation, Particularly Responsive evaluation”, en W. B. Dockrell y D. Hamilton, eds., Rethinking Educational Research. Londres: Hodder and Stoughton.

Schick, A. (2001), “Does Budgeting have a future?”, Ponencia presentada en el 22nd Annual Meeting of Senior Budget Officials, Paris 21-22 de mayo.

Stame, N. (2004), “Theory-Based Evaluation and Types of Complexity”, Evaluation, 10(1): 58-76.

Stame, N. (2008), “The European Project, Federalism and Evaluation”, Evaluation, 14(2): 117-139.

Stern, E. (2009), “Evaluation policy in the European Union and its institutions”, New Directions for Evaluation, 123: 67-85.

Subirats, J. (2004), “¿Podemos utilizar los instrumentos de la evaluación como palanca de gobierno del sector público?” Ponencia presentada en el IX Congreso Internacional del CLAD sobre Reforma del Estado y de la Administración Pública. Madrid, noviembre.

Summa, H. y Toulemonde, J. (2002), “Evaluation in the European Union: Addressing Complexity and Ambiguity”, en J. E. Furubo, R. Rist y R. Sandhal, eds., International Atlas of Evaluation. New Brunswick: Transaction Publishers.

Tavistock Institute, Net Effect Ltd., Istituto per la Ricerca Sociale (2005), “The Analysis of Impacts of Benchmarking and the eEurope Actions in the Open Method of Co-ordination - How the eEurope OMC worked: Implications for the Co-ordination of Policy under 2010”. Informe Final. Bruselas: DG Information Society of the European Commission.

Vedung, E. (1993), “La Utilización de la Evaluación”, Revista de Servicios Sociales y Política Social, 30: 69-80.

Weiss, C. (1973), “Where politics and Evaluation Research meet”, Evaluation, 1: 37-45.

Weiss, C. (1983), “Ideology, Interest, and Information: The basis for policy decisions”, en A.S. Bryk, ed., Stakeholder-Based Evaluation. San Francisco: Jossey-Bass.

Weiss, C. (1997), “Theory Based Evaluation: Past, Present and Future”, New Directions for Evaluation, 76: 41-55.

Published

01-06-2010

How to Cite

Zapico, E. (2010). Using Evaluation for European Management and Governance. Gestión Y Análisis De Políticas Públicas, (4), 101–133. https://doi.org/10.24965/gapp.v0i4.440