Forms of orientation and dimensions prioritized in performance measurement systems in the public sector
a systematic literature review
Keywords:
public sector, erformance measurement, erformance dimensionsAbstract
Organizational performance is one of the most relevant research topics in the public sector. However, due to its broad scope of roles and responsibilities, diversity of objectives and stakeholders, the implementation of Performance Measurement Systems (PMS) is complex, requiring measurement dimensions that consider its peculiarities and important results. Part of the constraints for implementation involve attention to regulations, the need for transparency and accountability. Through a systematic literature review, forms of guidance and performance dimensions prioritized in the PMS of this sector were identified, the results demonstrate that performance measurement in the public sector has crossed the boundaries of its organizations, with broader and more comprehensive measurement perspectives and high impact on society. The forms of guidance were synthesized into a model balanced by the missions and objectives of public institutions, considering their broad purposes, the public interest and the objectivity of the SMD, in relation to the performance dimensions prioritized by the sector, and grouped into three distinct phases, namely: sedimentation, consecration and emergence. As implications, there is a specific and balanced form of guidance, adhering to public institutions and three sets of performance dimensions (relating to three identified phases), some not referenced in existing PMS, providing a new reference for researchers and for practical applications in public administration.
Downloads
References
AGOSTINO, D.; ARNABOLDI, M. The new public management in hybrid settings: New challenges for performance measures. International Review of Public Administration, v. 20, n. 4, p. 353–369, 2015. https://doi.org/10.1080/12294659.2015.1088686
ARNABOLDI, M.; AZZONE, G. Constructing performance measurement in the public sector. Critical Perspectives on Accounting, v. 21, n. 4, p. 266–282, 2010. https://doi.org/10.1016/j.cpa.2010.01.016
BORST, R.; LAKO, C.; DE VRIES, M. Is Performance Measurement Applicable in the Public Sector? A Comparative Study of Attitudes among Dutch Officials. International Journal of Public Administration, v. 37, n. 13, p. 922–931, 2014. https://doi.org/10.1080/01900692.2014.944988
BRACCI, E.; MARAN, L.; INGLIS, R. Examining the process of performance measurement system design and implementation in two Italian public service organizations. Financial Accountability and Management, v. 33, n. 4, p. 406–421, 2017. https://doi.org/10.1111/faam.12131
BRASIL. Instituto de Pesquisa Econômica Aplicada. Avaliação de políticas públicas: guia prático de análise ex ante. v. 1. Brasília, 2018. Guia Técnico. Disponível em: https://repositorio.ipea.gov.br/handle/11058/8285. Acesso em 08 jul. 2023.
BRESSER-PEREIRA, L. C. Reforma gerencial e legitimação do estado social. Revista de Administração Pública, v. 51, n. 1, p. 147–156, 2017. https://doi.org/10.1590/0034-7612166376
BRIGNALL, T. J. et al. Performance Measurement in Service Businesses. Management Accounting, v. 69, n. 10, p. 34-36, 1991.
BROWN, M.G. Keeping Score: using the right metrics to drive world-class performance. Quality Resources, 1996.
BROWN, P. R. Public Value Measurement vs. Public Value Creating Imagination–the Constraining Influence of Old and New Public Management Paradigms. International Journal of Public Administration, v. 44, n. 10, p. 808–817, 2021. https://doi.org/10.1080/01900692.2021.1903498
CASTELO, S. L.; CASTELO, A. D. M.; GOMES, C. A. E. F. Sistema de gestão e medição de desempenho nas organizações públicas: o efeito mediador das capacidades dinâmicas. Revista de Gestão e Secretariado, v. 14, n. 1, p. 1284–1306, 2023. https://doi.org/10.7769/gesec.v14i1.1592
CLOETE, F. Policy indicator consistency and coherence in measuring public sector development programmes in South Africa. African Evaluation Journal, v. 6, n. 2, p. 1–11, 2018. https://doi.org/10.4102/aej.v6i2.338
COSTIN, C. Administração pública. Rio de Janeiro: Elsevier, 2010. E-book.
COULTER, P. B. Measuring the inequity of urban public services methodological discussion with applications. Policy Studies Journal, v. 8, n. 5, p. 683–698, 1980. https://doi.org/10.1111/j.1541-0072.1980.tb01274.x
COWELL, R. et al. Public confidence and public services: It matters what you measure. Policy and politics, v. 40, n. 1, p. 123–143, 2012. https://doi.org/10.1332/147084411X581862
DAL MAS, F. et al. From output to outcome measures in the public sector: a structured literature review. International Journal of Organizational Analysis, v. 27, n. 5, p. 1631–1656, 2019. https://doi.org/10.1108/IJOA-09-2018-1523
DE WAELE, L. et al. “A little bit of everything?” Conceptualising performance measurement in hybrid public sector organisations through a literature review. Journal of Public Budgeting, Accounting and Financial Management, v. 33, n. 3, p. 343–363, 2021. https://doi.org/10.1108/JPBAFM-05-2020-0075
DRESCH, A.; LACERDA, D. P.; ANTUNES, J. A. V. Design science research: método de pesquisa para avanço da ciência e tecnologia. Porto Alegre, RS: Bookman, 2020. E-book.
EBRAHIM, A.; RANGAN, V. K. What impact? A framework for measuring the scale and scope of social performance. California Management Review, v. 56, n. 3, p. 118–141, 2014. https://doi.org/10.1525/cmr.2014.56.3.118
ENSSLIN, S. R.; WELTER, L. M.; PEDERSINI, D. R. Performance evaluation: a comparative study between public and private sectors. International Journal of Productivity and Performance Management, v. 71, n. 5, p. 1761–1785, 2022. https://doi.org/10.1108/IJPPM-04-2020-0146
ESLAMZADEH, S. M. K. et al. A framework for fire departments’ performance assessment: a systematic literature review. International Journal of Public Sector Management, v. 35, n. 3, p. 349–369, 2022. https://doi.org/10.1108/IJPSM-06-2021-0149
FEIL, A. A.; SCHREIBER, D. Sustentabilidade e desenvolvimento sustentável: desvendando as sobreposições e alcances de seus significados. Cadernos EBAPE.BR, v. 15, n. 3, p. 667–681, 2017. http://dx.doi.org/10.1590/1679-395157473
FIGLIO, D. N.; KENNY, L. W. Public sector performance measurement and stakeholder support. Journal of Public Economics, v. 93, n. 9–10, p. 1069–1077, 2009. https://doi.org/10.1016/j.jpubeco.2009.07.003
FLYNN, N. performance measurement in public sector services. Policy and Politics, v. 14, n. 3, p. 389–404, 1986. https://doi.org/10.1332/030557386782628172
FRANCO-SANTOS, M. et al. Towards a definition of a business performance measurement system. International Journal of Operations and Production Management, v. 27, n. 8, p. 784–801, 2007. https://doi.org/10.1108/01443570710763778
GAO, J. Performance Measurement and Management in the Public Sector: Some Lessons from Research Evidence. Public Administration and Development, v. 35, n. 2, p. 86–96, 2015. https://doi.org/10.1002/pad.1704
GARENGO, P.; SARDI, A. Performance measurement and management in the public sector: state of the art and research opportunities. International Journal of Productivity and Performance Management, v. 70, n. 7, p. 1629–1654, 2020. https://doi.org/10.1108/IJPPM-03-2020-0102
GĘBCZYŃSKA, A.; BRAJER-MARCZAK, R. Review of selected performance measurement models used in public administration. Administrative Sciences, v. 10, n. 4, p. 1–20, 2020. https://doi.org/10.3390/admsci10040099
GONZAGA, R. P. et al. Avaliação de Desempenho no Governo Mineiro: Alterações dos Indicadores e Metas. Revista de Administração Contemporânea, v. 21, n. spe, p. 1–21, 2017. https://doi.org/10.1590/1982-7849rac2017150331
GRØN, C. H.; KRISTIANSEN, M. B. What Gets Measured Gets Managed? The Use of Performance Information across Organizational Echelons in the Public Sector. Public Performance and Management Review, v. 45, n. 2, p. 448–472, 2022. https://doi.org/10.1080/15309576.2022.2045615
JÄÄSKELÄINEN, A. Implementing a component approach to productivity measurement in a large public service organization. International Journal of Business Performance Management, v. 14, n. 2, p. 111–128, 2013. https://doi.org/10.1504/IJBPM.2013.052941
JÄÄSKELÄINEN, A.; LAIHONEN, H. A strategy framework for performance measurement in the public sector. Public Money and Management, v. 34, n. 5, p. 355–362, 2014. https://doi.org/10.1080/09540962.2014.945807
JÄÄSKELÄINEN, A.; LÖNNQVIST, A. Designing operative productivity measures in public services. Vine, v. 39, n. 1, p. 55–67, 2009. https://doi.org/10.1108/03055720910962443
JACKSON, P. M. Performance measurement: Public service performance evaluation: A strategic perspective. Public Money and Management, v. 13, n. 4, p. 9–14, 1993. https://doi.org/10.1080/09540969309387783
KAPLAN, R. S. Strategic Leadership and Management in Nonprofit Organizations: Theory and Practice. Non-profit Management and Leadership, v. 11, n. 3, p. 353–370, 2001. https://doi.org/10.1002/nml.11308
KAPLAN, R. S.; NORTON, D. P. The balanced scorecard: Measures That drive performance. Harvard Business Review, v. 83, n. 7–8, 1992. https://www.hbs.edu/faculty/Pages/item.aspx?num=9161
KEEGAN, D. P.; EILER, R. G.; JONES, C. R. Are your performance measures obsolete? Management Accounting, v. 70, n. 12, p. 45–50, 1989.
KRÁL, M. 20-Year History of Performance Measurement in the Local Public Sector: A Systematic Review. International Journal of Public Administration, v. 45, n. 9, p. 726–740, 2022. https://doi.org/10.1080/01900692.2021.1891425
LECA, B.; LAGUECIR, A. Expanding Public Sector Performance Measurement and Management Research with Actor-Centred Approaches in New Institutionalism. Journal of Public Budgeting, Accounting & Financial Management, v. 35, n. 5, p. 608–620, 2023. https://doi.org/10.1108/JPBAFM-12-2022-0180
LINNENLUECKE, M. K.; MARRONE, M.; SINGH, A. K. Conducting systematic literature reviews and bibliometric analyses. Australian Journal of Management, v. 45, n. 2, p. 175–194, 2020. https://doi.org/10.1177/0312896219877678
LIU, W. B. et al. The 3E methodology for developing performance indicators for public sector organizations. Public Money & Management, v. 5, n. 30, p. 305-312, 2010. https://doi.org/10.1080/09540962.2010.509180
LYNCH, R L.; CROSS, K. F. Measure Up: the Essential Guide to Measuring Business Performance, Mandarin, 1991.
MARCHIORI, D. M. et al. O papel das capacidades de TI, capacidade de reconfiguração de TI e inovatividade no desempenho organizacional: evidências do setor público brasileiro. Revista de Administração Pública, v. 57, n. 2, p. 1–31, 2023. http://dx.doi.org/10.1590/0034-761220220221
MATIAS-PEREIRA, J. Administração pública. 5ª ed. São Paulo: Grupo GEN, 2018. E-book.
MCKOY, D. V. Measuring the utility of institutional reform in the public service. Social and Economic Studies, v. 58, n. 1, p. 11–41, 2009. https://www.jstor.org/stable/27866574
MELO, A. I.; MOTA, L. F. Public sector reform and the state of performance management in Portugal: is there a gap between performance measurement and its use? International Journal of Public Sector Management, v. 33, n. 6/7, p. 613–627, 2020. https://doi.org/10.1108/IJPSM-12-2019-0325
MODELL, S. Performance Measurement Myths in the Public Sector: A Research Note. Financial Accountability and Management, v. 20, n. 1, p. 39–55, 2004. https://doi.org/10.1111/j.1468-0408.2004.00185.x
MODELL, S. New developments in institutional research on performance measurement and management in the public sector. Journal of Public Budgeting, Accounting and Financial Management, v. 34, n. 3, p. 353–369, 2022. https://doi.org/10.1108/JPBAFM-04-2021-0070
MOURA, L. F. et al. Designing performance measurement systems in nonprofit and public administration organizations. International Journal of Productivity and Performance Management, v, 68, n. 8, p. 1373–1410, 2019. https://doi.org/10.1108/IJPPM-06-2018-0236
MOURA, L. F. et al. Factors for performance measurement systems design in nonprofit organizations and public administration. Measuring Business Excellence, v. 24, n. 3, p. 377–399, 2020. https://doi.org/10.1108/MBE-10-2019-0102
NAVARATNAM, K. K. Quality Cost in the Public Service: Identifying, Measuring and Reporting. Australian Journal of Public Administration, v. 52, n. 4, p. 383–388, 1993. https://doi.org/10.1111/j.1467-8500.1993.tb00292.x
NEELY, A.; KENNERLEY, M.; ADAMS, C. Performance measurement frameworks: A review. In: Business Performance Measurement: Unifying Theories and Integrating Practice, 2ª ed. Cambridge: Cambridge University Press, 2007.
OH, Y.; BUSH, C. B. Assessing public sector performance and untangling the complexity of public performance measurement. International Review of Public Administration, v. 20, n. 3, p. 256–272, 2015. https://doi.org/10.1080/12294659.2015.1047143
OLIVEIRA, O. J. de et al. Bibliometric method for mapping the state-of-the-art and identifying research gaps and trends in literature: An essential instrument to support the development of scientific projects. IntechOpen. 2019. Disponível em: https://www.intechopen.com/chapters/69867. Acesso em: 10 jul. 2022
ONU. Os objetivos de desenvolvimento sustentável no Brasil/ Paz, Justiça e Instituições Eficazes. 2023. Disponível em: https://brasil.un.org/pt-br/sdgs/16/. Acesso em: 08 abr. 2023
OPPI, C.; CAMPANALE, C.; CINQUINI, L. Ambiguity in public sector performance measurement: a systematic literature review. Journal of Public Budgeting, Accounting and Financial Management, v. 34, n. 3, p. 370–390, 2022. https://doi.org/10.1108/JPBAFM-09-2020-0167
RASHMAN, L; WITHERS, E.; HARTLEY, J. Organizational learning and knowledge
in public service organizations: A systematic review of the literature. International Journal of Management Reviews, v. 11, n. 4, p. 463-494, 2009.
REITER, R.; KLENK, T. The manifold meanings of ‘post-New Public Management’ – a systematic literature review. International Review of Administrative Sciences, v. 85, n. 1, p. 11–27, 2019. https://doi.org/10.1177/0020852318759736
SANTOS, A. P. dos; GOMES, A. de O. Desempenho de organizações policiais: revisão sistemática da literatura. Revista do Serviço Público, v. 72, n. 1, p. 262–291, 2021. http://repositorio.enap.gov.br/handle/1/6277
SCIMAGO JOURNAL & COUNTRY RANK. Help. 2023. Disponível em: https://www.scimagojr.com/help.php. Acesso em: 01 jun. 2023.
SCHUMANN, A. Using outcome indicators to improve policies: methods, design strategies and implementation, OECD Regional Development Working Papers. Paris: OECD Publishing, n. 2016/2, 2016. https://doi.org/10.1787/5jm5cgr8j532-en
SMITH, G.; HALLIGAN, J.; MIR, M. Does performance measurement improve public sector performance? A case of Australian government agencies. Australian Journal of Public Administration, v. 80, n. 4, p. 713–731, 2021. https://doi.org/10.1111/1467-8500.12481
SMITH, P. Performance indicators and outcome in the public sector. Public Money and Management, v. 15, n. 4, p. 13–16, 1995. https://doi.org/10.1080/09540969509387889
SMITH, P. C.; STREET, A. Measuring the efficiency of public services: The limits of analysis. Journal of the Royal Statistical Society. Series A: Statistics in Society, v. 168, n. 2, p. 401–417, 2005. https://doi.org/10.1111/j.1467-985X.2005.00355.x
SPEKLÉ, R. F.; VERBEETEN, F. H. M. The use of performance measurement systems in the public sector: Effects on performance. Management Accounting Research, v. 25, n. 2, p. 131–146, 2014. https://doi.org/10.1016/j.mar.2013.07.004
STECCOLINI, I.; SALITERER, I.; GUTHRIE, J. The role(s) of accounting and performance measurement systems in contemporary public administration. Public Administration, v. 98, n. 1, p. 3–13, 2020. https://doi.org/10.1111/padm.12642
STROOBANTS, J.; BOUCKAERT, G. Towards Measurable and Auditable Efficiency Gains in the Flemish Public Sector. Public Organization Review, v. 13, n. 3, p. 245–260, 2013. https://doi.org/10.1007/s11115-012-0197-4
SUWANMALA, C. Measuring public service productivity: Case study from Thailand. International Journal of Public Administration, v. 19, n. 11–12, p. 2007–2033, 1996. https://doi.org/10.1080/01900699608525176
TAYLOR, J. Performance in the Public Sector. The Oxford Handbook of Australian Politics, 432–450. 2021. https://doi.org/10.1093/OXFORDHB/9780198805465.013.26
TEH, A.; PANG, L. C. Performance measurement for public sector organizational transformation. International Journal of Business Performance Management, v. 1, n. 4, p. 433–454, 1999. https://doi.org/10.1504/IJBPM.1999.004473
TIDD, J.; BESSANT, J. Gestão da Inovação. 5 ed. Porto Alegre: Bookman, 2015.
TRANFIELD, D.; DENYER, D.; SMART, P. Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review. British Journal of Management, v. 14, n. 3, p. 207–222, 2003. https://doi.org/10.1111/1467-8551.00375
TRONG, C. N.; QUANG, H. P. The measurement of operating results in the public sector: A systematic revaluation and academic interpretation of performance aspects. International Journal of Innovation, Creativity and Change, v. 12, n. 8, p. 143–163, 2020. https://ijicc.net/images/vol12/iss12/121276_Trong_2020_E_R.pdf
UCHOA, C. E. Elaboração de indicadores de desempenho institucional. Brasília: ENAP/DDG, 2013. Apostila. Disponível em: https://repositorio.enap.gov.br/bitstream/1/2403/1/Elabora%C3%A7%C3%A3o%20de%20indicadores%20de%20desempenho_apostila%20exerc%C3%ADcios.pdf. Acesso em: 02 jun. 2022
VAKKURI, J. PMM and beyond – reflections on the paper “new developments in institutional research on performance measurement and management in the public sector”. Journal of Public Budgeting, Accounting and Financial Management, v. 34, n. 4, p. 501–511, 2022. https://doi.org/10.1108/JPBAFM-12-2021-0168
VAN DER KOLK, B. Performance measurement in the public sector: Mapping 20 years of survey research. Financial Accountability and Management, v. 38, n. 4, p. 703–729, 2022. https://doi.org/10.1111/faam.12345
VILHENA, R.; MARTINS, H. Percepções sobre gestão do desempenho no setor público. Revista do Serviço Público, v. 73, n. a, p. 8–25, 2022. https://doi.org/10.21874/rsp.v73.ia.6864
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Revista do Serviço Público
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
- A RSP adota a licença Creative Commons (CC) do tipo Atribuição – Uso Não-Comercial (BY-NC).
- A licença permite que outros remixem, adaptem e criem obra licenciada, sendo proibido o uso com fins comerciais.
- As novas obras devem fazer referência ao autor nos créditos e não podem ser usadas com fins comerciais, porém não precisam ser licenciadas sob os mesmos termos dessa licença.
- Ao publicar o artigo na RSP, o autor cede e transfere para a ENAP os direitos autorais patrimoniais referentes ao artigo.
- O artigo publicado na RSP não poderá ser divulgado em outro meio sem a devida referência à publicação de origem.
- O autor que tiver o artigo publicado na RSP deverá assinar o Termo de Concessão de Direitos Autorais (em momento oportuno a editoria da Revista entrará em contato com o autor para assinatura do Termo).
