Forms of orientation and dimensions prioritized in performance measurement systems in the public sector

a systematic literature review

Authors

  • Newton Krüger Tallens Junior Universidade Federal de São Paulo (Unifesp), SP, Brasil 0000-0002-0451-1006
  • Emerson Gomes dos Santos Universidade Federal de São Paulo (Unifesp), SP, Brasil 0000-0002-3037-5001
  • Camila Bertini Martins Universidade Federal de São Paulo (Unifesp), SP, Brasil 0000-0002-8252-8815
  • Rogerio Scabim Morano Universidade Federal de São Paulo (Unifesp), SP, Brasil 0000-0002-3233-0843

Keywords:

public sector, erformance measurement, erformance dimensions

Abstract

Organizational performance is one of the most relevant research topics in the public sector. However, due to its broad scope of roles and responsibilities, diversity of objectives and stakeholders, the implementation of Performance Measurement Systems (PMS) is complex, requiring measurement dimensions that consider its peculiarities and important results. Part of the constraints for implementation involve attention to regulations, the need for transparency and accountability. Through a systematic literature review, forms of guidance and performance dimensions prioritized in the PMS of this sector were identified, the results demonstrate that performance measurement in the public sector has crossed the boundaries of its organizations, with broader and more comprehensive measurement perspectives and high impact on society. The forms of guidance were synthesized into a model balanced by the missions and objectives of public institutions, considering their broad purposes, the public interest and the objectivity of the SMD, in relation to the performance dimensions prioritized by the sector, and grouped into three distinct phases, namely: sedimentation, consecration and emergence. As implications, there is a specific and balanced form of guidance, adhering to public institutions and three sets of performance dimensions (relating to three identified phases), some not referenced in existing PMS, providing a new reference for researchers and for practical applications in public administration.

Downloads

Download data is not yet available.

Author Biographies

Newton Krüger Tallens Junior, Universidade Federal de São Paulo (Unifesp), SP, Brasil

Master in Technological Innovation from the Federal University of São Paulo (Unifesp).

Emerson Gomes dos Santos, Universidade Federal de São Paulo (Unifesp), SP, Brasil

PhD and MSc in Production Engineering from the University of São Paulo (USP). Professor at the Paulista School of Politics, Economics and Business at the Federal University of São Paulo (Unifesp).

Camila Bertini Martins, Universidade Federal de São Paulo (Unifesp), SP, Brasil

PhD in Statistics from the University of São Paulo (USP). Master's in Statistics from the University of São Carlos (UFSCAR). Professor at the Paulista School of Medicine of the Federal University of São Paulo (Unifesp).

Rogerio Scabim Morano, Universidade Federal de São Paulo (Unifesp), SP, Brasil

PhD and Master's in Business Administration from the Padre Sabóia de Medeiros Ignatian Educational Foundation (FEI). Professor in the Chemical Engineering Department of the Institute of Environmental, Chemical and Pharmaceutical Sciences at the Federal University of São Paulo (Unifesp).

References

AGOSTINO, D.; ARNABOLDI, M. The new public management in hybrid settings: New challenges for performance measures. International Review of Public Administration, v. 20, n. 4, p. 353–369, 2015. https://doi.org/10.1080/12294659.2015.1088686

ARNABOLDI, M.; AZZONE, G. Constructing performance measurement in the public sector. Critical Perspectives on Accounting, v. 21, n. 4, p. 266–282, 2010. https://doi.org/10.1016/j.cpa.2010.01.016

BORST, R.; LAKO, C.; DE VRIES, M. Is Performance Measurement Applicable in the Public Sector? A Comparative Study of Attitudes among Dutch Officials. International Journal of Public Administration, v. 37, n. 13, p. 922–931, 2014. https://doi.org/10.1080/01900692.2014.944988

BRACCI, E.; MARAN, L.; INGLIS, R. Examining the process of performance measurement system design and implementation in two Italian public service organizations. Financial Accountability and Management, v. 33, n. 4, p. 406–421, 2017. https://doi.org/10.1111/faam.12131

BRASIL. Instituto de Pesquisa Econômica Aplicada. Avaliação de políticas públicas: guia prático de análise ex ante. v. 1. Brasília, 2018. Guia Técnico. Disponível em: https://repositorio.ipea.gov.br/handle/11058/8285. Acesso em 08 jul. 2023.

BRESSER-PEREIRA, L. C. Reforma gerencial e legitimação do estado social. Revista de Administração Pública, v. 51, n. 1, p. 147–156, 2017. https://doi.org/10.1590/0034-7612166376

BRIGNALL, T. J. et al. Performance Measurement in Service Businesses. Management Accounting, v. 69, n. 10, p. 34-36, 1991.

BROWN, M.G. Keeping Score: using the right metrics to drive world-class performance. Quality Resources, 1996.

BROWN, P. R. Public Value Measurement vs. Public Value Creating Imagination–the Constraining Influence of Old and New Public Management Paradigms. International Journal of Public Administration, v. 44, n. 10, p. 808–817, 2021. https://doi.org/10.1080/01900692.2021.1903498

CASTELO, S. L.; CASTELO, A. D. M.; GOMES, C. A. E. F. Sistema de gestão e medição de desempenho nas organizações públicas: o efeito mediador das capacidades dinâmicas. Revista de Gestão e Secretariado, v. 14, n. 1, p. 1284–1306, 2023. https://doi.org/10.7769/gesec.v14i1.1592

CLOETE, F. Policy indicator consistency and coherence in measuring public sector development programmes in South Africa. African Evaluation Journal, v. 6, n. 2, p. 1–11, 2018. https://doi.org/10.4102/aej.v6i2.338

COSTIN, C. Administração pública. Rio de Janeiro: Elsevier, 2010. E-book.

COULTER, P. B. Measuring the inequity of urban public services methodological discussion with applications. Policy Studies Journal, v. 8, n. 5, p. 683–698, 1980. https://doi.org/10.1111/j.1541-0072.1980.tb01274.x

COWELL, R. et al. Public confidence and public services: It matters what you measure. Policy and politics, v. 40, n. 1, p. 123–143, 2012. https://doi.org/10.1332/147084411X581862

DAL MAS, F. et al. From output to outcome measures in the public sector: a structured literature review. International Journal of Organizational Analysis, v. 27, n. 5, p. 1631–1656, 2019. https://doi.org/10.1108/IJOA-09-2018-1523

DE WAELE, L. et al. “A little bit of everything?” Conceptualising performance measurement in hybrid public sector organisations through a literature review. Journal of Public Budgeting, Accounting and Financial Management, v. 33, n. 3, p. 343–363, 2021. https://doi.org/10.1108/JPBAFM-05-2020-0075

DRESCH, A.; LACERDA, D. P.; ANTUNES, J. A. V. Design science research: método de pesquisa para avanço da ciência e tecnologia. Porto Alegre, RS: Bookman, 2020. E-book.

EBRAHIM, A.; RANGAN, V. K. What impact? A framework for measuring the scale and scope of social performance. California Management Review, v. 56, n. 3, p. 118–141, 2014. https://doi.org/10.1525/cmr.2014.56.3.118

ENSSLIN, S. R.; WELTER, L. M.; PEDERSINI, D. R. Performance evaluation: a comparative study between public and private sectors. International Journal of Productivity and Performance Management, v. 71, n. 5, p. 1761–1785, 2022. https://doi.org/10.1108/IJPPM-04-2020-0146

ESLAMZADEH, S. M. K. et al. A framework for fire departments’ performance assessment: a systematic literature review. International Journal of Public Sector Management, v. 35, n. 3, p. 349–369, 2022. https://doi.org/10.1108/IJPSM-06-2021-0149

FEIL, A. A.; SCHREIBER, D. Sustentabilidade e desenvolvimento sustentável: desvendando as sobreposições e alcances de seus significados. Cadernos EBAPE.BR, v. 15, n. 3, p. 667–681, 2017. http://dx.doi.org/10.1590/1679-395157473

FIGLIO, D. N.; KENNY, L. W. Public sector performance measurement and stakeholder support. Journal of Public Economics, v. 93, n. 9–10, p. 1069–1077, 2009. https://doi.org/10.1016/j.jpubeco.2009.07.003

FLYNN, N. performance measurement in public sector services. Policy and Politics, v. 14, n. 3, p. 389–404, 1986. https://doi.org/10.1332/030557386782628172

FRANCO-SANTOS, M. et al. Towards a definition of a business performance measurement system. International Journal of Operations and Production Management, v. 27, n. 8, p. 784–801, 2007. https://doi.org/10.1108/01443570710763778

GAO, J. Performance Measurement and Management in the Public Sector: Some Lessons from Research Evidence. Public Administration and Development, v. 35, n. 2, p. 86–96, 2015. https://doi.org/10.1002/pad.1704

GARENGO, P.; SARDI, A. Performance measurement and management in the public sector: state of the art and research opportunities. International Journal of Productivity and Performance Management, v. 70, n. 7, p. 1629–1654, 2020. https://doi.org/10.1108/IJPPM-03-2020-0102

GĘBCZYŃSKA, A.; BRAJER-MARCZAK, R. Review of selected performance measurement models used in public administration. Administrative Sciences, v. 10, n. 4, p. 1–20, 2020. https://doi.org/10.3390/admsci10040099

GONZAGA, R. P. et al. Avaliação de Desempenho no Governo Mineiro: Alterações dos Indicadores e Metas. Revista de Administração Contemporânea, v. 21, n. spe, p. 1–21, 2017. https://doi.org/10.1590/1982-7849rac2017150331

GRØN, C. H.; KRISTIANSEN, M. B. What Gets Measured Gets Managed? The Use of Performance Information across Organizational Echelons in the Public Sector. Public Performance and Management Review, v. 45, n. 2, p. 448–472, 2022. https://doi.org/10.1080/15309576.2022.2045615

JÄÄSKELÄINEN, A. Implementing a component approach to productivity measurement in a large public service organization. International Journal of Business Performance Management, v. 14, n. 2, p. 111–128, 2013. https://doi.org/10.1504/IJBPM.2013.052941

JÄÄSKELÄINEN, A.; LAIHONEN, H. A strategy framework for performance measurement in the public sector. Public Money and Management, v. 34, n. 5, p. 355–362, 2014. https://doi.org/10.1080/09540962.2014.945807

JÄÄSKELÄINEN, A.; LÖNNQVIST, A. Designing operative productivity measures in public services. Vine, v. 39, n. 1, p. 55–67, 2009. https://doi.org/10.1108/03055720910962443

JACKSON, P. M. Performance measurement: Public service performance evaluation: A strategic perspective. Public Money and Management, v. 13, n. 4, p. 9–14, 1993. https://doi.org/10.1080/09540969309387783

KAPLAN, R. S. Strategic Leadership and Management in Nonprofit Organizations: Theory and Practice. Non-profit Management and Leadership, v. 11, n. 3, p. 353–370, 2001. https://doi.org/10.1002/nml.11308

KAPLAN, R. S.; NORTON, D. P. The balanced scorecard: Measures That drive performance. Harvard Business Review, v. 83, n. 7–8, 1992. https://www.hbs.edu/faculty/Pages/item.aspx?num=9161

KEEGAN, D. P.; EILER, R. G.; JONES, C. R. Are your performance measures obsolete? Management Accounting, v. 70, n. 12, p. 45–50, 1989.

KRÁL, M. 20-Year History of Performance Measurement in the Local Public Sector: A Systematic Review. International Journal of Public Administration, v. 45, n. 9, p. 726–740, 2022. https://doi.org/10.1080/01900692.2021.1891425

LECA, B.; LAGUECIR, A. Expanding Public Sector Performance Measurement and Management Research with Actor-Centred Approaches in New Institutionalism. Journal of Public Budgeting, Accounting & Financial Management, v. 35, n. 5, p. 608–620, 2023. https://doi.org/10.1108/JPBAFM-12-2022-0180

LINNENLUECKE, M. K.; MARRONE, M.; SINGH, A. K. Conducting systematic literature reviews and bibliometric analyses. Australian Journal of Management, v. 45, n. 2, p. 175–194, 2020. https://doi.org/10.1177/0312896219877678

LIU, W. B. et al. The 3E methodology for developing performance indicators for public sector organizations. Public Money & Management, v. 5, n. 30, p. 305-312, 2010. https://doi.org/10.1080/09540962.2010.509180

LYNCH, R L.; CROSS, K. F. Measure Up: the Essential Guide to Measuring Business Performance, Mandarin, 1991.

MARCHIORI, D. M. et al. O papel das capacidades de TI, capacidade de reconfiguração de TI e inovatividade no desempenho organizacional: evidências do setor público brasileiro. Revista de Administração Pública, v. 57, n. 2, p. 1–31, 2023. http://dx.doi.org/10.1590/0034-761220220221

MATIAS-PEREIRA, J. Administração pública. 5ª ed. São Paulo: Grupo GEN, 2018. E-book.

MCKOY, D. V. Measuring the utility of institutional reform in the public service. Social and Economic Studies, v. 58, n. 1, p. 11–41, 2009. https://www.jstor.org/stable/27866574

MELO, A. I.; MOTA, L. F. Public sector reform and the state of performance management in Portugal: is there a gap between performance measurement and its use? International Journal of Public Sector Management, v. 33, n. 6/7, p. 613–627, 2020. https://doi.org/10.1108/IJPSM-12-2019-0325

MODELL, S. Performance Measurement Myths in the Public Sector: A Research Note. Financial Accountability and Management, v. 20, n. 1, p. 39–55, 2004. https://doi.org/10.1111/j.1468-0408.2004.00185.x

MODELL, S. New developments in institutional research on performance measurement and management in the public sector. Journal of Public Budgeting, Accounting and Financial Management, v. 34, n. 3, p. 353–369, 2022. https://doi.org/10.1108/JPBAFM-04-2021-0070

MOURA, L. F. et al. Designing performance measurement systems in nonprofit and public administration organizations. International Journal of Productivity and Performance Management, v, 68, n. 8, p. 1373–1410, 2019. https://doi.org/10.1108/IJPPM-06-2018-0236

MOURA, L. F. et al. Factors for performance measurement systems design in nonprofit organizations and public administration. Measuring Business Excellence, v. 24, n. 3, p. 377–399, 2020. https://doi.org/10.1108/MBE-10-2019-0102

NAVARATNAM, K. K. Quality Cost in the Public Service: Identifying, Measuring and Reporting. Australian Journal of Public Administration, v. 52, n. 4, p. 383–388, 1993. https://doi.org/10.1111/j.1467-8500.1993.tb00292.x

NEELY, A.; KENNERLEY, M.; ADAMS, C. Performance measurement frameworks: A review. In: Business Performance Measurement: Unifying Theories and Integrating Practice, 2ª ed. Cambridge: Cambridge University Press, 2007.

OH, Y.; BUSH, C. B. Assessing public sector performance and untangling the complexity of public performance measurement. International Review of Public Administration, v. 20, n. 3, p. 256–272, 2015. https://doi.org/10.1080/12294659.2015.1047143

OLIVEIRA, O. J. de et al. Bibliometric method for mapping the state-of-the-art and identifying research gaps and trends in literature: An essential instrument to support the development of scientific projects. IntechOpen. 2019. Disponível em: https://www.intechopen.com/chapters/69867. Acesso em: 10 jul. 2022

ONU. Os objetivos de desenvolvimento sustentável no Brasil/ Paz, Justiça e Instituições Eficazes. 2023. Disponível em: https://brasil.un.org/pt-br/sdgs/16/. Acesso em: 08 abr. 2023

OPPI, C.; CAMPANALE, C.; CINQUINI, L. Ambiguity in public sector performance measurement: a systematic literature review. Journal of Public Budgeting, Accounting and Financial Management, v. 34, n. 3, p. 370–390, 2022. https://doi.org/10.1108/JPBAFM-09-2020-0167

RASHMAN, L; WITHERS, E.; HARTLEY, J. Organizational learning and knowledge

in public service organizations: A systematic review of the literature. International Journal of Management Reviews, v. 11, n. 4, p. 463-494, 2009.

REITER, R.; KLENK, T. The manifold meanings of ‘post-New Public Management’ – a systematic literature review. International Review of Administrative Sciences, v. 85, n. 1, p. 11–27, 2019. https://doi.org/10.1177/0020852318759736

SANTOS, A. P. dos; GOMES, A. de O. Desempenho de organizações policiais: revisão sistemática da literatura. Revista do Serviço Público, v. 72, n. 1, p. 262–291, 2021. http://repositorio.enap.gov.br/handle/1/6277

SCIMAGO JOURNAL & COUNTRY RANK. Help. 2023. Disponível em: https://www.scimagojr.com/help.php. Acesso em: 01 jun. 2023.

SCHUMANN, A. Using outcome indicators to improve policies: methods, design strategies and implementation, OECD Regional Development Working Papers. Paris: OECD Publishing, n. 2016/2, 2016. https://doi.org/10.1787/5jm5cgr8j532-en

SMITH, G.; HALLIGAN, J.; MIR, M. Does performance measurement improve public sector performance? A case of Australian government agencies. Australian Journal of Public Administration, v. 80, n. 4, p. 713–731, 2021. https://doi.org/10.1111/1467-8500.12481

SMITH, P. Performance indicators and outcome in the public sector. Public Money and Management, v. 15, n. 4, p. 13–16, 1995. https://doi.org/10.1080/09540969509387889

SMITH, P. C.; STREET, A. Measuring the efficiency of public services: The limits of analysis. Journal of the Royal Statistical Society. Series A: Statistics in Society, v. 168, n. 2, p. 401–417, 2005. https://doi.org/10.1111/j.1467-985X.2005.00355.x

SPEKLÉ, R. F.; VERBEETEN, F. H. M. The use of performance measurement systems in the public sector: Effects on performance. Management Accounting Research, v. 25, n. 2, p. 131–146, 2014. https://doi.org/10.1016/j.mar.2013.07.004

STECCOLINI, I.; SALITERER, I.; GUTHRIE, J. The role(s) of accounting and performance measurement systems in contemporary public administration. Public Administration, v. 98, n. 1, p. 3–13, 2020. https://doi.org/10.1111/padm.12642

STROOBANTS, J.; BOUCKAERT, G. Towards Measurable and Auditable Efficiency Gains in the Flemish Public Sector. Public Organization Review, v. 13, n. 3, p. 245–260, 2013. https://doi.org/10.1007/s11115-012-0197-4

SUWANMALA, C. Measuring public service productivity: Case study from Thailand. International Journal of Public Administration, v. 19, n. 11–12, p. 2007–2033, 1996. https://doi.org/10.1080/01900699608525176

TAYLOR, J. Performance in the Public Sector. The Oxford Handbook of Australian Politics, 432–450. 2021. https://doi.org/10.1093/OXFORDHB/9780198805465.013.26

TEH, A.; PANG, L. C. Performance measurement for public sector organizational transformation. International Journal of Business Performance Management, v. 1, n. 4, p. 433–454, 1999. https://doi.org/10.1504/IJBPM.1999.004473

TIDD, J.; BESSANT, J. Gestão da Inovação. 5 ed. Porto Alegre: Bookman, 2015.

TRANFIELD, D.; DENYER, D.; SMART, P. Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review. British Journal of Management, v. 14, n. 3, p. 207–222, 2003. https://doi.org/10.1111/1467-8551.00375

TRONG, C. N.; QUANG, H. P. The measurement of operating results in the public sector: A systematic revaluation and academic interpretation of performance aspects. International Journal of Innovation, Creativity and Change, v. 12, n. 8, p. 143–163, 2020. https://ijicc.net/images/vol12/iss12/121276_Trong_2020_E_R.pdf

UCHOA, C. E. Elaboração de indicadores de desempenho institucional. Brasília: ENAP/DDG, 2013. Apostila. Disponível em: https://repositorio.enap.gov.br/bitstream/1/2403/1/Elabora%C3%A7%C3%A3o%20de%20indicadores%20de%20desempenho_apostila%20exerc%C3%ADcios.pdf. Acesso em: 02 jun. 2022

VAKKURI, J. PMM and beyond – reflections on the paper “new developments in institutional research on performance measurement and management in the public sector”. Journal of Public Budgeting, Accounting and Financial Management, v. 34, n. 4, p. 501–511, 2022. https://doi.org/10.1108/JPBAFM-12-2021-0168

VAN DER KOLK, B. Performance measurement in the public sector: Mapping 20 years of survey research. Financial Accountability and Management, v. 38, n. 4, p. 703–729, 2022. https://doi.org/10.1111/faam.12345

VILHENA, R.; MARTINS, H. Percepções sobre gestão do desempenho no setor público. Revista do Serviço Público, v. 73, n. a, p. 8–25, 2022. https://doi.org/10.21874/rsp.v73.ia.6864

Published

2024-10-02

How to Cite

Krüger Tallens Junior, N., Gomes dos Santos, E., Bertini Martins, C., & Scabim Morano, R. (2024). Forms of orientation and dimensions prioritized in performance measurement systems in the public sector: a systematic literature review. Revista Do Serviço Público, 75(3), 580-619. Retrieved from https://revista.enap.gov.br/index.php/RSP/article/view/10440