Guest editorial: Accounting and performance measurement in the age of rankings, quality assurance, accreditation, and excellence frameworks

Kirsi-Mari Kallio (Turku School of Economics, University of Turku, Turku, Finland)
Elin Funck (School of Economics and Management, Lund University, Lund, Sweden)
Tomi J. Kallio (School of Management, University of Vaasa, Vaasa, Finland)

Journal of Accounting & Organizational Change

ISSN: 1832-5912

Article publication date: 31 October 2023

Issue publication date: 31 October 2023

187

Citation

Kallio, K.-M., Funck, E. and Kallio, T.J. (2023), "Guest editorial: Accounting and performance measurement in the age of rankings, quality assurance, accreditation, and excellence frameworks", Journal of Accounting & Organizational Change, Vol. 19 No. 4, pp. 537-542. https://doi.org/10.1108/JAOC-10-2023-216

Publisher

:

Emerald Publishing Limited

Copyright © 2023, Emerald Publishing Limited


Background and introduction

Over the past three decades, numbers, particularly those that can be expressed in financial terms, have come to be presented as a form of truth. Today, numbers guide and govern us, and shape and influence who we are, or who we should try to become (Kurunmäki et al., 2016). A few decades ago, this quantifying movement was restricted to a few fields. Today, however, it appears as if no one can escape the movement: higher education, health care and the public and private sectors in general have all witnessed a radical uptick of new management models, methods and calculative practices (Grossi et al., 2020; Argento et al., 2020; Eyraud, 2022; Parker et al., 2023). The so-called audit culture (Shore and Wright, 2015a) or audit explosion (Power, 2003) has resulted in the use of financial accounting technologies to measure and rank organizations and their employees and thus use quantification and statistics as instruments of governance and power (Shore and Wright, 2015b). More recently, the quality and quality assurance (QA) of operations and services, rankings of service providers and different excellence frameworks in public organizations have received increasing attention. Not least in the form of different accreditation systems (Bell and Taylor, 2005; Alajoutsijärvi et al., 2018; Vega and Cunha, 2023). Along with the rise in auditing and rankings, a vast number of international firms specializing in accountancy and statistical ratings have emerged (Shore and Wright, 2015a). These firms measure the creditworthiness of countries and organizations (ibid.).

The external control and monitoring of activities are taken up by administrative structures in public services or organizations and verified through standardized measures and instruments. The introduction of accounting and calculative practices, such as performance measurements and accreditation, has often been justified with reference to the positive effects they could have on transparency, effectiveness and quality. Studies have pointed to the normalizing and disciplining powers associated with ranking and accreditations and to responses to “reputational risk” as explanations for organizational change (Burrows, 2012; Espeland and Sauder, 2007; Power et al., 2009; Sauder and Espeland, 2009). Nevertheless, numerous studies have reported on the negative effects of introducing performance measures and demonstrated how performance measurement and ranking may cause stress and anxiety (Chandler et al., 2002), the valuing of quantity over quality (Kallio and Kallio, 2014; Olssen and Peters, 2005) or evaluations being limited by standardized scores based upon rankings and ratings (Lane, 2010; Gebreiter, 2022). According to Sauder and Espeland (2009, p. 80):

Rankings are part of a global movement that is redefining accountability, transparency, and good governance in terms of quantitative measures […] they diminish the salience of local knowledge and professional autonomy, they absorb vast resources, and they insinuate and extend market logic.

Muller (2018, p. 3) continues:

There are things that can be measured. There are things that are worth measuring. But what can be measured is not always what is worth measuring […] The things that get measured may draw efforts away from the things we really care about. And measurement may provide us with distorted knowledge.

Responding to a challenge by Sauder and Espeland (2009) and Muller (2018), this special issue focuses on the effects and consequences of the age of rankings, QA, accreditation and excellence frameworks in public services and organizations. Earlier studies have pointed to how ranking and performance measurement generate tensions between corporate and collegial cultures (Christopher, 2012; Kallio et al., 2021), how underlying logics of academics become challenged (Kallio and Kallio, 2014) and how the combination of two or more elements from different sectors or logics that are normally found separately becomes merged into a hybrid construct with the introduction of calculative practices (Weisel and Modell, 2014; Johanson and Vakkuri, 2018; Kastberg and Lagström, 2019; Kallio et al., 2021). Consequently, we may expect to find the effects and consequences of the age of rankings, QA, accreditation and excellence frameworks on both macro and micro levels in society. Moreover, as public sector organizations are typically not directly subject to market mechanisms, it is far from easy to determine what quality means for public sector organizations in general and for knowledge-intensive public organizations in particular.

Papers included in this issue

Our call for papers has provided us with a group of interesting studies with a range of public institutions (health care, higher education, municipal organizations). The common themes of the four papers passing the review process are the focus on perceptions of calculative practices, performative effects and navigations of expectations of the introduction of accreditation. The studies also address how educational background affects reporting quality. These themes are investigated differently in the four papers and use a range of different methods as well as varied theoretical frames and empirical material from different countries.

The first paper by Vega and Cunha (2023), “Commensuration of health-care quality standards through hospital accreditation: from measurement weapon to management tool?” examines management perceptions of calculative practices behind the reconstruction of a mandatory hospital accreditation system. Through the lens of commensuration (Espeland and Stevens, 1998), they emphasize that metrics, such as the accreditation system, have an important performativity effect. The findings of their case study illustrate:

[…] how the interplay between the features of a quality assurance system and their appropriation by organizations turns it into a quality improvement system suggesting that contemporary hospital accreditation and similar accreditation systems are becoming hybrid models (Vega and Cunha, 2023).

They conclude that although the hospital accreditation might be perceived as threatening by management, there is also the possibility of an alternative view: accreditation might also be used as an instance for organizational changes and improvement of performance.

The second paper by Iman Harymawan et al. (2022), “Chief financial officer’s educational background from reputable universities and financial reporting quality”, examines the relationship between the educational background of Chief Financial Officers (CFO) from reputable, high ranked universities and financial reporting quality. Harymawan et al. (2022) use data from companies listed on the Indonesia Stock Exchange with least-squares regression analysis model. They find that the educational background of CFOs from a reputable university has a significant and positive association with financial reporting quality. They explain the result by the fact that the CFOs with a degree from a high-ranked university have higher and broader financial skills, which, in turn, help to improve financial reporting quality and the individual performance of CFOs.

The third paper by Lise Degn, Miriam Madsen and Katja Brøgger “Translating quality criteria in university accreditation,” deals with the Danish higher education sector and seeks to find out how these higher education institutions navigate the demands and expectations of accreditation procedures. By doing this, they demonstrate how the limited freedom posed by accreditation schemes is used by higher education studies by way of translation (Sahlin and Wedlin, 2008). From studying policy documents and institutional self-assessment reports, the authors conclude that the Danish higher education institutions they study exercise a great deal of agency, albeit within the rather narrow frame of the regulations, guidelines and procedures of the national accreditation system in Denmark. They show how the institutions not only imitate and abide with institutionalized norms and concepts of quality but also reformulate, edit, omit and enhance certain elements of quality.

The fourth paper by Linda Höglund, Maria Mårtensson and Pia Nylinder, “Public value accounting and the use of performance measurements as a management tool in a context of various assessments,” discusses understanding of public value accounting by studying the use and usefulness of performance measurements as a management tool in a Swedish regional health care division. The paper shows how performance measurements become an instrumental tool for performance and thus leave out non-instrumental use related to such things as quality, with the result that output is promoted above outcome. The authors show a conceptual shortcoming in the discussion of public value accounting, as the effort needed to achieve outcome-based information might exceed the ability of an organization to deliver it. Furthermore, the paper encourages the enhancing of interaction among different stakeholders, including politicians, the public and the media.

Conclusion and implications

The papers in this special issue show that although the literature paints a dark picture of the effects and consequences of the age of rankings, QA, accreditation and excellence frameworks in public services and organizations, there are also many positive aspects, including organizational change and improvement of performance (Vega and Cunha, 2023), improved financial reporting quality (Harymawan et al., 2022), opportunities for institutions to reformulate, edit, omit and enhance elements of quality (Degn et al., 2023) and, finally, encouraging of interaction between different stakeholders in the process of choosing performance measurements for management purposes and the creation of public value (Höglund et al., 2023). Overall, there is still a need for future studies on accounting and performance measurement in the age of rankings, QA, accreditation and excellence frameworks. Some interesting themes that need further investigation include the following: How is quality produced in discourses within organizations? How do different public sector entities (such as health care, education, municipalities) make use of excellence frameworks? How are rankings used to support decision-making and how do they steer the actions of organizations? How can quality assurance and accounting be put to good use in the future when dealing with issues such as equality, inclusion and diversity within knowledge-intensive public organizations? We urge future researchers to draw on a wide range of methods and theories to tackle these issues.

References

Alajoutsijärvi, K., Kettunen, K. and Sohlo, S. (2018), “Shaking the status quo: business accreditation and positional competition”, Academy of Management Learning and Education, Vol. 17 No. 2, pp. 203-225, doi: 10.5465/amle.2015.0199.

Argento, D., Dobija, D. and Grossi, G. (2020), “The disillusion of calculative practices in academia”, Qualitative Research in Accounting and Management, Vol. 17 No. 1, pp. 1-17, doi: 10.1108/QRAM-12-2019-0130.

Bell, E. and Taylor, S. (2005), “Joining the club: the ideology of quality and business school badging”, Studies in Higher Education, Vol. 30 No. 3, pp. 239-255, doi: 10.1080/03075070500095671.

Burrows, R. (2012), “Living with the H-index? Metric assemblages in the contemporary academy”, The Sociological Review, Vol. 60 No. 2, pp. 355-372, doi: 10.1111/j.1467-954X.2012.02077.x.

Chandler, J., Barry, J. and Clark, H. (2002), “Stressing academe: the wear and tear of the new public management”, Human Relations, Vol. 55 No. 9, pp. 1051-1069, doi: 10.1177/0018726702055009019.

Christopher, J. (2012), “Tension between the corporate and collegial cultures of Australian public universities: the current status”, Critical Perspectives on Accounting, Vol. 23 Nos 7/8, pp. 556-571, doi: 10.1016/j.cpa.2012.06.001.

Degn, L., Madsen, M. and Brøgger, K. (2023), “Translating quality criteria in university accreditation”, Journal of Accounting and Organizational Change, Vol. ahead-of-print No. ahead-of-print, doi: 10.1108/JAOC-02-2022-0030.

Espeland, W.N. and Sauder, M. (2007), “Rankings and reactivity: how public measures recreate social worlds”, American Journal of Sociology, Vol. 113 No. 1, pp. 1-40, doi: 10.1086/517897.

Espeland, W.N. and Stevens, M.L. (1998), “Commensuration as a social process”, Annual Review of Sociology, Vol. 24 No. 1, pp. 313-343, doi: 10.1086/517897.

Eyraud, C. (2022), “Archaeology of a quantification device: quantification, policies and politics in French higher education”, in Mennicken, A. and Salais, R. (Eds), The New Politics of Numbers: Utopia, Evidence and Democracy, Springer International Publishing, Cham.

Gebreiter, F. (2022), “A profession in peril? University corporatization, performance measurement and the sustainability of accounting academia”, Critical Perspectives on Accounting, Vol. 87, doi: 10.1016/j.cpa.2021.102292.

Grossi, G., Kallio, K.-M., Sargiacomo, M. and Skoog, M. (2020), “Accounting, performance management systems and accountability changes in knowledge-intensive public organizations: a literature review and research agenda”, Accounting, Auditing and Accountability Journal, Vol. 33 No. 1, pp. 256-280, doi: 10.1108/AAAJ-02-2019-3869.

Harymawan, I., Minanurohman, A., Nasih, M., Shafie, R. and Ismail, I. (2022), “Chief financial officer’s educational background from reputable universities and financial reporting quality”, Journal of Accounting and Organizational Change, Vol. ahead-of-print No. ahead-of-print, doi: 10.1108/JAOC-12-2021-0195.

Höglund, L., Mårtensson, M. and Nylinder, P. (2023), “Public value accounting and the use of performance measurements as a management tool in a context of various assessments”, Journal of Accounting and Organizational Change, Vol. ahead-of-print No. ahead-of-print, doi: 10.1108/JAOC-12-2021-0186.

Johanson, J.E. and Vakkuri, J. (2018), Governing Hybrid Organizations: exploring Diversity of Institutional Life, Routledge, London.

Kallio, K.-M. and Kallio, T.J. (2014), “Management-by-results and performance measurements in universities – implications for work motivation”, Studies in Higher Education, Vol. 39 No. 4, pp. 574-589, doi: 10.1080/03075079.2012.709497.

Kallio, K.-M., Kallio, T.J., Grossi, G. and Engblom, J. (2021), “Institutional logic and scholars' reactions to performance measurement in universities”, Accounting, Auditing and Accountability Journal, Vol. 34 No. 9, pp. 104-130, doi: 10.1108/AAAJ-03-2018-3400.

Kastberg, G. and Lagström, C. (2019), “Processes of hybridization and de-hybridization: organizing and the task at hand”, Accounting, Auditing and Accountability Journal, Vol. 32 No. 3, doi: 10.1108/AAAJ-08-2017-3103.

Kurunmäki, L., Mennicken, A. and Miller, P. (2016), “Quantifying, economising, and marketising: democratising the social sphere?”, Sociologie du Travail, Vol. 58 No. 4, pp. 390-402, doi: 10.1016/j.soctra.2016.09.018.

Lane, J. (2010), “Let’s make science metrics more scientific”, Nature, Vol. 464 No. 7288, pp. 488-489, doi: 10.1038/464488a.

Muller, J.Z. (2018), The Tyranny of Metrics, Princeton University Press, Princeton, NJ.

Olssen, M. and Peters, M. (2005), “Neoliberalism, higher education and the knowledge economy: from the free market to knowledge capitalism”, Journal of Education Policy, Vol. 20 No. 3, pp. 313-345, doi: 10.1080/02680930500108718.

Parker, L., Martin-Sardesai, A. and Guthrie, J. (2023), “The commercialized Australian public university: an accountingized transition”, Financial Accountability and Management, Vol. 39 No. 1, pp. 125-150, doi: 10.1111/faam.12310.

Power, M. (2003), “Evaluating the audit explosion”, Law and Policy, Vol. 25 No. 3, pp. 185-202, doi: 10.1111/j.1467-9930.2003.00147.x.

Power, M., Scheytt, T., Soin, K. and Sahlin, K. (2009), “Reputational risk as a logic of organizing in late modernity”, Organization Studies, Vol. 30 Nos 2/3, pp. 301-324, doi: 10.1177/0170840608101482.

Sahlin, K. and Wedlin, L. (2008), “Circulating ideas: imitation, translation and editing”, The Sage Handbook of Organizational Institutionalism, Vol. 218, Sage, p. 242.

Sauder, M. and Espeland, W.N. (2009), “The discipline of rankings: tight coupling and organizational change”, American Sociological Review, Vol. 74 No. 1, pp. 63-82, doi: 10.1177/000312240907400104.

Shore, C. and Wright, S. (2015a), “Audit culture revisited. Rankings, ratings, and the reassembling of society”, Current Anthropology, Vol. 56 No. 3, pp. 421-444.

Shore, C. and Wright, S. (2015b), “Governing by numbers: audit culture, rankings and the new world order”, Social Anthropology, Vol. 23 No. 1, pp. 22-28, doi: 10.1111/1469-8676.12098.

Vega, M. and Cunha, J.V.d. (2023), “Commensuration of health-care quality standards through hospital accreditation: from measurement weapon to management tool?”, Journal of Accounting and Organizational Change, Vol. ahead-of-print No. ahead-of-print, doi: 10.1108/JAOC-12-2021-0190.

Weisel, F. and Modell, S. (2014), “From new public management to new public governance? Hybridization and implications for public sector consumerism”, Financial Accountability and Management, Vol. 30 No. 2, pp. 175-205, doi: 10.1111/faam.12033.

Acknowledgements

The authors would like to express their gratitude to the various parties that supported them in putting together this issue. First, the authors would extend their gratitude to Zahirul Hoque, the editor-in-chief of the Journal of Accounting and Organizational Change, for unwavering support and willingness to publish a special issue on accounting and performance measurement in the age of rankings, QA, accreditation and excellence frameworks. Second, the authors would like to thank Jan Wallanders och Tom Hedelius stiftelse samt Tore Browaldhs stiftelse for the financial support of the research project University Quality Assurance and Performance Measurement Systems (Grant No. P18-0143). Additionally, the authors want to extend their appreciation to the numerous peer reviewers who generously dedicated their time to offer insightful and well-considered feedback. Lastly, the authors would like to extend a sincere appreciation to the esteemed authors whose contributions grace the pages of this issue. Their dedication is evident in the substantial time and intellectual effort invested in composing and refining their manuscripts, guided by the invaluable feedback provided by peer reviewers. The authors are assured that the included articles will advance our understanding of the effects and consequences of the age of rankings, quality assurance, accreditation and excellence frameworks in public services and organizations paving the way for informed anticipation of future imperatives.

Related articles