kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A metric culture in academia: The influence of performance measurement on the academic culture of Swedish universities
KTH, School of Industrial Engineering and Management (ITM), Learning.ORCID iD: 0000-0002-4280-9866
2020 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This thesis studies how the proliferation of performance measurement within Swedish universities has affected the way university actors perceive academic work. The wide diffusion of performance measures in academia is conceptualised as a reflection of changes in the wider societal culture that may be attributed to comprehensive public sector reforms, the globalisation of the higher education sector and novel perspectives and expectations on universities. The result has been an increasing focus on productivity, accountability and competition within universities. To study how this is received by actors within Swedish universities is important because it is likely to have significant consequences for the way academic work is organised and conducted. Therefore, the research question asked in this thesis is how performance measurement influences the understanding of academic work among academics and managers in Swedish universities. This question has been approached through the application of organisational culture theory, which enables an analysis of how university actors collectively perceive the increasing measurement of academic performance. The empirical contribution of the thesis consists of four papers that in different ways explore the role of performance measurement within Swedish universities. The papers discuss academic managers as mediators of meaning, how funding arrangements influence local perceptions of research, subcultural differences in attitudes towards performance measurement and why department heads make use of performance measurement systems. The conclusions of the thesis are that the influence of performance measurement on the understanding of academic work among academics and managers in Swedish universities has affected academic culture in various ways. Some aspects of academic culture have been strengthened and others weakened. The prevalence of performance measures has caused academic work to be increasingly seen through the lens of these measures, which emphasise the importance of displaying a good performance as indicated by the metrics. For most, this is often a matter of minor adaptation, but for some it may imply severe challenges. Although academic performance measures are important tools, used for a variety of purposes, they also pose a challenge to academic culture as the organising principle for academic work.

Abstract [sv]

Den här avhandlingen undersöker hur utbredningen av prestationsmått inom svenska universitet har påverkat hur aktörer inom universiteten uppfattar akademiskt arbete. Den stora spridningen av prestationsmått inom akademin ses som en reflektion av förändringar i en vidare samhällskultur. Dessa förändringar är en konsekvens av omfattande reformer av den offentliga sektorn, globaliseringen av högskolesektorn samt nya perspektiv och förväntningar på universiteten. Följden har blivit ett ökat fokus på produktivitet, ansvarsutkrävande och konkurrens inom universiteten. Att studera hur detta tas emot av aktörer inom svenska universitet är av vikt då det antas ha stor betydelse för hur akademiskt arbete organiseras och utförs. Forskningsfrågan som vägleder avhandlingen är således hur prestationsmätning påverkar förståelsen av akademiskt arbete bland akademiker och ledare inom svenska universitet. För att besvara denna fråga används teorier om organisationskultur, vilket möjliggör en analys av hur aktörer inom universiteten kollektivt uppfattar den ökande mätningen av akademiska prestationer. Avhandlingens empiriska bidrag består av fyra artiklar som på olika sätt undersöker prestationsmåttens roll inom svenska universitet. Artiklarna diskuterar akademiska ledare som medlare av mening, hur forskningsfinansieringens organisering påverkar uppfattningen om forskning inom universiteten, subkulturella skillnader i attityder gentemot prestationsmätning, samt varför institutionsledare använder sig av system för mätning av prestationer inom forskning. Avhandlingens slutsatser är att prestationsmåtten påverkar hur akademiskt arbete uppfattas av akademiker och ledare inom svenska universitet, vilket också förändrar den akademiska kulturen på olika vis. Vissa delar av den akademiska kulturen stärks av prestationsmåtten, medan andra försvagas. Förekomsten av prestationsmått har lett till att akademiskt arbete i ökande grad betraktas i ljuset av dessa mått, vilket understryker vikten av att uppvisa goda prestationer, så som det definieras av måtten. För de flesta innebär detta endast mindre anpassningar, men för vissa grupper kan det innebära betydande utmaningar. Trots att akademiska prestationsmått utgör viktiga verktyg för ett flertal ändamål så utgör de således också en utmaning för den akademiska kulturen som organisationsprincip för akademiskt arbete.

Place, publisher, year, edition, pages
Stockholm: Kungliga Tekniska högskolan, 2020. , p. 187
Series
TRITA-ITM-AVL ; 35
National Category
Social Sciences
Research subject
Technology and Learning
Identifiers
URN: urn:nbn:se:kth:diva-279630ISBN: 978-91-7873-614-0 (print)OAI: oai:DiVA.org:kth-279630DiVA, id: diva2:1461211
Public defence
2020-09-25, https://kth-se.zoom.us/webinar/register/WN_geWu3bMPSiK3tFs1Npl0cA, Stockholm, 13:00 (English)
Opponent
Supervisors
Available from: 2020-09-01 Created: 2020-08-26 Last updated: 2022-06-25Bibliographically approved
List of papers
1. Making sense of academic work: the influence of performance measurement in Swedish universities
Open this publication in new window or tab >>Making sense of academic work: the influence of performance measurement in Swedish universities
2019 (English)In: Policy Reviews in Higher Education, ISSN 2332-2969, p. 75-93Article in journal (Refereed) Published
Abstract [en]

Based on data from interviews conducted with 14 academic managers at two Swedish universities, this article investigates the consequences of the increasing prevalence of performance measurement in the higher education sector. The study contributes to the discussion of how performance measurement impacts academic work, focusing specifically on its influence on how meaning is created and recreated by academic managers. By applying the sensemaking perspective, as proposed by Weick ([1995. Sensemaking in Organizations. Thousand Oaks: SAGE Publications]), the article explores seven properties of the sensemaking process. The study results demonstrate the influence of metrics on the process by which managers give meaning to academic work. Performance measures are interpreted by academic managers as important in acquiring resources, supporting decision-making, and enhancing organisational legitimacy. They also reinforce social scripts of competition and success, although they are often understood as being unable to indicate scientific quality. The consequence for sensemaking in teaching and research activities is that measurable performance is understood to be increasingly important. However, a notable finding from the study is that the managers are aware of how metrics promote specific forms of academic work and often attempt to balance these incentives by acknowledging the values and priorities that these metrics are unable to assess. This finding highlights the important role of academic managers as they counteract some of the pressure caused by various performance measures.

Keywords
Performance measures, higher education, universities, sensemaking
National Category
Social Sciences
Identifiers
urn:nbn:se:kth:diva-244856 (URN)10.1080/23322969.2018.1564354 (DOI)2-s2.0-85078871619 (Scopus ID)
Note

QC 20190305

Available from: 2019-03-01 Created: 2019-03-01 Last updated: 2024-03-15Bibliographically approved
2. National Performance-Based Research Funding Systems: Constructing Local Perceptions of Research?
Open this publication in new window or tab >>National Performance-Based Research Funding Systems: Constructing Local Perceptions of Research?
2019 (English)In: Reforms, Organizational Change and Performance in Higher Education: A Comparative Account from the Nordic Countries / [ed] Rómulo Pinheiro, Lars Geschwind, Hanne Foss Hansen, Kirsi Pulkkinen, Cham: Palgrave Macmillan, 2019, p. 111-144Chapter in book (Refereed)
Abstract [en]

In recent years, performance-based research funding systems (PRFSs) have been introduced in all of the Nordic countries. In this chapter, we compare these systems and explore how their introduction is reflected within universities. Through interviews with academics, managers and administrators, we study how the performance measures of these systems are used at the university level and how that affects research activities. The results indicate that the introduction of PRFSs at the national level have had significant effects at the institutional level. The PRFSs contribute to the institutionalisation and consolidation of research metrics as the main way to describe research performances, and thus as the organising principles of research. Differences are also noted between the countries in the reactions of the university actors, which are believed to be a consequence of the variations of the PRFSs.

Place, publisher, year, edition, pages
Cham: Palgrave Macmillan, 2019
National Category
Social Sciences
Identifiers
urn:nbn:se:kth:diva-252800 (URN)10.1007/978-3-030-11738-2_4 (DOI)2-s2.0-85075099645 (Scopus ID)
Note

QC 20210913

Part of ISBN 978-3-030-11737-5

Available from: 2019-06-10 Created: 2019-06-10 Last updated: 2024-10-24Bibliographically approved
3. Disciplinary Differences in Academics’ Perceptions of Performance Measurement at Nordic Universities
Open this publication in new window or tab >>Disciplinary Differences in Academics’ Perceptions of Performance Measurement at Nordic Universities
2020 (English)In: Higher Education Governance & Policy, ISSN 2717-8676, Vol. 1, no 1, p. 18-31Article in journal (Refereed) Published
Abstract [en]

As performance measurement has become increasingly common at Nordic universities, concerns have been raised that disciplinary differences create difficulties in comparing academic performances. To better understand the potential of utilising performance measures for the management of academic work, this study explores how academics perceive governance and steering based on performance measurement. Building on an established typology of the disciplines that distinguishes the hard sciences from the soft and the applied sciences from the pure, we ask how academics perceive performance measurement depending on their disciplinary affiliation. The empirical material consists of a survey sent to academics in four Nordic countries. Our results show there are clear differences in the attitudes toward performance measurement between academics from different disciplines. Academics from the hard applied sciences are more positive about performance measurement than any other group, and academics from the soft pure sciences are more negative. These findings are consistent with notions about the poor adaptation of metrics to publication practices within the soft sciences and greater sensitivity to performance measurement among the applied sciences. The main contribution of the article is to provide empirical data that support the notion that performance measures are accepted to different degrees in different disciplines.

Place, publisher, year, edition, pages
Dergipark, 2020
National Category
Social Sciences
Identifiers
urn:nbn:se:kth:diva-279627 (URN)
Note

QC 20201223

Available from: 2020-08-26 Created: 2020-08-26 Last updated: 2022-06-25Bibliographically approved
4. Why university managers use bibliometric evaluation systems: The case of annual bibliometric monitoring
Open this publication in new window or tab >>Why university managers use bibliometric evaluation systems: The case of annual bibliometric monitoring
(English)Manuscript (preprint) (Other academic)
Abstract [en]

As bibliometrics becomes ever more prevalent, universities have started to implement bibliometric evaluation systems to monitor and improve their research productivity. Because these systems are costly and can be stressful for staff, it is important that they provide substantial benefits to the organisation. However, previous research has indicated that the extent to which performance data are actually being used is not always satisfactory. Therefore, this article aims to study the reasons for use of bibliometric evaluation systems as provided by university managers. A number of factors that have been suggested as influencing evaluation use are explored through qualitative interviews with heads of department at a technical university in Sweden. The results show that a range of factors influence whether the managers use the evaluation system or not. The conclusions suggest that it is important to pay attention to the way in which bibliometric evaluation systems can support learning and development, but also to recognise the limits of their potential.

National Category
Educational Sciences
Identifiers
urn:nbn:se:kth:diva-279629 (URN)
Note

QC 20201022

Available from: 2020-08-26 Created: 2020-08-26 Last updated: 2022-06-25Bibliographically approved

Open Access in DiVA

fulltext(894 kB)1218 downloads
File information
File name FULLTEXT01.pdfFile size 894 kBChecksum SHA-512
46c2ebefaa9fb7d3bf7072e3907c10b56f24766c63c4a40c1629d39aa5a2bcb21570b6b6249d6c0555f320aa6264f7de3400ff35a35046c50859ed9af0fc13b0
Type fulltextMimetype application/pdf

Other links

http://Vid fysisk närvaro eller Du som saknar dator/ datorvana kan kontakta service@itm.kth.se

Search in DiVA

By author/editor
Söderlind, Johan
By organisation
Learning
Social Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 1220 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 2631 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf