kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Reliability and validity of a high-profile peer review study: Probing Wennerås and Wold’s data in Nature
KTH, School of Industrial Engineering and Management (ITM), Industrial Economics and Management (Dept.).ORCID iD: 0000-0003-1292-8239
Department of Education, Uppsala Universitet, Uppsala, Sweden.
2025 (English)In: Quantitative Science Studies, E-ISSN 2641-3337, Vol. 6, p. 1315-1335Article in journal (Refereed) Published
Abstract [en]

This article revisits the widely cited study by Wennerås and Wold (1997), which reported evidence of gender bias and nepotism in the peer review process for Swedish medical research fellowships. Their study has had substantial scholarly and policy influence, often cited as a foundational demonstration of systemic bias in science evaluation to the disadvantage of women. By accessing and reanalyzing the original data set and reconstructing the analytical model used by Wennerås and Wold, we reproduce their findings while identifying key methodological inconsistencies and overlooked complexities. Applications to program types were excluded from their analysis without justification. With the use of normalization techniques, we reassess gender disparities in reviewer scores and demonstrate that much of the reported gender bias can be attributed to disciplinary and programmatic variation rather than applicant sex per se. Moreover, we introduce a network-based analysis of applicant success rates. We conclude that while Wennerås and Wold’s original study remains a milestone in exposing bias in science, aspects of its empirical foundation merit reconsideration. Our findings contribute to ongoing debates about the reproducibility of influential social science studies and the persistent challenges in measuring fairness in research evaluation. The broader political context within Sweden is also outlined.

Place, publisher, year, edition, pages
MIT Press , 2025. Vol. 6, p. 1315-1335
Keywords [en]
bibliometrics, gender studies, peer review, reproducibility and replication studies, scientometrics
National Category
Gender Studies Other Social Sciences not elsewhere specified Information Studies
Identifiers
URN: urn:nbn:se:kth:diva-377874DOI: 10.1162/QSS.a.395ISI: 001636098500003Scopus ID: 2-s2.0-105030998660OAI: oai:DiVA.org:kth-377874DiVA, id: diva2:2044417
Note

QC 20260309

Available from: 2026-03-09 Created: 2026-03-09 Last updated: 2026-03-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Sandström, Ulf

Search in DiVA

By author/editor
Sandström, Ulf
By organisation
Industrial Economics and Management (Dept.)
Gender StudiesOther Social Sciences not elsewhere specifiedInformation Studies

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 25 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf