Change search
Link to record
Permanent link

Direct link
BETA
Arnold, Erik
Publications (7 of 7) Show all publications
Åström, T., Brown, N., Wain, M., Nielsen, K., Potau, X. & Arnold, E. (2018). How can the EU Framework Programme for Research and Innovation increase the economic and societal impact of RDI funding in Finland?. Helsinki: Prime Minister's Office
Open this publication in new window or tab >>How can the EU Framework Programme for Research and Innovation increase the economic and societal impact of RDI funding in Finland?
Show others...
2018 (English)Report (Other academic)
Place, publisher, year, edition, pages
Helsinki: Prime Minister's Office, 2018. p. 216
National Category
Social Sciences Interdisciplinary
Research subject
History of Science, Technology and Environment
Identifiers
urn:nbn:se:kth:diva-250283 (URN)978-952-287-511-2 (ISBN)
Note

QC 20190520

Available from: 2019-04-28 Created: 2019-04-28 Last updated: 2019-05-20Bibliographically approved
Kolarz, P., Arnold, E., Davé, A., Andréasson, H. & Bryan, B. (2018). How Research Funders Ensure the Scientific Legitimacy of their Decisions: Investigation in Support of Formas Scientific Management. Brighton: technopolis |group| United Kingdom
Open this publication in new window or tab >>How Research Funders Ensure the Scientific Legitimacy of their Decisions: Investigation in Support of Formas Scientific Management
Show others...
2018 (English)Report (Other academic)
Abstract [en]

This report was commissioned by Formas, to inform its decision-making about scientific management and  how  it  ensures  the  scientific  quality  and  legitimacy  of  its  decisions.  Formas’  structure  and organisation were designed when it was much smaller than today. In particular, it is not clear that the traditional  arrangement  with  a  ‘secretary  general’  (huvudsekreterare)  who  provides  scientific  quality control  of  funding  processes  and  decisions  and  aims  to  ensure  that  proposed  programming  decisions are scientifically based, is sustainable in the new context. The report therefore looks at how equivalent processes  for  ensuring  the  scientific  legitimacy  of  decisions  work  elsewhere  by  looking  at  five  other Swedish funders and five international examples. The use of quality control mechanisms outside the normal hierarchy of committees and administration turns out to be confined to the four funders that are researcher governed. All funders rely on peer and expert  review  so  that – while  there  may  be  ways  for  higher  levels  to  check  the  process  and  ratify  the decisions – de facto it is review panels that make funding decisions. To varying degrees, all the funders considered are transparent about how they make decisions, both in terms of the information they share with  applicants  and  the  outside  world  and  in  terms  of  the  ability  of  higher  decision-levels  within  the organisation  to  scrutinise  processes  done  at  lower  levels.  Except  in  the  researcher-governed  funders, this is normally considered adequate to ensure scientific quality and legitimacy. Peer and panel review of proposals in ‘bottom-up’ or ‘response-mode’ programmes is well understood and conceptually simple. A difficulty most of the funders have to manage is to define and maintain an appropriate  balance  between  the need  to  fund  high-quality  science  and  the  requirement  in  thematic programmes  for  the  research  to  be  societally  relevant.  Funders  tend  to  manage  these  two  types  of programme  separately,  using  different  assessment  criteria  and  often  different  types  of  panel (e.g. involving  ‘user’  or  societal  representatives  in  addition  to  academic  experts  when  funding  thematic research). In many cases, scientific and non-scientific criteria are assessed at the same time (typically including  remote  review  followed  by  a  panel  decision),  but  this  can  lead  to  lack  of  clarity  about  how specific project funding decisions are actually made. The alternative is to assess proposals sequentially: this can mean scientific peer review first and then consideration of non-scientific criteria second (e.g. by peer review at the first stage and panel review including non-academics at the second) or vice versa (e.g. an  outline-proposal  detailing  thematic  relevance  first  and  peer  review  second).  The  advantage  of sequential  treatment  is  that  it  makes  the  judgement  of  scientific  quality  unambiguous,  providing  a clearer basis for trust in the assessment process as a whole. In whatever order the assessment is done, there is a clear scientific quality test that filters out scientifically sub-standard proposals. Not all funders use the kind of rigid distinction between scientific committees and administration seen in  research  councils.  NERC  (UK)  and  NWO  (Netherlands)  have  both  reorganised  lately  in  ways  that reduce  this  distinction  while  maintaining  scientific  oversight  within  the  organisation.  While  all  the funders  consult  with  their  beneficiary  communities,  three  have  started  to  do  so  through  external processes, opening up future research prioritisation to the wider research community (and also in the Netherlands to the public) as part of a process of increasing wider trust in them as useful organisations. Based  on  international  experience,  Formas  could  consider  at  least  the  following  options  for  future scientific management (in addition to the status quo).

• Further increase the internal and external transparency of proposal selection processes, replacing quality control by a secretary general with quality assurance through open processes. This could be accompanied by further development of processes for selecting peer and panel reviewers

• Increase  the  role  of  the  Scientific  Council  in  oversight  and  especially  in  programme  planning, avoiding the need for separate quality control processes

• Implement multi-stage assessment processes, separating scientific and societal assessments

• Alternatively,  the  present  system  could  be  extended  by  having  three  secretaries  general  (one  per department)  or  introducing  scientific  committees  for  each  department.  These  solutions  would however be relatively inefficient

Place, publisher, year, edition, pages
Brighton: technopolis |group| United Kingdom, 2018. p. 82
National Category
Social Sciences Interdisciplinary
Research subject
History of Science, Technology and Environment
Identifiers
urn:nbn:se:kth:diva-250285 (URN)
Note

QC 20190520

Available from: 2019-04-28 Created: 2019-04-28 Last updated: 2019-05-20Bibliographically approved
Arnold, E., Åström, T., Glass, C. & de Scalzi, M. (2018). How should we evaluate complex programmes for innovation and socio-technical transitions?. Brighton: technopolis |group| United Kingdom
Open this publication in new window or tab >>How should we evaluate complex programmes for innovation and socio-technical transitions?
2018 (English)Report (Other academic)
Place, publisher, year, edition, pages
Brighton: technopolis |group| United Kingdom, 2018. p. 94
National Category
Social Sciences Interdisciplinary
Research subject
History of Science, Technology and Environment
Identifiers
urn:nbn:se:kth:diva-250284 (URN)
Note

QC 20190520

Available from: 2019-04-28 Created: 2019-04-28 Last updated: 2019-05-20Bibliographically approved
Kolarz, P., Arnold, E., Fryges, H., Krčál, A., Peter, V. & Rentel, M. (2018). Impact evaluation of National Research Programmes 59, 60 and 61: Final report. Brighton: technopolis |group| United Kingdom
Open this publication in new window or tab >>Impact evaluation of National Research Programmes 59, 60 and 61: Final report
Show others...
2018 (English)Report (Other academic)
Place, publisher, year, edition, pages
Brighton: technopolis |group| United Kingdom, 2018. p. 103
National Category
Social Sciences Interdisciplinary
Research subject
History of Science, Technology and Environment
Identifiers
urn:nbn:se:kth:diva-250282 (URN)
Note

QC 20190520

Available from: 2019-04-28 Created: 2019-04-28 Last updated: 2019-05-20Bibliographically approved
Arnold, E. (2018). Review of the Research Excellence Framework: Evidence Report. London
Open this publication in new window or tab >>Review of the Research Excellence Framework: Evidence Report
Show others...
2018 (English)Report (Other academic)
Place, publisher, year, edition, pages
London: , 2018
National Category
Social Sciences Interdisciplinary
Research subject
History of Science, Technology and Environment
Identifiers
urn:nbn:se:kth:diva-250280 (URN)
Note

QCR 20190819

Available from: 2019-04-28 Created: 2019-04-28 Last updated: 2019-08-19Bibliographically approved
Arnold, E. (2018). The Latvian Research Funding System. Brussels: European Commission, DG-RTD Policy Support Facility
Open this publication in new window or tab >>The Latvian Research Funding System
2018 (English)Report (Other (popular science, discussion, etc.))
Alternative title[en]
Specific Support to Latvia : The Latvian Research Funding System
Place, publisher, year, edition, pages
Brussels: European Commission, DG-RTD Policy Support Facility, 2018. p. 97
National Category
Other Social Sciences not elsewhere specified
Research subject
History of Science, Technology and Environment
Identifiers
urn:nbn:se:kth:diva-250279 (URN)10.2777/3392 (DOI)978-92-79-79921-1 (ISBN)
Note

QC 20190520

Available from: 2019-04-28 Created: 2019-04-28 Last updated: 2019-05-20Bibliographically approved
Soete, L., Mahieu, B., Luukkonen, T. & Arnold, E. (2018). The research evaluation and performance-based funding system in Bulgaria. Brussels: RTD-PUBLICATIONS@ec.europa.eu
Open this publication in new window or tab >>The research evaluation and performance-based funding system in Bulgaria
2018 (English)Report (Other academic)
Alternative title[en]
Specific Support to Bulgaria : The research evaluation and performance-based funding system in Bulgaria
Place, publisher, year, edition, pages
Brussels: RTD-PUBLICATIONS@ec.europa.eu, 2018. p. 116
National Category
Social Sciences Interdisciplinary
Research subject
History of Science, Technology and Environment
Identifiers
urn:nbn:se:kth:diva-250281 (URN)10.2777/865586 (DOI)978-92-79-85769-0 (ISBN)
Note

QC 20190520

Available from: 2019-04-28 Created: 2019-04-28 Last updated: 2019-05-20Bibliographically approved
Organisations

Search in DiVA

Show all publications