Publiseringsindikatoren i en internasjonal kontekst - Resultatbasert finansiering av forskningsinstitusjoner Gunnar Sivertsen

Oversikt 1.Resultatbasert finansiering 2.Evalueringsbaserte modeller 3.Indikatorbaserte modeller 4.Utviklingstendenser 5.Konsekvenser for CRIS-systemer

Oversikt 1.Resultatbasert finansiering 2.Evalueringsbaserte modeller 3.Indikatorbaserte modeller 4.Utviklingstendenser 5.Konsekvenser for CRIS-systemer

”The dual funding system” (Public sources) Government Direct grants Historical, Political Strategic Performance based Research institutions Research Councils Projects and Programmes Competition Research Evaluation

The balance? Government Direct grants Historical, Political Strategic Performance based Research institutions Research Councils Projects and Programmes Competition Research Evaluation

The mix? Government Direct grants Historical, Political Strategic Performance based Research institutions Research Councils Projects and Programmes Competition Research Evaluation

Same aims, methods, and effects? Government Direct grants Historical, Political Strategic Performance based Research institutions Research Councils Projects and Programmes Competition Research Evaluation

2004: Behov for mer vekt på forskning i den overordnete budsjettmodellen for universiteter og høgskoler Budsjett for U&H Basis: 60%Utdanning: 25%Forskning: 15% Strategiske midlerResultatbasert Vitenskapelig publisering Doktorgrader Ekstern finansiering : Vitenskapelige stillinger. Fra 2006: Publiseringspoeng 1,8 prosent av sektorens samlede budsjett omfordeles ut fra siste års publiseringspoeng Studiepoeng siden 2002

Direkte finansiering av forskning: Evalueringsbaserte og indikatorbaserte modeller

Evalueringsbaserte (blå) og indikatorbaserte (røde) modeller

Oversikt 1.Resultatbasert finansiering 2.Evalueringsbaserte modeller 3.Indikatorbaserte modeller 4.Utviklingstendenser 5.Konsekvenser for CRIS-systemer

Allerede innførte evalueringsbaserte modeller

Konklusjon etter åpen høring om den evalueringsbaserte modellen i Storbritannia i 2006 Bibliometrics may inform, but not replace peer review

Et eksempel på samme diskusjon i Italia “Empirical evidence shows that for the natural and formal sciences, the bibliometric methodology is by far preferable to peer-review. Setting up national databases of publications by individual authors, derived from Web of Science or Scopus databases, would allow much better, cheaper and more frequent national research assessments.”  Giovanni Abramo & Ciriaco Andrea D’Angelo: Evaluating research: from informed peer review to bibliometrics, Scientometrics (2011) 87:499–514.

Et eksempel på samme diskusjon i Italia “Empirical evidence shows that for the natural and formal sciences, the bibliometric methodology is by far preferable to peer-review. Setting up national databases of publications by individual authors, derived from Web of Science or Scopus databases, would allow much better, cheaper and more frequent national research assessments.”  Giovanni Abramo & Ciriaco Andrea D’Angelo: Evaluating research: from informed peer review to bibliometrics, Scientometrics (2011) 87:499–514. “Bibliometrics are not independent of peer review assessment. The correlation between peer assessment and bibliometric indicators is significant but not perfect. Peer review should be integrated with bibliometric indicators in national assessment exercises.”  Massimo Franceschet and Antonio Costantini. The first Italian research assessment exercise: a bibliometric perspective. Journal of Informetrics (2011) 5(2):

Australia hadde opprinnelig et indikatorbasert system

Sverige og Tsjekkia utformer i år evalueringsbaserte modeller som kan bli implementert 2018

Panel structure under development in Sweden A Mathematics B Physics C Chemistry D Geosciences and environmental sciences incl. climate research E Biology F Chemical engineering, material engineering, nanotechnology and mechanical engineering G Civil and environmental engineering H Computer science, signals and systems and electrical and electronic engineering I Biotechnology and medical technology J Basic medical sciences I K Basic medical sciences II L Clinical medicine I M Clinical medicine II N Health sciences O Agricultural sciences P Psychology Q Economics (including social and economic geography, business and industrial economy) R Educational science S Sociology, anthropology, technology, cultural studies and gender studies T Political science and law U History and archaeology V Language, literature and aesthetics W Philosophy, ethics and religious studies X Artistic research Natural Sciences (N) Technical and Engineering Sciences (T) Medical and health sciences (M) Social Sciences (S) Humanities (H)

Peer review of societal impact (Evaluation of the Royal Institute of Technology, Stockholm, in 2012)

Impact template as Word file

A top-down submissions system at the cost of the institutions

The research leading to the contraceptive pill

Also external impact Internal impact

Measuring impact in social media and public spaces

Social impact is not the same as societal impact

Oversikt 1.Resultatbasert finansiering 2.Evalueringsbaserte modeller 3.Indikatorbaserte modeller 4.Utviklingstendenser 5.Konsekvenser for CRIS-systemer

Web of Science baserte modeller

Peer review and bibliometric methods We are not covered!!!

Indexed journals Journals and series Books

References imported from ISI References to book and article in book added

Indikatorbaserte modeller 2009

Local use of «Norwegian publication points» at nine Swedish Universities

“Norsk modell” for indikatorbaserte modeller

Oversikt 1.Resultatbasert finansiering 2.Evalueringsbaserte modeller 3.Indikatorbaserte modeller 4.Utviklingstendenser 5.Konsekvenser for CRIS-systemer

Utviklingstendenser

Ingen nasjonale modeller er helt like. Avhenger av nasjonal forskningspolitikk. Både evalueringsbaserte og indikatorbaserte løsninger har funnet sin plass og videreutvikles. Kombinasjonen av dem er realiteten der man har evalueringsbaserte løsninger. Landene lærer av hverandre og utbygger modellene med elementer fra andre land. Løsninger som utelukkende er basert på Web of Science eller Scopus avløses av CRIS (institusjonsbaserte) datakilder Vanskelig å identifisere “best practice” eller hovedsakelig negative eller positive effekter

Oversikt 1.Resultatbasert finansiering 2.Evalueringsbaserte modeller 3.Indikatorbaserte modeller 4.Utviklingstendenser 5.Konsekvenser for CRIS-systemer

A top-down submissions system at the cost of the institutions

Both Elsevier and Thomson Reuters are now integrating the citation databases with research management tools and CRIS-systems

Integrering og kommersialisering Markedet for bibliografiske søketjenester integreres med markedet for bibliometri og forskningsadministrative analysebehov WoS/Scopus integreres med InCites/SciVal og med Converis/Pure Faglig potensiale:  Nye faglige møtesteder mellom bibliometri, CRIS, forskningsadministrasjon og forskningsbibliotek Kommersielt potensiale:  To leverandører til samme marked (research management)  To standardløsninger  Ingen faglig diskusjon