Koskinen, J; et al How to use bibliometric methods in evaluation of scientific research? An example from Finnish schizophrenia research NORDIC JOURNAL OF PSYCHIATRY, 62 (2): 136-143 2008

[Eugene Garfield]

E-mail Address: johanna.koskinen at oulu.fi 

Author(s): Koskinen, J (Koskinen, Johanna); Isohanni, M (Isohanni, Matti); 
Paajala, H (Paajala, Henna); Jaaskelainen, E (Jaaskelainen, Erika); 
Nieminen, P (Nieminen, Pentti); Koponen, H (Koponen, Hannu); Tienari, P 
(Tienari, Pekka); Miettunen, J (Miettunen, Jouko) 

Title: How to use bibliometric methods in evaluation of scientific 
research? An example from Finnish schizophrenia research 

Source: NORDIC JOURNAL OF PSYCHIATRY, 62 (2): 136-143 2008 

Language: English 

Document Type: Article 

Author Keywords: bibliometrics; Finland; information science; 
schizophrenia 

Keywords Plus: BIPOLAR DISORDER; PUBLICATIONS; IMPACT; VISIBILITY; 
PSYCHIATRY 

Abstract: We present bibliometric methods that can be utilized in 
evaluation processes of scientific work. In this paper, we present some 
practical clues using Finnish schizophrenia research as an example and 
comparing the research output of different institutions. Bibliometric data 
and indicators including publication counts, impact factors and received 
citations were used as tools for evaluating research performance in 
Finnish schizophrenia research. The articles and citations were searched 
from the Web of Science database. We used schizophrenia as a keyword and 
defined address Finland, and limited years to 1996-2005. When we analysed 
Finnish schizophrenia research, altogether 265 articles met our criteria. 
There were differences in impact factors and received citations between 
institutions. The number of annually published Finnish schizophrenia 
articles has tripled since the mid-1990s. International co-operation was 
common (43%). Bibliometric methods revealed differences between 
institutions, indicating that the methods can be applied in research 
evaluation. The coverage of databases as well as the precision of their 
search engines can be seen as limitations. Bibliometric methods offer a 
practical and impartial way to estimate publication profiles of 
researchers and research groups. According to our experience, these 
methods can be used as an evaluation instrument in research together with 
other methods, such as expert opinions and panels. 

Addresses: Univ Oulu, Dept Psychiat, FIN-90014 Oulu, Finland; Oulu Univ 
Hosp, Oulu, Finland; Univ Oulu, Med Informat Grp, FIN-90014 Oulu, Finland; 
Univ Kuopio, Dept Psychiat, FIN-70211 Kuopio, Finland 

Reprint Address: Koskinen, J, Univ Oulu, Dept Psychiat, POB 5000, FIN-
90014 Oulu, Finland. 

E-mail Address: johanna.koskinen at oulu.fi 

Cited Reference Count: 21 

Times Cited: 0 

Publisher: TAYLOR & FRANCIS AS 

Publisher Address: PO BOX 12 POSTHUSET, NO-0051 OSLO, NORWAY 

ISSN: 0803-9488 

DOI: 10.1080/08039480801961667 

29-char Source Abbrev.: NORD J PSYCHIATR 

ISO Source Abbrev.: Nord. J. Psychiatr. 

Source Item Page Count: 8 

Subject Category: Psychiatry 

ISI Document Delivery No.: 318CX 

ADAM D
The counting house 
NATURE 415 : 726 2002 

AMIN M
PERSPECTIVES PUBLISH 1 : 2 2000 

DEBACKERE K
Using a bibliometric approach to support research policy making: The case 
of the Flemish BOF-key 
SCIENTOMETRICS 59 : 253 2004 

FIGUEIRA I
A comparison between domestic and international publications in Brazilian 
psychiatry 
SCIENTOMETRICS 56 : 317 2003 

GARFIELD E
WHICH MEDICAL JOURNALS HAVE THE GREATEST IMPACT 
ANNALS OF INTERNAL MEDICINE 105 : 313 1986 

HOVATTA I
Linkage analysis of putative schizophrenia gene candidate regions on 
chromosomes 3p, 5q, 6p, 8p, 20p and 22q in a population-based sampled 
Finnish family set 
MOLECULAR PSYCHIATRY 3 : 452 1998 

HUBERT JJ
GENERAL BIBLIOMETRIC-MODELS 
LIBRARY TRENDS 30 : 65 1981 

INGWERSEN P
Visibility and impact of research in Psychiatry for North European 
countries in EU, US and world contexts 
SCIENTOMETRICS 54 : 131 2002 

JONES PB
Schizophrenia as a long-term outcome of pregnancy, delivery, and perinatal 
complications: A 28-year follow-up of the 1966 North Finland general 
population birth cohort 
AMERICAN JOURNAL OF PSYCHIATRY 155 : 355 1998 

KALTENBORN KF
The journal impact factor as a parameter for the evaluation of researchers 
and research 
MEDIZINISCHE KLINIK 98 : 153 DOI 10.1007/s00063-003-1240-6 2003
 
KEKOMAKI M
EVALUATION USES PROP : 3 2001 

KOSKINEN J
PSYCHIAT FENNICA : 9 2004 

LETA J
Central international visibility of Brazilian psychiatric publications 
from 1981 to 1999 
SCIENTOMETRICS 50 : 241 2001 

LEWIS CM
Genome scan meta-analysis of schizophrenia and bipolar disorder, part II: 
Schizophrenia 
AMERICAN JOURNAL OF HUMAN GENETICS 73 : 34 2003 

LEWISON G
Bibliometric methods for the evaluation of arthritis research 
RHEUMATOLOGY 38 : 13 1999 

LOPEZMUNOZ F
Bibliometric analysis of biomedical publications on SSRIs during 1980-2000 
DEPRESSION AND ANXIETY 18 : 95 DOI 10.1002/da.10121 2003 

LOPEZMUNOZ F
Bipolar disorder as an emerging pathology in the scientific literature: A 
bibliometric approach 
JOURNAL OF AFFECTIVE DISORDERS 92 : 161 DOI 10.1016/j.jad.2006.02.006 2006 

LOPEZMUNOZ F
PSIQUIATR 11 : 68 1995 

MIETTUNEN J
SCIENTOMETRICS 57 : 379 2004 

NIEMINEN P
SOCIAALILAAK AIKAK 35 : 152 1998 

SUVISAARI JM
Decline in the incidence of schizophrenia in Finnish cohorts born from 
1954 to 1965 
ARCHIVES OF GENERAL PSYCHIATRY 56 : 733 1999