Lewison, G; Thornicroft, G; Szmukler, G (Szmukl; Tansella, M (Tansella, Michele) Fair assessment of the merits of psychiatric research BRITISH JOURNAL OF PSYCHIATRY, 190: 314-318 APR 2007

[Eugene Garfield]

E-mail Address: g.thoricroft at iop.kcl.ac.uk 

Author(s): Lewison, G (Lewison, Grant); Thornicroft, G (Thornicroft, 
Graham); Szmukler, G (Szmukler, George); Tansella, M (Tansella, Michele) 

Title: Fair assessment of the merits of psychiatric research 

Source: BRITISH JOURNAL OF PSYCHIATRY, 190: 314-318 APR 2007 

Language: English 

Document Type: Article 

Keywords Plus: OPTIMAL SEARCH STRATEGIES; HEALTH-SERVICES RESEARCH; 
IMPACT; INDICATORS; JOURNALS; MEDLINE 

Abstract: Background Use of bibliometric assessments of research quality 
is growing worldwide. So far, a narrow range of metrics have been applied 
across the whole of biomedical research. Without specific sets of metrics, 
appropriate to each sub-field of research, biased assessments of research 
excellence are possible.
Aims To discuss the measures used to evaluate the merits of psychiatric 
biomedical research, and to propose a new approach using a 
multidimensional selection of metrics appropriate to each particular field 
of medical research.
Method Three steps: (a) a definition of scientific 'domains', (b) 
translating these into 'filters' to identify publications from 
bibliometric databases, leading to (c) the creation of standardised 
measures of merit.
Results We propose using: (a) established metrics such as impact factors 
and citation indices, (b) new derived measures such as the 'worldscale' 
score, and (c) new indicators based on journal peer esteem, impact on 
clinical practice, medical education and health policy.
Conclusions No single index or metric can be used as a fair rating to 
compare nations, universities, research groups, or individual 
investigators across biomedical science. Rather, we propose using a 
multidimensional profile composed of a carefully selected array of such 
metrics. 

Addresses: Kings Coll London, Hlth Serv & Populat Res Dept, Inst Psychiat, 
London SE5 8AF, England; Univ Coll London, Sch Lib Arch & Informat 
Studies, London WC1E 6BT, England; Evaluametr Ltd, Richmond, Surrey, 
England; Univ Verona, Dept Med & Publ Hlth, Sec Psychiat & Clin Psychol, I-
37100 Verona, Italy 

Reprint Address: Thornicroft, G, Kings Coll London, Hlth Serv & Populat 
Res Dept, Inst Psychiat, De Crespigny Pk, London SE5 8AF, England. 

E-mail Address: g.thoricroft at iop.kcl.ac.uk 

Cited Reference Count: 26 

Times Cited: 1 

Publisher: ROYAL COLLEGE OF PSYCHIATRISTS 

Publisher Address: BRITISH JOURNAL OF PSYCHIATRY 17 BELGRAVE SQUARE, 
LONDON SW1X 8PG, ENGLAND 

ISSN: 0007-1250 

29-char Source Abbrev.: BRIT J PSYCHIAT 

ISO Source Abbrev.: Br. J. Psychiatry 

Source Item Page Count: 5 

Subject Category: Psychiatry 

ISI Document Delivery No.: 156AI 

*AC HLTH
GLOSS TERMS COMM US : 2004 

*I MED
CROSS QUAL CHASM NEW : 2001 

*MED RES COUNC
CLUST RAND TRIALS : 2002 

AGORITSAS T
Patient reports of undesirable events during hospitalization 
JOURNAL OF GENERAL INTERNAL MEDICINE 20 : 922 DOI 10.1111/j.1525-
1497.2005.0225.x 2005 

DASH P
Increasing the impact of health services research 
BRITISH MEDICAL JOURNAL 327 : 1339 2003 

DAWSON S
Inhabiting different worlds: How can research relate to practice? 
QUALITY IN HEALTH CARE 6 : 177 1997 

DEFRANCISCO A
10 90 REPORT HLTH RE 2004 

GOLDBERG D
How should financial support for research be distributed to Universities? 
The Research Assessment Exercise (RAE) in England and Wales 
EPIDEMIOLOGIA E PSICHIATRIA SOCIALE 15 : 104 2006 

GRANT J
Evaluating "payback" on biomedical research from papers cited in clinical 
guidelines: applied bibliometric study 
BRITISH MEDICAL JOURNAL 320 : 1107 2000 

HAYNES RB
Optimal search strategies for retrieving scientifically strong studies of 
treatment from Medline: analytical survey 
BRITISH MEDICAL JOURNAL 330 : 1179 2005 

HORIG H
J TRANSL MED 2 : 44 2004 

JONES T
What British psychiatrists read - Questionnaire survey of journal usage 
among clinicians 
BRITISH JOURNAL OF PSYCHIATRY 185 : 251 2004 

KENDLER KS
Psychiatric genetics: A methodologic critique 
AMERICAN JOURNAL OF PSYCHIATRY 162 : 3 2005 

LEE KP
Association of journal quality indicators with methodological quality of 
clinical research articles 
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 287 : 2805 2002 

LEWISON G
International gastroenterology research: subject areas, impact, and 
funding 
GUT 49 : 295 2001 

LEWISON G
HDB QUANTITATIVE SCI : 457 2004 

LEWISON G
P 10 ISSI INT SOC SC : 585 2005 

LEWISON G
RES EVALUAT 8 : 47 1999 

LEWISON G
RES EVALUAT 6 : 25 1996 

LEWISON G
Researchers' and users' perceptions of the relative standing of biomedical 
papers in different journals 
SCIENTOMETRICS 53 : 229 2002 

MARTIN BR
The use of multiple indicators in the assessment of basic research 
SCIENTOMETRICS 36 : 343 1996 

PERNEGER TV
Relation between online "hit counts" and subsequent citations: prospective 
study of research papers in the BMJ 
BRITISH MEDICAL JOURNAL 329 : 546 2004 

RIPPON I
Research outputs in respiratory medicine 
THORAX 60 : 63 DOI 10.1136/thx.2004.031229 2005 

SEGLEN PO
Why the impact factor of journals should not be used for evaluating 
research 
BRITISH MEDICAL JOURNAL 314 : 498 1997 

TSAFRIR JS
USING THE CITATION INDEX TO ASSESS PERFORMANCE 
BRITISH MEDICAL JOURNAL 301 : 1333 1990 

WILCZYNSKI NL
Optimal search strategies for detecting health services research studies 
in MEDLINE 
CANADIAN MEDICAL ASSOCIATION JOURNAL 171 : 1179 2004