How has healthcare research performance been assessed? A systematic review

[Eugene Garfield]

How has healthcare research performance been assessed? A systematic review

Author(s): Patel, VM (Patel, Vanash M.); Ashrafian, H (Ashrafian, Hutan); 
Ahmed, K (Ahmed, Kamran); Arora, S (Arora, Sonal); Jiwan, S (Jiwan, Sejal); 
Nicholson, JK (Nicholson, Jeremy K.); Darzi, A (Darzi, Ara); Athanasiou, T 
(Athanasiou, Thanos)
Source: JOURNAL OF THE ROYAL SOCIETY OF MEDICINE  Volume: 104  Issue: 6  
Pages: 251-261  DOI: 10.1258/jrsm.2011.110005  Published: JUN 2011  

Abstract: Objectives Healthcare research performance is increasingly assessed 
through research indicators. We performed a systematic review to identify the 
indicators that have been used to measure healthcare research performance. 
We evaluated their feasibility, validity, reliability and acceptability; and finally 
assessed the utility of these indicators in terms of measuring performance in 
individuals, specialties, institutions and countries. 
Design A systematic review was performed by searching EMBASE, PsycINFO, 
Ovid MEDLINE and Cochrane Library databases between 1950 and September 
2010. 
Setting Studies of healthcare research were appraised. Healthcare was defined 
as the prevention, treatment and management of illness and the preservation 
of mental and physical wellbeing through the services offered by the medical 
and allied health professions. 
Participants All original studies that evaluated research performance indicators 
in healthcare were included. 
Main outcome measures Healthcare research indicators, data sources, study 
characteristics, results and limitations for each study were studied. 
Results The most common research performance indicators identified in 50 
studies were: number of publications (n = 38), number of citations (n = 27), 
Impact Factor (n = 15), research funding (n = 10), degree of co-authorship (n 
= 9), and h index (n = 5). There was limited investigation of feasibility, validity, 
reliability and acceptability, although the utility of these indicators was 
adequately described. 
Conclusion Currently, there is only limited evidence to assess the value of 
healthcare research performance indicators. Further studies are required to 
define the application of these indicators through a balanced approach for 
quality and innovation. The ultimate aim of utilizing healthcare research 
indicators is to create a culture of measuring research performance to support 
the translation of research into greater societal and economic impact.

Language: English
Document Type: Article
KeyWords Plus: CANADIAN PSYCHOLOGY DEPARTMENTS; ASSESSING RESEARCH 
PRODUCTIVITY; JOURNAL IMPACT FACTORS; ACADEMY-OF-SCIENCES; 
BIBLIOMETRIC ANALYSIS; SCIENTIFIC-RESEARCH; BALANCED-SCORECARD; 
CITATION ANALYSIS; SCHOLARLY IMPACT; MEDICAL-RESEARCH

Addresses: [Patel, VM; Ashrafian, H; Ahmed, K; Arora, S; Jiwan, S; Nicholson, 
JK; Darzi, A; Athanasiou, T] Univ London Imperial Coll Sci Technol & Med, St 
Marys Hosp, Dept Surg & Canc, London, England
Reprint Address: Athanasiou, T (reprint author), Univ London Imperial Coll Sci 
Technol & Med, St Marys Hosp, Dept Surg & Canc, London, England

E-mail Address: t.athanasiou at imperial.ac.uk
ISSN: 0141-0768
URL: http://jrsm.rsmjournals.com/cgi/content/abstract/104/6/251