Rosas, SR; et al.. 2011. Evaluating Research and Impact: A Bibliometric Analysis of Research by the NIH/NIAID HIV/AIDS Clinical Trials Networks. PLOS ONE 6 (3): art. no.-e17428

[Eugene Garfield]

Rosas, SR; Kagan, JM; Schouten, JT; Slack, PA; Trochim, WMK. 2011. 
Evaluating Research and Impact: A Bibliometric Analysis of Research by the 
NIH/NIAID HIV/AIDS Clinical Trials Networks. PLOS ONE 6 (3): art. no.-e17428..

Author Full Name(s): Rosas, Scott R.; Kagan, Jonathan M.; Schouten, Jeffrey 
T.; Slack, Perry A.; Trochim, William M. K.
Language: English
Document Type: Article

KeyWords Plus: AIDS LITERATURE; LATIN-AMERICA; CITATION; METRICS; 
AFRICA; OUTPUT

Abstract: Evaluative bibliometrics uses advanced techniques to assess the 
impact of scholarly work in the context of other scientific work and usually 
compares the relative scientific contributions of research groups or institutions. 
Using publications from the National Institute of Allergy and Infectious Diseases 
(NIAID) HIV/AIDS extramural clinical trials networks, we assessed the presence, 
performance, and impact of papers published in 2006-2008. Through this 
approach, we sought to expand traditional bibliometric analyses beyond citation 
counts to include normative comparisons across journals and fields, 
visualization of co-authorship across the networks, and assess the inclusion of 
publications in reviews and syntheses. Specifically, we examined the research 
output of the networks in terms of the a) presence of papers in the scientific 
journal hierarchy ranked on the basis of journal influence measures, b) 
performance of publications on traditional bibliometric measures, and c) impact 
of publications in comparisons with similar publications worldwide, adjusted for 
journals and fields. We also examined collaboration and interdisciplinarity across 
the initiative, through network analysis and modeling of co-authorship patterns. 
Finally, we explored the uptake of network produced publications in research 
reviews and syntheses. Overall, the results suggest the networks are producing 
highly recognized work, engaging in extensive interdisciplinary collaborations, 
and having an impact across several areas of HIV-related science. The 
strengths and limitations of the approach for evaluation and monitoring 
research initiatives are discussed.

Addresses: [Rosas, Scott R.; Slack, Perry A.] Concept Syst Inc, Ithaca, NY 
USA; [Kagan, Jonathan M.] NIAID, Div Clin Res, NIH, Bethesda, MD 20892 USA; 
[Schouten, Jeffrey T.] Fred Hutchinson Canc Res Ctr, HIV AIDS Network 
Coordinat Project, Seattle, WA 98104 USA; [Trochim, William M. K.] Cornell 
Univ, Dept Policy Anal & Management, Ithaca, NY USA

Reprint Address: Rosas, SR, Concept Syst Inc, Ithaca, NY USA.
E-mail Address: srosas at conceptsystems.com
ISSN: 1932-6203
DOI: 10.1371/journal.pone.0017428
PDF: 
http://www.socialresearchmethods.net/research/Rosas%20et%20al%202011%
20Evaluating%20research%20and%20impact.pdf