excellent papers

[Bornmann, Lutz]

Dear Wouter,

Thank you for these hints. However, the first paper is included in the study. The second one is not included, because it does not fulfill the criteria for inclusion: “In order to obtain those papers (articles, reviews and letters) which have bibliometrically investigated excellent papers, a topic search for "highly cited", "most cited", "top cited" and "most frequently cited" was undertaken in the SCI Expanded and in the SSCI”.

Best,

Lutz

From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Gerritsma, Wouter
Sent: Monday, January 27, 2014 9:49 AM
To: SIGMETRICS at LISTSERV.UTK.EDU
Subject: Re: [SIGMETRICS] excellent papers

Dear Lutz,

I do miss in your review reference to

Tijssen, R. J. W., M. S. Visser, and T. N. van Leeuwen. 2002. Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? Scientometrics, 54(3): 381-397. http://dx.doi.org/10.1023/A:1016082432660
Tijssen, R. J. W. 2003. Scoreboards of research excellence. Research Evaluation, 12(2): 91-104. http://dx.doi.org/10.3152/147154403781776690

In my impression one of the first to use the top decile to characterize research excellence.

Yours sincerely
Wouter



Wouter Gerritsma
Team leader research support
Information Specialist – Bibliometrician
Wageningen UR Library
PO box 9100
6700 HA Wageningen
The Netherlands
++31 3174 83052
Wouter.gerritsma at wur.nl<mailto:Wouter.gerritsma at wur.nl%0d>
wageningenur.nl/library<http://wageningenur.nl/library>
@wowter<http://twitter.com/Wowter/>
wowter.net<http://wowter.net/>

#AWCP http://tinyurl.com/mk65m36



From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Bornmann, Lutz
Sent: maandag 27 januari 2014 9:36
To: SIGMETRICS at LISTSERV.UTK.EDU<mailto:SIGMETRICS at LISTSERV.UTK.EDU>
Subject: [SIGMETRICS] excellent papers

How are excellent (highly cited) papers defined in bibliometrics? A quantitative analysis of the literature
Lutz Bornmann<http://arxiv.org/find/cs/1/au:+Bornmann_L/0/1/0/all/0/1>
(Submitted on 22 Jan 2014)
As the subject of research excellence has received increasing attention (in science policy) over the last few decades, increasing numbers of bibliometric studies have been published dealing with excellent papers. However, many different methods have been used in these studies to identify excellent papers. The present quantitative analysis of the literature has been carried out in order to acquire an overview of these methods and an indication of an "average" or "most frequent" bibliometric practice. The search in the Web of Science yielded 321 papers dealing with "highly cited", "most cited", "top cited" and "most frequently cited". Of the 321 papers, 16 could not be used in this study. In around 80% of the papers analyzed in this study, a quantitative definition has been provided with which to identify excellent papers. With definitions which relate to an absolute number, either a certain number of top cited papers (58%) or papers with a minimum number of citations are selected (17%). Around 23% worked with percentile rank classes. Over these papers, there is an arithmetic average of the top 7.6% (arithmetic average) or of the top 3% (median). The top 1% is used most frequently in the papers, followed by the top 10%. With the thresholds presented in this study, in future, it will be possible to identify excellent papers based on an "average" or "most frequent" practice among bibliometricians.

Available at: http://arxiv.org/abs/1401.5986

---------------------------------------

Dr. Dr. habil. Lutz Bornmann
Division for Science and Innovation Studies
Administrative Headquarters of the Max Planck Society
Hofgartenstr. 8
80539 Munich
Tel.: +49 89 2108 1265
Mobil: +49 170 9183667
Email: bornmann at gv.mpg.de<mailto:bornmann at gv.mpg.de>
WWW: www.lutz-bornmann.de<http://www.lutz-bornmann.de/>
ResearcherID: http://www.researcherid.com/rid/A-3926-2008
ResearchGate: http://www.researchgate.net/profile/Lutz_Bornmann

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.asis.org/pipermail/sigmetrics/attachments/20140127/dbbfe472/attachment.html>