SV: Caveats for the journal and field normalizations in the CWTS ("Leiden") evaluations of research performance

Ulf Sandström usandstrom at TELE2.SE
Fri Apr 9 03:13:06 EDT 2010

To the discussion about field normalization I would like to draw attention
to the  article by Mcallister, Narin and Corrigan published in 1983 (avaible
here: in IEEE
Transactions on Engineering Management, vol EM-40, NO 4, November.
It was published just before the groups in Leiden and Leuven came with their
first articles on normalized citation analysis, but had quite a different,
and methodologically sound approach. In 2006, I visited Barry Bozeman in the
US and gave a presentation on field normalized citation analysis.
Immediately, he responded in a way that pointed to z-score as the best
alternative for handling these types of problems. Could it be the case that
in the 1980s there was a gap between the US and Europe, maybe there still
is, regarding statistical methods and methdological competence? 
Since 2005, my group have performed citation analysis with normalization at
article level, and in 2007 we included the Standard Citation Score using the
method proposed by Mcallister et al. Most or our work is in Swedish, but to
give a couple of examples (in English) of this type of work: see the report
on the Research Assessement in 2008 for Royal Institute of Technology,
Stockholm, avaiable here: or via
Another evaluation using the same methods was performed last year for the
Swedish Environmental Protection Agency "Bibliometric evaluation of research
Especially, have a look at the Technical Appendices to these reports.
Ulf Sandstrom

Ulf Sandström, docent 

Linköpings universitet                 


581 83 Linköping                        

(           +46 708 137376
*           ulf.sandstrom at 
"**** <>   



Från: Loet Leydesdorff [mailto:loet at LEYDESDORFF.NET] 
Skickat: den 23 mars 2010 07:41
Ämne: Re: Caveats for the journal and field normalizations in the CWTS
("Leiden") evaluations of research performance

Normalization, CWTS indicators, and the Leiden Rankings: 
Differences in citation behavior at the level of fields

Authors: Loet
Leydesdorff, Tobias
<> Opthof
(Submitted on 21 Mar 2010)

Abstract: Van Raan et al. (2010; arXiv:1003.2113
<> ) have proposed a new indicator (MNCS) for
field normalization. Since field normalization is also used in the Leiden
Rankings of universities, we elaborate our critique of journal normalization
in Opthof & Leydesdorff (2010; arXiv:1002.2769
<> ) in this rejoinder concerning field
normalization. Fractional citation counting thoroughly solves the issue of
normalization for differences in citation behavior among fields. This
indicator can also be used to obtain a normalized impact factor. 

Subjects: 	Physics and Society (physics.soc-ph)	
Cite as: 	arXiv:1003.3977v1 <>

Loet Leydesdorff 
Amsterdam School of Communications Research (ASCoR)
Kloveniersburgwal 48, 1012 CX Amsterdam
 <mailto:loet at> loet at ;

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <>

More information about the SIGMETRICS mailing list