Herther NK "Research evaluation and citation analysis: key issues and implications " Electronic Library 27(3):361-375, 2009

[Eugene Garfield]

E-Mail Address: n-hert at umn.edu  

TITLE : Research evaluation and citation analysis: key issues and 
implications 

AUTHOR (s): Herther NK (Herther, Nancy K.)  

SOURCE: ELECTRONIC LIBRARY    Volume: 27    Issue: 3    Pages: 361-375    
Published: 2009    

ABSTRACT: Purpose - Citation and ranking information are becoming key 
aspects of knowledge management in academic and research institutions. By 
examining changing user needs and products, this paper aims to encourage 
information professionals to better understand and manage these resources 
and better respond to user needs.   

Design/methodology/approach - Literature reviews, work with faculty clients 
and initial product testing are used to present coherent information on the 
current climate and practice of competitive analysis of researchers and 
their institutions.    

Findings - As more sources for citation information have become available - 
even many scholarly databases today offering cited reference data - the 
need to identify, access and manage these resources is becoming acute. 
Information professionals need to become more proactive in their strategies 
to support these applications and users.    

Originality/value - This article builds on previous analyses of the roles 
and nature of citation analysis in research institutions and examines 
potential new roles and contributions that information professionals can 
take on to better serve their users.  

Reprint Address: Herther, NK (reprint author), Univ Minnesota Lib, 
Minneapolis, MN USA    

Addresses:  
1. Univ Minnesota Lib, Minneapolis, MN USA   
E-mail Addresses: n-hert at umn.edu   
Publisher: EMERALD GROUP PUBLISHING LIMITED, HOWARD HOUSE, WAGON LANE, 
BINGLEY BD16 1WA, W YORKSHIRE, ENGLAND  

IDS Number: 481EO  
ISSN: 0264-0473  
DOI: 10.1108/02640470910966835  


REFERENCES: 
1.  *ALL CONS GROUP
MEAS IMP PUBL FUND R : 2005  
2.  *COMM FUT HIGH ED
TEST LEAD CHART FUT : 2006  
3.  *MOD LANG ASS AM
MLA TASK FORC EV SCH : 2006  
4.  *THOMS SCI
ESS SCI IND : 2008  
5.  *THOMS SCI
J CIT REP : 2008  
6.  ABBASI K
BRIT MED J 329 : 867 2004  
7.  ADAM D
The counting house 
NATURE 415 : 726 2002  
8.  BATAILLE GM
FACULTY CAREER PATHS : 2006  
9.  BENSMAN SJ
Garfield and the impact factor 
ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY 41 : 93 2007  
10.  BOLLAG B
CHRON HIGHER EDUC 52 : A40 2006  
11.  BORGMAN CL
Scholarly communication and bibliometrics 
ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY 36 : 3 2002  
12.  CAMERON BD
Trends in the usage of ISI bibliometric data: Uses, abuses, and 
implications 
PORTAL-LIBRARIES AND THE ACADEMY 5 : 105 2005  
13.  CHEEK J
QUALITATIVE HLTH RES 16 : 23 2006  
14.  CHOO CW
5 1 MONDAY 2000  
15.  COLQUHOUN D
Challenging the tyranny of impact factors 
NATURE 423 : 479 DOI 10.1038/423479a 2003  
16.  COLR JR
SOCIAL STRATIFICATIO : 6 1973  
17.  CORBY K
PORTAL-LIBR ACAD 1 : 279 2001  
18.  CRONIN B
Invoked on the web 
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 49 : 1319 1998  
19.  DING Y
Scholarly communication and bibliometrics: Part II. The scholarly 
communication process - Literature review 
INTERNATIONAL FORUM ON INFORMATION AND DOCUMENTATION 23 : 3 1998  
20.  DRACOS A
ANN I SUPER SANITA 31 : 381 1995  
21.  DRAKE MA
INFORM TODAY 24 : 1 2007  
22.  DUQUE RB
Collaboration paradox: Scientific productivity, the Internet, and problems 
of research in developing areas 
SOCIAL STUDIES OF SCIENCE 35 : 755 DOI 10.1177/0306212705053048 2005  
23.  EGGHE L
New informetric aspects of the Internet: some reflections - many problems 
JOURNAL OF INFORMATION SCIENCE 26 : 329 2000  
24.  FARRELL EF
CHRON HIGHER EDUC 53 : A46 2006  
25.  FELLOWS LK
Method matters: An empirical study of impact in cognitive neuroscience 
JOURNAL OF COGNITIVE NEUROSCIENCE 17 : 850 2005  
26.  FIELD K
CHRON HIGHER EDUC 52 : A34 2006  
27.  FINE MA
REFLECTIONS ON DETERMINING AUTHORSHIP CREDIT AND AUTHORSHIP ORDER ON 
FACULTY STUDENT COLLABORATIONS 
AMERICAN PSYCHOLOGIST 48 : 1141 1993  
28.  FOGG P
CHRON HIGHER EDUC 52 : A22 2006  
29.  FOGG P
CHRON HIGHER EDUC 52 : A31 2005  
30.  GARFIELD E
How can impact factors be improved? 
BRITISH MEDICAL JOURNAL 313 : 411 1996  
31.  GARFIELD E
CITATION INDEXES FOR SCIENCE - NEW DIMENSION IN DOCUMENTATION THROUGH 
ASSOCIATION OF IDEAS 
SCIENCE 122 : 108 1955  
32.  GARFIELD E
Random thoughts on citationology. Its theory and practice - Comments on 
theories of citation? 
SCIENTOMETRICS 43 : 69 1998  
33.  GARFIELD E
The Impact Factor and using it correctly 
UNFALLCHIRURG 101 : 413 1998  
34.  GARVEY WD
COMMUNICATION ESSENC : 1979  
35.  GELMAN SR
A quest for citations? An analysis of and commentary on the trend toward 
multiple authorship 
JOURNAL OF SOCIAL WORK EDUCATION 35 : 203 1999  
36.  GOLDIN RF
CHRON HIGHER EDUC 53 : B24 2006  
37.  GRAVOIS J
CHRON HIGH ED 53 : A8 2006  
38.  GRIFFITH BC
AGING OF SCIENTIFIC LITERATURE - CITATION ANALYSIS 
JOURNAL OF DOCUMENTATION 35 : 179 1979  
39.  GRIFFITH BC
STRUCTURE OF SCIENTIFIC LITERATURES .2. TOWARD A MACROSTRUCTURE AND 
MICROSTRUCTURE FOR SCIENCE 
SCIENCE STUDIES 4 : 339 1974  
40.  GRIFFITH BC
COHERENT SOCIAL GROUPS IN SCIENTIFIC CHANGE 
SCIENCE 177 : 959 1972  
41.  GRIFFTH BC
KEY PAPERS INFORM SC : 19 1980  
42.  HAGGBLOOM SJ
The 100 most eminent psychologists of the 20th century 
REVIEW OF GENERAL PSYCHOLOGY 6 : 139 2002  
43.  HARGENS LL
CITATION COUNTS AND SOCIAL COMPARISONS - SCIENTISTS USE AND EVALUATION OF 
CITATION INDEX DATA 
SOCIAL SCIENCE RESEARCH 19 : 205 1990  
44.  HARTER SP
Accessing electronic journals and other e-publications: An empirical study 
COLLEGE & RESEARCH LIBRARIES 57 : 440 1996  
45.  HARTER SP
IMPACT ELECT J SCHOL : 1996  
46.  HIRSCH JE
ARXIVPHYSICS0508025V : 2005  
47.  HOLDEN G
An assessment of the predictive validity of impact factor scores: 
Implications for academic employment decisions in social work 
RESEARCH ON SOCIAL WORK PRACTICE 16 : 613 DOI 10.1177/1049731506292570 2006 

48.  HORAN JJ
FELLOWSHIP BEHAVIOR IN DIVISION 17 AND THE MOMM CARTEL 
COUNSELING PSYCHOLOGIST 19 : 253 1991  
49.  HUGHES CA
PORTAL LIB ACAD 6 : 2006  
50.  KEEN B
ANN M AM PSYCH ASS S : 1998  
51.  KOSTOFF RN
Citation analysis of research performer quality 
SCIENTOMETRICS 53 : 49 2002  
52.  KROC RJ
ED RES 13 : 17 1984  
53.  LABAND DN
A CITATION ANALYSIS OF THE IMPACT OF BLINDED PEER-REVIEW 
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 272 : 147 1994  
54.  LARSON RR
ASIS 1996 : 1996  
55.  LEE S
The impact of research collaboration on scientific productivity 
SOCIAL STUDIES OF SCIENCE 35 : 673 DOI 10.1177/0306312705052359 2005  
56.  LICHTMAN MA
The productivity and impact of the Leukemia & Lymphoma Society Scholar 
Program: The apparent positive effect of peer review 
BLOOD CELLS MOLECULES AND DISEASES 27 : 1020 2001  
57.  LU Z, THESIS U MASSACHUSET : 1999 
58.  MARTIN B, AUSTR LIB J 55 : 12 2006  
59.  MCCAIN KW, Sharing digitized research-related information on the World 
Wide Web, JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 51 : 1321 
2000  
60.  MCCREADY K, JSTOR PART PUBL M MA : 2006  
61.  MEADOWS AJ, COMMUNICATION SCI : R9 1974  
62.  MELA GS, Radiological research in Europe: a bibliometric study 
EUROPEAN RADIOLOGY 13 : 657 DOI 10.1007/s00330-002-1640-7 2003  
63.  MERTON RK, CITATION INDEXING IT : R6 1979  
64.  MERTON RK, The Thomas theorem and the Matthew effect 
SOCIAL FORCES 74 : 379 1995   
65.  MERTON RK, SOCIOL SCI : R7 1973  
66.  METCALFE AS, KNOWLEDGE MANAGEMENT : 2006   
67.  MOED HF, CITATION ANAL RES EV : 2005   
68.  MONTORI VM, BMC MED 1 : 2 2003  
69.  NAJMAN JM, The validity of publication and citation counts for 
Sociology and other selected disciplines, JOURNAL OF SOCIOLOGY 39 : 62 2003
70.  OBER J, GRAIN 16 : 2004  
71.  PERRY B, SOCIAL EPISTEMOLOGY 20 : 201 2006   
72.  PFIRMAN SL, CHRON HIGHER EDUC 51 : B15 2005  
73.  ROUSSEAU R, CYBERMETRICS 1 : 1 1997'  
74.  SCHUSTER JH, AM FACULTY RESTRUCTU : 2006  
75.  SEGLEN PO, BRIT MED J 314 : 497 1997    
76.  SHAW V, ADV LIFE COURSE RES 9 : 331 2005    
77.  SHORE C, PARALLAX 10 : 110 2004    
78.  SMALL H, COCITATION IN SCIENTIFIC LITERATURE - NEW MEASURE OF 
RELATIONSHIP BETWEEN 2 DOCUMENTS, JOURNAL OF THE AMERICAN SOCIETY FOR 
INFORMATION SCIENCE 24 : 265 1973    
79.  SMALL H, STRUCTURE OF SCIENTIFIC LITERATURES .1. IDENTIFYING AND 
GRAPHING SPECIALTIES, SCIENCE STUDIES 4 : 17 1974    
80.  SMALLWOOD S, CHRON HIGHER EDUC 51 : A8 2005    
81.  SONNENWALD DH, Scientific collaboration, ANNUAL REVIEW OF INFORMATION 
SCIENCE AND TECHNOLOGY 41 : 643 2007  
82.  SWAN A, Open access and the progress of science, AMERICAN SCIENTIST 
95 : 197 2007  
83.  TAUBES G, MEASURE FOR MEASURE IN SCIENCE, SCIENCE 260 : 884 1993  
84.  WALLIN JA, Bibliometric methods: Pitfalls and possibilities 
BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY 97 : 261 2005  
85.  WALSH JP, PROBLEMS SCI C UNPUB : 2003    
86.  WEST R, What do citation counts count for in the field of addiction? 
An empirical evaluation of citation counts and their link with peer ratings 
of quality , ADDICTION 97 : 501 2002    
87.  WHITE HD, Visualization of literatures , ANNUAL REVIEW OF INFORMATION 
SCIENCE AND TECHNOLOGY 32 : 99 1997  
88.  WHITE HD, AUTHOR COCITATION - A LITERATURE MEASURE OF INTELLECTUAL 
STRUCTURE, JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 32 : 163 
1981   
89.  WILSON CS, ANN REV INFORMATION 34 : 3 2001   
90.  WILSON P, The future of research in our field, INFORMATION SCIENCE : 
319 1996   
91.  YOUNGEN GK, Citation patterns to traditional and electronic preprints 
in the published literature , COLLEGE & RESEARCH LIBRARIES 59 : 448 1998 
92.  ZHAO DZ, Citation analysis using scientific publications on the Web as 
data source: A case study in the XML research area 
SCIENTOMETRICS 54 : 449 2002