ABS: Meho, Citation ranking versus peer evaluation of senior faculty research performance: A case study of Kurdish scholarship

[Gretchen Whitney]

Authors' emails are mehol at ils.unc.edu AND dhs at ils.unc.edu

AU Meho, LI
   Sonnenwald, DH
TI Citation ranking versus peer evaluation of senior faculty
   research performance: A case study of Kurdish scholarship
SO JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE
NR 73
C1 Univ N Carolina, Sch Lib & Informat Sci, CB 3360, 100 Manning
   Hall, Chapel Hill, NC 27599 USA.
   Univ N Carolina, Sch Lib & Informat Sci, Chapel Hill, NC 27599 USA.
ID INFORMATION-SCIENCE RESEARCH; BOOK SELECTION; BASIC RESEARCH;
   INDICATORS; PSYCHOLOGY; LIBRARY; ART
AB The purpose of this study is to analyze the relationship
   between citation ranking and peer evaluation in assessing
   senior faculty research performance. Other studies typically
   derive their peer evaluation data directly from referees, often
   in the form of ranking, This study uses two additional sources
   of peer evaluation data: citation content analysis and book
   review content analysis. Two main questions are investigated:
   (a) To what degree does citation ranking correlate with data
   from citation content analysis, book reviews, and peer ranking?
   (b) Is citation ranking a valid evaluative indicator of
   research performance of senior faculty members? Citation data,
   book reviews, and peer ranking were compiled and examined for
   faculty members specializing in Kurdish studies. Analysis shows
   that normalized citation ranking and citation content analysis
   data yield identical ranking results. Analysis also shows that
   normalized citation ranking and citation content analysis, book
   reviews, and peer ranking perform similarly (i.e., are highly
   correlated) for high-ranked and low-ranked senior scholars,
   Additional evaluation methods and measures that take into
   account the context and content of research appear to be needed
   to effectively evaluate senior scholars whose performance ranks
   relatively in the middle. Citation content analysis data did
   appear to give some specific and important insights into the
   quality of research of these middle performers, however,
   further analysis and research is needed to validate this
   finding. This study shows that citation ranking can provide a
   valid indicator for comparative evaluation of senior faculty
   research performance.
CR 1906, INDEX ISLAMICUS
   *AM BIBL CTR ABC C, 1955, HIST ABSTR
   *GAL RES CO, 1965, BOOK REV IND
   *HW WILS CO, 1905, BOOK REV DIG
   *I SCI INF, ARTS HUM CIT IND 198
   *I SCI INF, 1972, SOC SCI CIT IND 1972
   *IFI PLEN, 1975, POL SCI ABSTR
   *OCLC, WORLDCAT COMP FIL 12
   *PRESS U FRANC, 1951, INT POL SCI ABSTR
   *PUBL AFF INF SERV, 1915, PAIS INT
   *RR BOWK CO, 1948, BOOKS PRINT
   *SOC ABSTR INC, 1963, SOC ABSTR
   ALLEN B, 1990, LIBR INFORM SCI RES, V12, P251
   ALLEN B, 1989, LIBR INFORM SCI RES, V11, P235
   BAIRD LM, 1994, J INFORM SCI, V20, P2
   BERELSON B, 1952, CONTENT ANAL COMMUNI
   BILHARTZ T, 1984, HIST TEACHER, V17, P525
   BORNSTEIN RF, 1991, J MIND BEHAV, V12, P429
   BUSHA CH, 1980, RES METHODS LIB TECH
   CASEY JB, 1985, THESIS CASE W RESERV
   CHAMPION DJ, 1973, AM J SOCIOL, V78, P1256
   CHUBIN DE, 1990, PEERLESS SCI PEER RE
   CLARK KE, 1957, AM PSYCHOL SURVEY GR
   COLE S, 1968, AM SOCIOL REV, V33, P397
   COLE S, 1967, AM SOCIOL REV, V32, P377
   CRONIN B, 1994, J AM SOC INFORM SCI, V45, P61
   DALTON MS, 1995, ANNU REV INFORM SCI, V30, P213
   GARFIELD E, 1979, CITATION INDEXING IT
   GARFIELD E, 1983, CURR CONTENTS, V45, P5
   GARFIELDS E, 1983, CURR CONTENTS, V44, P5
   GILBERT GN, 1978, SCIENTOMETRICS, V1, P9
   GLANZEL W, 1996, SCIENTOMETRICS, V35, P167
   GLENN N, 1978, CONTEMP SOCIOL, V7, P254
   HICKS CE, 1985, SUBJECT INFORMATION, P57
   HIRSCH W, 1974, 81 PURD U I STUD SOC
   HOLSTI OR, 1969, CONTENT ANAL SOCIAL
   INGRAM HM, 1989, PS, V22, P627
   IRVINE J, 1983, SOC STUD SCI, V13, P49
   KING J, 1987, J INFORM SCI, V13, P261
   KOENIG MED, 1983, J AM SOC INFORM SCI, V34, P136
   KOENIG MED, 1982, SCIENTOMETRICS, V4, P361
   KOSTOFF RN, 1996, SCIENTOMETRICS, V36, P281
   LAWANI SM, 1983, J AM SOC INFORM SCI, V34, P59
   LINDHOLMROMATSC Y, 1998, SCHOLARLY BOOK REV S
   LIU MX, 1993, J DOC, V49, P370
   MACROBERTS MH, 1989, J AM SOC INFORM SCI, V40, P342
   MACROBERTS MH, 1996, SCIENTOMETRICS, V36, P435
   MACROBERTS MH, 1986, SOC STUD SCI, V16, P151
   MACROBERTS MH, 1984, SOC STUD SCI, V14, P91
   MARTIN BR, 1996, SCIENTOMETRICS, V36, P343
   MEHO LI, 1997, KURDS KURDISTAN SELE
   MEHO LI, UNPUB IMPORTANCE USE
   MOXLEY JM, 1992, PUBLISH DONT PERISH
   MULKAY MJ, 1974, SOC SCI INFORM, V13, P107
   MYERS CR, 1970, AM PSYCHOL, V25, P1041
   NARIN F, 1976, EVALUATIVE BIBLIOMET
   NARIN F, 1996, SCIENTOMETRICS, V36, P293
   NATOWITZ A, 1997, COLL RES LIBR, V58, P323
   PERITZ BC, 1983, SCIENTOMETRICS, V5, P303
   RILEY LE, 1970, AM SOCIOL, V5, P358
   SCHWARTZ CA, 1989, COLL RES LIBR, V50, P328
   SEGLEN PO, 1998, ACTA ORTHOP SCAND, V69, P224
   SEGLEN PO, 1992, J AM SOC INFORM SCI, V43, P628
   SMITH LC, 1981, LIBR TRENDS, V30, P83
   SNIZEK WE, 1979, AM SOCIOL, V14, P108
   SPIEGELROSING I, 1977, SOC STUD SCI, V7, P97
   TAYLOR WR, 1967, THESIS PURDUE U W LA
   THOMAS PR, 1998, SCIENTOMETRICS, V41, P335
   VANRAAN AFJ, 1997, SCIENTOMETRICS, V38, P205
   VANRAAN AFJ, 1996, SCIENTOMETRICS, V36, P397
   VANROOY S, 1968, ISKS KURDISH BIBLIO
   VIRGO JA, 1977, LIBR QUART, V47, P415
   WHITE HD, 1990, SCHOLARLY COMMUNICAT, P84
BP 123
EP 138
PG 16
JI J. Am. Soc. Inf. Sci.
PY 2000
PD JAN 15
VL 51
IS 2
GA 270AM
RP Meho LI
   Univ N Carolina, Sch Lib & Informat Sci, CB 3360, 100 Manning Hall,
Chapel Hill, NC 27599 USA.
J9 J AMER SOC INFORM SCI
UT ISI:000084513300003
ER


----------------------------------
c ISI, Reprinted with permission
Please visit their website at www.isinet.com