FW: article on interdisciplinary peer panels fyi (also see otherpapers in this special issue on interdisciplinarity

[Eugene Garfield]

Title: Citation ranking versus peer evaluation of senior faculty
research performance: A case study of Kurdish scholarship 

Author(s): Meho LI
<http://apps.isiknowledge.com/WoS/CIW.cgi?SID=G1omNmmGHhdGC2oanpP&Func=O
neClickSearch&field=AU&val=Meho+LI&curr_doc=1/1&Form=FullRecordPage&doc=
1/1> , Sonnenwald DH
<http://apps.isiknowledge.com/WoS/CIW.cgi?SID=G1omNmmGHhdGC2oanpP&Func=O
neClickSearch&field=AU&val=Sonnenwald+DH&curr_doc=1/1&Form=FullRecordPag
e&doc=1/1>  

Source: JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 51 (2):
123-138 JAN 15 2000 

Document Type: Article 

Language: English 

Cited References: 73
<http://apps.isiknowledge.com/WoS/CIW.cgi?SID=G1omNmmGHhdGC2oanpP&Func=P
agedCitedRefList&UT=000084513300003&doc=1/1&rec_id=113222967>       
Times Cited: 7
<http://apps.isiknowledge.com/WoS/CIW.cgi?SID=G1omNmmGHhdGC2oanpP&Func=D
ispCitingRec&doc=1/1&isickref=113222967>        
<http://apps.isiknowledge.com/WoS/CIW.cgi?SID=G1omNmmGHhdGC2oanpP&Func=E
asyRelated&UT=000084513300003&doc=1/1&rec_id=113222967>   
<javascript:void();>  

Abstract: The purpose of this study is to analyze the relationship
between citation ranking and peer evaluation in assessing senior faculty
research performance. Other studies typically derive their peer
evaluation data directly from referees, often in the form of ranking,
This study uses two additional sources of peer evaluation data: citation
content analysis and book review content analysis. Two main questions
are investigated: (a) To what degree does citation ranking correlate
with data from citation content analysis, book reviews, and peer
ranking? (b) Is citation ranking a valid evaluative indicator of
research performance of senior faculty members? Citation data, book
reviews, and peer ranking were compiled and examined for faculty members
specializing in Kurdish studies. Analysis shows that normalized citation
ranking and citation content analysis data yield identical ranking
results. Analysis also shows that normalized citation ranking and
citation content analysis, book reviews, and peer ranking perform
similarly (i.e., are highly correlated) for high-ranked and low-ranked
senior scholars, Additional evaluation methods and measures that take
into account the context and content of research appear to be needed to
effectively evaluate senior scholars whose performance ranks relatively
in the middle. Citation content analysis data did appear to give some
specific and important insights into the quality of research of these
middle performers, however, further analysis and research is needed to
validate this finding. This study shows that citation ranking can
provide a valid indicator for comparative evaluation of senior faculty
research performance. 

KeyWords Plus: INFORMATION-SCIENCE RESEARCH; BOOK SELECTION; BASIC
RESEARCH; INDICATORS; PSYCHOLOGY; LIBRARY; ART 

Addresses: Meho LI (reprint author), Univ N Carolina, Sch Lib & Informat
Sci, CB 3360,100 Manning Hall, Chapel Hill, NC 27599 USA
Univ N Carolina, Sch Lib & Informat Sci, Chapel Hill, NC 27599 USA 

Publisher: JOHN WILEY & SONS INC, 605 THIRD AVE, NEW YORK, NY 10158-0012
USA 

Subject Category: COMPUTER SCIENCE, INFORMATION SYSTEMS; INFORMATION
SCIENCE & LIBRARY SCIENCE 

IDS Number: 270AM 

ISSN: 0002-8231 

 

 

-----Original Message-----
From: Lokman I. Meho [mailto:meho at indiana.edu] 
Sent: Tuesday, September 19, 2006 6:10 PM
To: meho at indiana.edu
Subject: RE: article on interdisciplinary peer panels fyi (also see
otherpapers in this special issue on interdisciplinarity

 

Attached is:

 

Meho, Lokman I., and Diane H. Sonnenwald. "Citation Ranking Versus

Peer Evaluation of Senior Faculty Research Performance: A Case Study

of Kurdish Scholarship." Journal of the American Society for

Information Science, 51, no. 2 (January 15, 2000): 123-138.

 

Lokman I. Meho, Ph.D.

Assistant Professor

School of Library and Information Science

Indiana University

1320 East 10th Street, LI 011

Bloomington, IN 47405-3907

Tel: (812) 856-2323

Fax: (812) 855-6166

E-mail: meho at indiana.edu

http://www.slis.indiana.edu/faculty/meho/

 

 

  

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.asis.org/pipermail/sigmetrics/attachments/20060920/2f048d6b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.gif
Type: image/gif
Size: 931 bytes
Desc: image001.gif
URL: <http://mail.asis.org/pipermail/sigmetrics/attachments/20060920/2f048d6b/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 345 bytes
Desc: image002.gif
URL: <http://mail.asis.org/pipermail/sigmetrics/attachments/20060920/2f048d6b/attachment-0001.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: meho-sonnenwald.pdf
Type: application/pdf
Size: 171031 bytes
Desc: meho-sonnenwald.pdf
URL: <http://mail.asis.org/pipermail/sigmetrics/attachments/20060920/2f048d6b/attachment.pdf>