Clyde LA "Evaluating the quality of research publications: A pilot study of school librarianship" JASIST 55(13):1119-1130 Nov. 2004.

[Eugene Garfield]

LAUREL A. CLYDE : anne at hi.is


Title     : Evaluating the quality of research publications: A pilot study
            of school librarianship

Author(s) : Clyde LA

Source    : JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND
TECHNOLOGY 55 (13): 1119-1130 NOV 2004

Cited References: 57

Abstract:
Evaluation of research quality is becoming more important in the field of
library and information science, as in other fields. This pilot study is a
preliminary attempt to address issues associated with determining the
quality of the published research in one area of library and information
science, specifically school librarianship. The main aims were (1) to test
the extent to which experienced evaluators agreed in their rankings of
published research articles on the basis of quality and (2) to investigate
the approaches to evaluation used by the experienced evaluators. A
qualitative, naturalistic research design was used. On the basis of a
comprehensive literature review, four approaches to evaluation were
identified; they were generally supported through an analysis of the
responses of the experienced evaluators. However, although the majority of
the evaluators agreed on the article ranked lowest, basic statistical
analyses showed less agreement about the other articles. Although subject
knowledge (of the field of school librarianship in this case) may have some
influence on the evaluations, cluster analysis suggests that there may be
differences in the value perceptions of the evaluators that also carry
weight. More research would be needed to gain a better understanding of
these value perceptions and their relationship, if any, to the four
approaches to evaluation that were identified through the literature.

Addresses: Clyde LA (reprint author), Univ Iceland, Fac Social Sci,
Reykjavik, IS-101 Iceland
Univ Iceland, Fac Social Sci, Reykjavik, IS-101 Iceland

E-mail Addresses: anne at hi.is

Publisher: JOHN WILEY & SONS INC, 111 RIVER ST, HOBOKEN, NJ 07030 USA

Subject Category: COMPUTER SCIENCE, INFORMATION SYSTEMS; INFORMATION SCIENCE
& LIBRARY SCIENCE

IDS Number: 860SY
ISSN: 1532-2882

CITED REFERENCES:
CR *I SCI INF, 2002, ISI MASTER JOURNAL L
   *I SCI INF, 2002, J SEL CRIT
   ASHER W, 1973, INFORMATION QUALITY
   AVKIRAN NK, 1997, SCIENTOMETRICS, V39, P173
   BAHR AH, 2000, COLL RES LIBR, V61, P410
   BLAKE VLP, 1996, EDUC INFORM, V14, P157
   BOON JA, 1990, S AFRICAN J LIBR INF, V58, P155
   CALVERT PJ, 2001, LIBR MANAGEMENT, V22, P205
   CHEN HM, 2001, J AM SOC INF SCI TEC, V52, P888
   CHUNG F, 2001, CARDIOPULMONARY PHYS, V12
   CLYD LA, 2001, INSPIRING CONNECTION, P65
   CLYDE LA, 1996, SUSTAINING VISION CO
   CLYDE LA, 2002, SCH LIBR KNOWLEDGE S, P55
   CLYDE LA, 2003, IFLA J, V29, P18
   CRACE J, 2003, PEER TROUBLE HOW FAI
   GARFIELD EE, 1979, CITATION INDEXING IT
   GEHANNO JF, 2000, OCCUP ENVIRON MED, V57, P706
   GILES MW, 1989, P S, V22, P613
   GOLDBECKWOOD S, 1999, BRIT MED J, V318, P44
   HANSEN HF, 1996, BIBLIOTEKSARBEJDE, V48, P7
   HART RL, 2000, COLL RES LIBR, V61, P410
   HARTER SP, 1996, PUBLIC ACCESS COMPUT, V7, P5
   HAYCOCK K, 1994, P 23 ANN C INT ASS S, P94
   HENRI J, 1998, ACCESS, V12, P29
   HERNON P, 1999, J ACAD LIBR, V25, P263
   JOHNSON SC, 1967, PSYCHOMETRIKA, V32, P241
   JUSTICE AC, 1998, JAMA-J AM MED ASSOC, V280, P240
   KATZER J, 1989, LIB INFORMATION SCI, V11, P83
   KATZER J, 1998, EVALUATING INFORMATI
   KOHL DF, 1985, COLL RES LIBR, V46, P40
   KOSTOFF RN, 1998, SCIENTOMETRICS, V43, P27
   LEE KP, 2002, JAMA-J AM MED ASSOC, V287, P2805
   LOWI TJ, 1998, AM POLIT SCI REV, V86, P210
   MACAULEY D, 1994, BRIT J GEN PRACT, V44, P83
   MACLEOD D, 2001, GUARDIAN ED, V11, P10
   MACLEOD D, 2003, GUARDIAN ED, V17, P39
   MACROBERTS MH, 1989, J AM SOC INFORM SCI, V40, P342
   MARSHALL JG, 2003, INFORMATION OUTLOOK, V7, P40
   MCCLURE CR, 1989, COLL RES LIBR, V50, P127
   MILLER PA, 2003, PHYS THER, V83, P123
   MOED HF, 2002, NATURE, V415, P731
   MURPHY PS, 1994, AUSTR U REV, V37, P14
   NICOLAISEN J, 2002, J DOC, V58, P383
   NKEREUWEM EE, 1997, ASIAN LIB, V6, P71
   OPTHOF T, 1997, CARDIOVASC RES, V33, P1
   PALSDOTTIR G, 1997, PUBLICATED RES LIBR, P85
   PIRSIG RM, 1975, ZEN ART MOTORCYCLE M
   SEGLEN PO, 1997, BRIT MED J, V314, P498
   SMITH A, 2001, NEVER MINS WIDTH FEE
   THOMAS O, 2000, J INFORM SCI, V26, P421
   TJOUMAS R, 1992, J EDUC LIBR INF SCI, V33, P173
   TJOURMAS R, 1994, SERIALS LIBR, V25, P65
   TODD R, 2001, TRANSITIONS PREFERRE
   VAUGHAN L, 2002, ASLIB PROC, V54, P356
   WANDT E, 1965, CROSS SECTION ED RES
   WARNER J, 2000, J INFORM SCI, V26, P453
   WHITE C, 2003, BRIT MED J, V326, P241