Oppenheim, C; Summers, MAC Citation counts and the Research Assessment Exercise, part VI: Unit of assessment 67 (music) INFORMATION RESEARCH-AN INTERNATIONAL ELECTRONIC JOURNAL, 13 (2): Art. No. 342 JUN 2008

[Eugene Garfield]

URL: http://informationr.net/ir/13-2/paper342.html

Email Address: c.oppenheim at lboro.ac.uk

Author(s): Oppenheim, C (Oppenheim, Charles); Summers, MAC (Summers, Mark 
A. C.) 

Title: Citation counts and the Research Assessment Exercise, part VI: Unit 
of assessment 67 (music) 

Source: INFORMATION RESEARCH-AN INTERNATIONAL ELECTRONIC JOURNAL, 13 (2): 
Art. No. 342 JUN 2008 

Language: English 

Document Type: Article 

Keywords Plus: BIBLIOMETRIC METHODS; ARCHAEOLOGY; RANKINGS; LIBRARY; 
AUTHORS; RATINGS 

Abstract: Introduction. This study aimed to explore research assessment 
within the field of music and, specifically, to investigate whether 
citation counting could be used to replace or inform the peer review 
system currently in use in the UK.
Method. A citation analysis of academics submitted for peer review in Unit 
of Assessment 67 in the 2001 Research Assessment Exercise was performed 
using the Arts and Humanities Citation Index and checked for correlations 
with the Assessment scores. A Spearman rank order correlation coefficient 
test was used to assess the significance of correlations between citations 
and scores.
Results. At a departmental level, citation counts correlated strongly with 
scores awarded by the Assessment Exercise. A weaker correlation was found 
between scores and individual counts. The correlations were significant at 
the 0.01% level. Types of submission were analysed and trends were found 
within the author group. However, the Arts and Humanities Citation Index 
was found to be unrepresentative of music research activity in UK 
universities due to its choice of source material.
Conclusion. The Arts and Humanities Citation Index alone is not a suitable 
data source for citation analysis in the field of music. However, if an 
alternative data source could be found, there is potential for the use of 
citation analysis in research assessment in music. 
Addresses: Loughborough Univ Technol, Dept Informat Sci, LISU, 
Loughborough LE11 3TU, Leics, England 
Reprint Address: Oppenheim, C, Loughborough Univ Technol, Dept Informat 
Sci, LISU, Loughborough LE11 3TU, Leics, England. 

Cited Reference Count: 44 

Times Cited: 0 

Publisher: UNIV SHEFFIELD DEPT INFORMATION STUDIES 

Publisher Address: UNIV SHEFFIELD, WESTERN BANK, SHEFFIELD S10 2TN, S 
YORKS, ENGLAND 

ISSN: 1368-1613 

29-char Source Abbrev.: INF RES 

ISO Source Abbrev.: Inf. Res. 

Source Item Page Count: 44 

Subject Category: Information Science & Library Science 

ISI Document Delivery No.: 324GO 

*HEFCE
MAINSTR QR RAT FUND : 2006 

*HERO
RES ASS EX 2001 : 2002 

*HM TREAS
BUDG 2006 : 2006 

*RES ASS EX
RES ASS EX 2001 ASS : 1999 

*RES ASS EX
RES ASS EX 2008 PAN : 2006 

BAIRD LM
DO CITATIONS MATTER 
JOURNAL OF INFORMATION SCIENCE 20 : 2 1994 

BANFIELD S
NAMHE NEWSLETTER : 1 2003 

BENCE V
THESIS LOUGHBOROUGH : 2005 

COLE JR
SOCIAL STRATIFICATIO : 1973 

COOK N
RETHINKING MUSIC : 1999 

CRONIN B
Comparative citation rankings of authors in monographic and journal 
literature: A study of sociology 
JOURNAL OF DOCUMENTATION 53 : 263 1997 

CULLARS JM
Citation characteristics of English-language monographs in philosophy 
LIBRARY & INFORMATION SCIENCE RESEARCH 20 : 41 1998 

DIODATO V
DICT BIBLIOMETRICS : 1994 

EASTWOOD D
FUTURE FRAMEWORK RES : 2007 

GARFIELD E
CITATION INDEXING IT : 1979 

HEMLIN S
SOCIAL EPISTEMOLOGY 10 : 209 1996 

HOLMES A
INFORM RES 6 : 61 2001 

JACSO P
INFORM REV 30 : 297 2007 

JOHNSON P
AHRC HEFCE EXP GROUP : 2006 

LANGE LL
Citation counts of multi-authored papers - First-named authors and further 
authors 
SCIENTOMETRICS 52 : 457 2001 

LEWIS J
Funding social science research in academia 
SOCIAL POLICY & ADMINISTRATION 34 : 365 2000 

MACROBERTS MH
PROBLEMS OF CITATION ANALYSIS - A CRITICAL-REVIEW 
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 40 : 342 1989 

MACROBERTS MH
Problems of citation analysis 
SCIENTOMETRICS 36 : 435 1996 

MEADOWS AJ
COMMUNICATING RES : 1998 

MOED HF
CITATION ANAL RES EV : 2005 

NEDERHOF AJ
SCIENTOMETRICS 66 : 81 2006 

NORRIS M
Citation counts and the Research Assessment Exercise V - Archaeology and 
the 2001 RAE 
JOURNAL OF DOCUMENTATION 59 : 709 2003 

OPPENHEIM C
The correlation between citation counts and the 1992 research assessment 
exercise ratings for British research in genetics, anatomy and archaeology 
JOURNAL OF DOCUMENTATION 53 : 477 1997 

OPPENHEIM C
THE CORRELATION BETWEEN CITATION COUNTS AND THE 1992 RESEARCH ASSESSMENT 
EXERCISE RATINGS FOR BRITISH-LIBRARY AND INFORMATION-SCIENCE UNIVERSITY 
DEPARTMENTS 
JOURNAL OF DOCUMENTATION 51 : 18 1995 

OPPENHEIM C
A critical review of the application of citation studies to the Research 
Assessment Exercises 
JOURNAL OF INFORMATION SCIENCE 26 : 459 2000 

OPPENHEIM C
SERIALS 9 : 155 1996 

PEYRAUBE A
PROJECT BUILDING EUR : 2005 

ROBERTS G
REV RES ASSESSMENT : 2004 

SARWAR S
THESIS U SHEFFIELD S : 2000 

SENG LB
THE CITEDNESS OF PUBLICATIONS BY UNITED-KINGDOM LIBRARY-SCHOOLS 
JOURNAL OF INFORMATION SCIENCE 21 : 68 1995 

SMITH A
CORRELATION RES ASSE : 2002 

SNYDER H
Patterns of self-citation across disciplines (1980-1989) 
JOURNAL OF INFORMATION SCIENCE 24 : 431 1998 

SO CYK
Citation ranking versus expert judgment in evaluating communication 
scholars: Effects of research specialty size and individual prominence 
SCIENTOMETRICS 41 : 325 1998 

SUMMERS MAC
ANAL RES UNIT ASSESS : 2007 

THOMAS PR
Institutional research rankings via bibliometric analysis and direct peer 
review: A comparative case study with policy implications 
SCIENTOMETRICS 41 : 335 1998 

THOMSON
ARTS HUMANITIES CITA : 

VANRAAN AFJ
Fatal attraction: Conceptual and methodological problems in the ranking of 
universities by bibliometric methods 
SCIENTOMETRICS 62 : 133 2005 

VANRAAN AFJ
Advanced bibliometric methods as quantitative core of peer review based 
evaluation and foresight exercises 
SCIENTOMETRICS 36 : 397 1996 

WARNER J
A critical review of the application of citation studies to the Research 
Assessment Exercises 
JOURNAL OF INFORMATION SCIENCE 26 : 453 2000