RAE/REF research

[Stevan Harnad]

On Fri, 15 Feb 2008, Bevan, Simon wrote:

> The research undertaken at Cranfield concerning the differences between
> the Research Assessment Exercise and the Research Excellence Framework,
> discussed in the Times Higher this week is available at:
> https://dspace.lib.cranfield.ac.uk/bitstream/1826/2248/1/Citation%20Counts-RAE%20Scores-2008..pdf

This pilot study has some methodological weaknesses.

The remedy for the ostensible problems encountered in this study is for
the panel rankings in the parallel metric/panel RAE 2008 to be analysed
in a full-scale multiple regression study using as rich and diverse
as possible a spectrum of predictive metrics (not just citation
counts!), discipline by discipline. This will reveal which metrics are
most predictive of the panel rankings in each discipline, and it will
initialise their weights, which can then be calibrated, updated and
fine-tuned (as well as augmented with any new metrics) in subsequent
continuous assessment.

Stevan Harnad

Harnad, S. (2007) Open Access Scientometrics and the UK Research
Assessment Exercise. In Proceedings of 11th Annual Meeting of the
International Society for Scientometrics and Informetrics 11(1), pp.
27-33, Madrid, Spain. Torres-Salinas, D. and Moed, H. F., Eds.
http://eprints.ecs.soton.ac.uk/13804/

Brody, T., Carr, L., Harnad, S. and Swan, A. (2007) Time to Convert to
Metrics. Research Fortnight pp. 17-18.
http://eprints.ecs.soton.ac.uk/14329/

Brody, T., Carr, L., Gingras, Y., Hajjem, C., Harnad, S. and Swan, A.
(2007) Incentivizing the Open Access Research Web:
Publication-Archiving, Data-Archiving and Scientometrics. CTWatch
Quarterly 3(3). http://eprints.ecs.soton.ac.uk/14418/

Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) Mandated online
RAE CVs Linked to University Eprint Archives:
Improving the UK Research Assessment Exercise whilst making it cheaper
and easier. Ariadne 35.
http://www.ecs.soton.ac.uk/~harnad/Temp/Ariadne-RAE.htm

Brody, T., Kampa, S., Harnad, S., Carr, L. and Hitchcock, S. (2003)
Digitometric Services for Open Archives Environments. In Proceedings of
European Conference on Digital Libraries 2003, pp. 207-220, Trondheim,
Norway. http://eprints.ecs.soton.ac.uk/7503/

Harnad, S. (2003) Measuring and Maximising UK Research Impact. Times
Higher Education Supplement. Friday, June 6 2003
http://eprints.ecs.soton.ac.uk/7728/

Harnad, S. (2001) Research access, impact and assessment. Times Higher
Education Supplement 1487: p. 16.  http://cogprints.org/1683/

>
>
> Cheers
>
>
>
> Simon
>
> -------------------------------------------
>
> Simon J. Bevan
>
> Information Systems Manager
>
> Cranfield University
>
> Cranfield
>
> Bedfordshire
>
> MK43 0AL
>
>
>
> Email: s.bevan at cranfield.ac.uk <mailto:s.bevan at cranfield.ac.uk>
>
> Tel: +44(0)1234 754445
>
>
>
> The Kings Norton Library has been awarded Charter Mark
> <blocked::http://www.cranfieldlibrary.cranfield.ac.uk/chartermark> , the
> UK Government standard for excellent customer service.
>
>
>
> ***************************************************************
>
> This communication is sent in confidence to the named recipient only. If
> you are not the named recipient, any use, disclosure or copying of this
> communication is prohibited. If you have received this communication in
> error, please notify the sender immediately by telephone or email.
>
>
>
> The opinions expressed do not necessarily represent the corporate views
> of Cranfield University. Cranfield University accepts no liability for
> the content of this email or the consequences of any actions taken on
> the basis of the information provided.
>
> ***************************************************************
>
>
>
>