Abramo, G (Abramo, Giovanni); D'Angelo, CA (D'Angelo, Ciriaco Andrea); Caprasecca, A (Caprasecca, Alessandro) Allocative efficiency in public research funding: Can bibliometrics help? RESEARCH POLICY, 38 (1): 206-215 FEB 2009

[Eugene Garfield]

E-mail Address: abramo at disp.uniroma2.it 

Author(s): Abramo, G (Abramo, Giovanni); D'Angelo, CA (D'Angelo, Ciriaco 
Andrea); Caprasecca, A (Caprasecca, Alessandro) 

Title: Allocative efficiency in public research funding: Can bibliometrics 
help? 

Source: RESEARCH POLICY, 38 (1): 206-215 FEB 2009 

Language: English 

Document Type: Article 

Author Keywords: Research assessment; Universities; Peer review; 
Bibliometrics 

KeyWords Plus: IMPACT-FACTORS; INDICATORS; UNIVERSITIES; PERFORMANCE; 
CITATION 

Abstract: The use of outcome control modes of research evaluation 
exercises is ever more frequent. They are conceived as tools to stimulate 
increased levels of research productivity, and to guide choices in 
allocating components of government research budgets for publicly funded 
institutions. There are several contributions in the literature that 
compare the different methodological approaches that policy makers could 
adopt for these exercises, however the comparisons are limited to only a 
few disciplines. This work, examining the case of the whole of the "hard 
sciences" of the Italian academic system, makes a comparison between 
results obtained from peer review type of evaluations (as adopted by the 
Ministry of Universities and Research) and those possible from a 
bibliometric approach (as developed by the authors). The aim is to 
understand to what extent bibliometric methodology, which is noted as 
relatively inexpensive, time-saving and exhaustive, can complement and 
integrate peer review methodology in research evaluation. (C) 2008 
Elsevier B.V. All rights reserved. 

Addresses: [Abramo, Giovanni; D'Angelo, Ciriaco Andrea; Caprasecca, 
Alessandro] Univ Roma Tor Vergata, Sch Engn, Dept Management, Lab Studies 
Res & Technol Transfer, Rome, Italy 

Reprint Address: Abramo, G, Univ Roma Tor Vergata, Sch Engn, Dept 
Management, Lab Studies Res & Technol Transfer, Rome, Italy. 

E-mail Address: abramo at disp.uniroma2.it 

Cited Reference Count: 25 

Times Cited: 0 

Publisher: ELSEVIER SCIENCE BV 

Publisher Address: PO BOX 211, 1000 AE AMSTERDAM, NETHERLANDS 

ISSN: 0048-7333 

DOI: 10.1016/j.respol.2008.11.001 

29-char Source Abbrev.: RES POLICY 

ISO Source Abbrev.: Res. Policy 

Source Item Page Count: 10 

Subject Category: Management; Planning & Development 

ISI Document Delivery No.: 400VI 

*CIVR
VTR 2001 2003 RIS VA : 2006 

*SCI PUBL POL
FUT PATHW RES ASS ME 34 : 2007 

ABRAMO G
Measuring science: Irresistible temptations, easy shortcuts and dangerous 
consequences 
CURRENT SCIENCE 93 : 762 2007 

ABRAMO G
NON TUTTO QUELLO LUC : 2006 

ABRAMO G
The measurement of Italian universities' research productivity by a non 
parametric-bibliometric methodology 
SCIENTOMETRICS 76 : 225 DOI 10.1007/s11192-007-1942-2 2008 

AKSNES DW
Peer reviews and bibliometric indicators: a comparative study at a 
Norwegian university 
RESEARCH EVALUATION 13 : 33 2004 

GEORGHIOU L
BERL INT WORKSH EV P : 2005 

HORROBIN DF
THE PHILOSOPHICAL BASIS OF PEER-REVIEW AND THE SUPPRESSION OF INNOVATION 
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 263 : 1438 1990 

KOREVAAR JC
Validation of bibliometric indicators in the field of mathematics 
SCIENTOMETRICS 37 : 117 1996 

MARTIN BR
The use of multiple indicators in the assessment of basic research 
SCIENTOMETRICS 36 : 343 1996 

MOED HF
The impact-factors debate: The ISI's uses and limits 
NATURE 415 : 731 2002 

MOED HF
Impact factors can mislead 
NATURE 381 : 186 1996 

MOED HF
NEW BIBLIOMETRIC TOOLS FOR THE ASSESSMENT OF NATIONAL RESEARCH 
PERFORMANCE - DATABASE DESCRIPTION, OVERVIEW OF INDICATORS AND FIRST 
APPLICATIONS 
SCIENTOMETRICS 33 : 381 1995 

MOXAM H
SCI TECHNOLOGY POLIC : 7 1992 

NARIN F
Bibliometric performance measures 
SCIENTOMETRICS 36 : 293 1996 

OPPENHEIM C
J DOC 56 : 709 2003 

OPPENHEIM C
The correlation between citation counts and the 1992 research assessment 
exercise ratings for British research in genetics, anatomy and archaeology 
JOURNAL OF DOCUMENTATION 53 : 477 1997 

REALE E
P PLATF FTEVAL INT C : 2006 

RINIA EJ
Comparative analysis of a set of bibliometric indicators and central peer 
review criteria - Evaluation of condensed matter physics in the 
Netherlands 
RESEARCH POLICY 27 : 95 1998 

VANRAAN AFJ
1 INT C WORLD CLASS 2005 

VANRAAN AFJ
Fatal attraction: Conceptual and methodological problems in the ranking of 
universities by bibliometric methods 
SCIENTOMETRICS 62 : 133 2005 

VIALE R
VALUTARE SCI : 21 2003 

WARNER J
A critical review of the application of citation studies to the Research 
Assessment Exercises 
JOURNAL OF INFORMATION SCIENCE 26 : 453 2000 

WEINGART P
2 C FORSCH JUL GMBH 2003 

WEINGART P
HDB QUANTITATIVE SCI : 2004