Lundberg J, Fransson A, Brommels M, Skar J, Lundkvist I "Is it better or just the same? Article identification strategies impact bibliometric assessments " Scientometrics 66 (1): 183-197 Dec 2005

[Eugene Garfield]

E-mail Addresses: Jonas.Lundberg at cmi.ki.se


Title: Is it better or just the same? Article identification strategies
impact bibliometric assessments

Author(s): Lundberg J, Fransson A, Brommels M, Skar J, Lundkvist I

Source: SCIENTOMETRICS 66 (1): 183-197 DEC 2005

Document Type: Article
Language: English
Cited References: 41      Times Cited: 0

Abstract:
This study demonstrates that the choice of search strategy for article
identification has an impact on evaluation and policy analysis of research
areas. We have assessed the scientific production in two areas at one
research institution during a ten-year period. We explore the recall and
precision of three article identification strategies: journal
classifications, keywords and authors. Our results show that the different
search strategies have varying recall (0.38-1.00) and precision (0.50-
1.00). In conclusion, uncritical analysis based on rudimentary article
identification strategies may lead to misinterpretation of the development
of research areas, and thus provide incorrect data for decision-making.

Addresses: Lundberg J (reprint author), Karolinska Inst, Ctr Med Innovat,
Nobels Vag 15A, Stockholm, S-17177 Sweden
Karolinska Inst, Ctr Med Innovat, Stockholm, S-17177 Sweden
Karolinska Inst, Med Management Ctr, Stockholm, S-17177 Sweden
Karolinska Univ Hosp, Karolinska Inst, Ctr Hearing & Commun Res, Stockholm,
Sweden
Univ Helsinki, Dept Publ Hlth, Helsinki, Finland

E-mail Addresses: Jonas.Lundberg at cmi.ki.se

Publisher: SPRINGER, VAN GODEWIJCKSTRAAT 30, 3311 GZ DORDRECHT, NETHERLANDS
Subject Category: COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS;
INFORMATION SCIENCE & LIBRARY SCIENCE
IDS Number: 002HZ
ISSN: 0138-9130


CITED REFERENCES :
CLISTAT COMPUTER PRO : 2004

 *THOMS CORP
WEB SCI

 *US NAT LIBR MED
PUBMED

 *US NAT LIBR MED
US NAT LIB MED

 ADAMS J
BENCHMARKING INT STA : 174 1997

 BARRE R
HDB QUANTITATIVE SCI : 115 2004

 BELINCHON I
Dermatological scientific production from European Union authors (1987-2000)
SCIENTOMETRICS 61 : 271 2004

 BLAND M
INTRO MED STAT : 2000

 BLOCH S
AUST NZ J PSYCHIAT 5 : 563 2001

 BUTLER L
AUSTR BIOMEDICAL RES : 1998

 CALLON M
FROM TRANSLATIONS TO PROBLEMATIC NETWORKS - AN INTRODUCTION TO CO-WORD
ANALYSIS
SOCIAL SCIENCE INFORMATION SUR LES SCIENCES SOCIALES 22 : 191 1983

 DAVIS M
CLIN EXPT OPHTHALMOL 4 : 286 2003

 DEBACKERE K
Using a bibliometric approach to support research policy making: The case
of the Flemish BOF-key
SCIENTOMETRICS 59 : 253 2004

 FLEISS JL
STAT METHODS RATES P : 1981

 GARCIARIO F
EUR RESPIR J 6 : 1175 2001

 GARFIELD E
How can impact factors be improved?
BRITISH MEDICAL JOURNAL 313 : 411 1996

 GARFIELD E
JUNK MAIL AND TARGETED DIRECT MAIL MARKETING - THERE IS A DIFFERENCE
CURRENT CONTENTS : 5 1983

 GLANZEL W
Journal impact measures in bibliometric research
SCIENTOMETRICS 53 : 171 2002

 GROSSI F
EUR J CANCER 1 : 106 2003

 HECHT F
The journal "impact factor": A misnamed, misleading, misused measure
CANCER GENETICS AND CYTOGENETICS 104 : 77 1998

 KATZ JS
A systemic view of British science
SCIENTOMETRICS 35 : 133 1996

 LEWISON G
RES EVALUAT 6 : 25 1996

 MARTIN BR
ASSESSING BASIC RESEARCH - SOME PARTIAL INDICATORS OF SCIENTIFIC PROGRESS
IN RADIO ASTRONOMY
RESEARCH POLICY 12 : 61 1983

 MAY RM
The scientific wealth of nations
SCIENCE 275 : 793 1997

 MELA G
ANN RHEUM DIS 11 : 643 1998

 MELA GS
Impact assessment of oncology research in the European Union
EUROPEAN JOURNAL OF CANCER 35 : 1182 1999

 MOHANTI BK
NATL MED J INDIA 4 : 197 2004

 NOYONS ECM
Combining mapping and citation analysis for evaluative bibliometric
purposes: A bibliometric study
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 50 : 115 1999

 OPTHOF T
CARDIOVASC RES 1 : 1 1997

 PEZZULLO JC
2 WAY CONTINGENCY TA : 2005

SAHA S
J MED LIBR ASSOC 1 : 42 2003

 SEGLEN PO
Why the impact factor of journals should not be used for evaluating research
BRITISH MEDICAL JOURNAL 314 : 498 1997

 SKRAM U
ACTA ANAESTHESIOLOGI 8 : 1006 2004

 SMALL H
COCITATION IN SCIENTIFIC LITERATURE - NEW MEASURE OF RELATIONSHIP BETWEEN 2
DOCUMENTS
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 24 : 265 1973

 STRANDBERG Y
20041210 KAR I

 UGOLINI D
EUR J CANCER 13 : 1888 2003

 UGOLINI D
EUR J CANCER 8 : 1121 2002

 UGOLINI D
How the European Union writes about ophthalmology
SCIENTOMETRICS 52 : 45 2001

 VANLEEUWEN TN
THESIS LEIDEN U : 2004

 VANRAAN AFJ
HDB QUANTITATIVE SCI : 19 2004

 VONESSEN L
WELCOME CTR HEARING : 2004