Kurmis AP, Kurmis TP "Exploring the relationship between impact factor and manuscript rejection rates in radiologic journals " Academic Radiology 13 (1): 77-83 JAN 2006

[Eugene Garfield]

E-mail Addresse: andrew.kurmis at flinders.edu.au


Title: Exploring the relationship between impact factor and manuscript
rejection rates in radiologic journals

Author(s): Kurmis AP, Kurmis TP

Source: ACADEMIC RADIOLOGY 13 (1): 77-83 JAN 2006

Document Type: Article
Language: English
Cited References: 29      Times Cited: 0

Abstract:
Rationale and Objectives.
Stratifying candidates objectively on the merit Of publication portfolios
is an onerous and difficult task. Institutional committees are under
increasing pressure to rank applicants based on previous achievements for
appointments/promotions, funding, and awards, and must do so within
unforgiving time constraints. The journal impact factor (IF) has been
loosely adopted in many circles for assessing article "quality,"
circumventing detailed review of individual articles. The premise
supporting such practice often hinges on assuming that high-IF journals are
harder to publish in, for example, have higher rejection rates (RRs), and
therefore, authors achieving publication in such periodicals should
be "recognized" for their achievement. There is no evidence of previous
research linking IF and RR.

Materials and Methods.
A subset of Institute for Scientific Information (ISI)-listed radiology
journals, for which IF data were available, was identified and a direct-
contact survey approach (63.3% response rate) used to ascertain journal
manuscript RR.

Results.
Of the sample reviewed, the ISI-listed IF values ranged from 4.759 to 0.056
(mean 1.491), and editor-reported manuscript RRs from 80.0% to 8.0% (mean
47.8%). Statistical comparison of IF and RR using linear regression yielded
an r(2) value of 0.223.

Conclusions.
In summary, this study demonstrates poor linear agreement between IF and RR
for manuscripts submitted to peer-reviewed radiology journals. This
suggests that journal IF is a poor predictor of RR, and vice versa. This
finding may be of interest to institutional committees who have adopted the
IF as an indicator of merit in reviewing publication curriculum vitae, and
may encourage rethinking of currently practiced candidate assessment
approaches.


Addresses: Kurmis AP (reprint author), Repatriat Gen Hosp, Dept Orthopaed,
Div Surg, Daws Rd, Daw Pk, SA 5041 Australia
Repatriat Gen Hosp, Dept Orthopaed, Div Surg, Daw Pk, SA 5041 Australia

E-mail Addresses: andrew.kurmis at flinders.edu.au

Publisher: ASSOC UNIV RADIOLOGISTS, 820 JORIE BLVD, OAK BROOK, IL 60523-
2251 USA
Subject Category: RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
IDS Number: 003CK
ISSN: 1076-6332


CITED REFERENCES :
*ISI
ISI J CIT REP
 BLOCH S
The Impact Factor: Time for change
AUSTRALIAN AND NEW ZEALAND JOURNAL OF PSYCHIATRY 35 : 563 2001
 BRODY S
IMPACT FACTOR AS THE BEST OPERATIONAL MEASURE OF MEDICAL JOURNALS
LANCET 346 : 1300 1995
 CHEW FS
FATE OF MANUSCRIPTS REJECTED FOR PUBLICATION IN THE AJR
AMERICAN JOURNAL OF ROENTGENOLOGY 156 : 627 1991
 CHEW FS
HOW RESEARCH BECOMES KNOWLEDGE IN RADIOLOGY - AN ANALYSIS OF CITATIONS TO
PUBLISHED PAPERS
AMERICAN JOURNAL OF ROENTGENOLOGY 150 : 31 1988
 CHEW FS
THE SCIENTIFIC LITERATURE IN DIAGNOSTIC-RADIOLOGY FOR AMERICAN READERS - A
SURVEY AND ANALYSIS OF JOURNALS, PAPERS, AND AUTHORS
AMERICAN JOURNAL OF ROENTGENOLOGY 147 : 1055 1986
 CURTI M
Impact factor and electronic versions of biomedical scientific journals
HAEMATOLOGICA 86 : 1015 2001
 DEJONG JW
The international rank order of clinical cardiology
EUROPEAN HEART JOURNAL 17 : 35 1996
 GALLAGHER EJ
Evidence of methodologic bias in the derivation of the Science Citation
Index impact factor
ANNALS OF EMERGENCY MEDICINE 31 : 83 1998
 GARFIELD E
Journal impact factor: a brief review
CANADIAN MEDICAL ASSOCIATION JOURNAL 161 : 979 1999
 HANSSON S
IMPACT FACTOR AS A MISLEADING TOOL IN EVALUATION OF MEDICAL JOURNALS
LANCET 346 : 906 1995
 HECHT F
The journal "impact factor": A misnamed, misleading, misused measure
CANCER GENETICS AND CYTOGENETICS 104 : 77 1998
 HEMMINGSSON A
Impact factors in scientific journals
JOURNAL OF MAGNETIC RESONANCE IMAGING 15 : 619 2002
 JACSO P
A deficiency in the algorithm for calculating the impact factor of
scholarly journals: The journal impact factor
CORTEX 37 : 590 2001
 KURMIS AP
Current concepts review - Understanding the limitations of the journal
impact factor
JOURNAL OF BONE AND JOINT SURGERY-AMERICAN VOLUME 85 : 2449 2003
 LEHRL S
Evaluating scientific performances by impact factors - the right for equal
chances
STRAHLENTHERAPIE UND ONKOLOGIE 175 : 141 1999
 LINARDI PM
The ''impact factor'' as a criterion for the quality of scientific
production is a relative, not absolute, measure
BRAZILIAN JOURNAL OF MEDICAL AND BIOLOGICAL RESEARCH 29 : 555 1996
 LINDE A
On the pitfalls of journal ranking by impact factor (R)
EUROPEAN JOURNAL OF ORAL SCIENCES 106 : 525 1998
 LUNDBERG GD
The "omnipotent" Science Citation Index impact factor
MEDICAL JOURNAL OF AUSTRALIA 178 : 253 2003
 MOED HF
A new classification system to describe the ageing of scientific journals
and their impact factors
JOURNAL OF DOCUMENTATION 54 : 387 1998
 MUSSI C
Impact factor of medical journals: Problems in geriatrics
AGING CLINICAL AND EXPERIMENTAL RESEARCH 14 : 64 2002
 NEUBERGER J
Impact factors: uses and abuses
EUROPEAN JOURNAL OF GASTROENTEROLOGY & HEPATOLOGY 14 : 209 2002
 ROGERS LF
Impact factor: The numbers game
AMERICAN JOURNAL OF ROENTGENOLOGY 178 : 541 2002
 SAPER CB
What's in a citation impact factor? A journal by any other measure ...
JOURNAL OF COMPARATIVE NEUROLOGY 411 : 1 1999
 SEGLEN PO
Why the impact factor of journals should not be used for evaluating research
BRITISH MEDICAL JOURNAL 314 : 498 1997
 SIECK GC
The "impact factor": what it means to the impact of applied physiology
JOURNAL OF APPLIED PHYSIOLOGY 89 : 865 2000
 TALAMANCA AF
B GROUP INT RECH SCI 44 : 2 2002
 WALSH EF
Spine: Scientific citation index and its impact factor
SPINE 23 : 1087 1998
 WHITEHOUSE GH
Impact factors: facts and myths
EUROPEAN RADIOLOGY 12 : 715 2002