Zehrer, A (Zehrer, Anita) The justification of journal rankings - A pilot study SCANDINAVIAN JOURNAL OF HOSPITALITY AND TOURISM, 7 (2): 139-156 2007

[Eugene Garfield]

E-mail Address: anita.zehrer at mci.edu

Author(s): Zehrer, A (Zehrer, Anita) 

Title: The justification of journal rankings - A pilot study 

Source: SCANDINAVIAN JOURNAL OF HOSPITALITY AND TOURISM, 7 (2): 139-156 
2007 

Language: English 

Document Type: Article 

Author Keywords: scientific journals; pilot testing; journal ranking; 
quality perception 

Keywords Plus: ECONOMICS JOURNALS; RELATIVE IMPACTS; QUALITY; MANAGEMENT; 
TOURISM; PERCEPTIONS; CITATIONS; SCHOLARS; SCIENCE 

Abstract: Among the communication platforms of research, the scientific 
journal can be regarded as the most important medium for publishing, 
especially in terms of tenure decisions and promotion. Yet, the big number 
of existing journals makes it difficult to select the most suitable 
journal for publishing. In the last few years, many studies have been 
carried out on the quality of academic journals and produced one ranking 
after another. Also the field of tourism has seen a growing number of 
surveys on this subject. But do these rankings measure the quality of 
journals in a reliable way? The paper reports a pilot study on journal 
quality among a small group of experts in the field of tourism and leisure 
to produce a ranking of tourism journals. Theoretically, the ranking of 
journals is discussed by asking the following questions: What role do 
journal rankings play? May rankings reflect the overall quality of 
journals? Are indicators chosen in a reliable way? How accurate are 
journal lists compiled?. 

Addresses: Univ Appl Sci, MCI, Tourism Business Studies, Innsbruck, 
Austria 

Reprint Address: Zehrer, A, Univ Appl Sci, MCI, Tourism Business Studies, 
Weiherburggasse 8, Innsbruck, Austria. 

E-mail Address: anita.zehrer at mci.edu 

Cited Reference Count: 63 

Times Cited: 0 

Publisher: ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD 

Publisher Address: 4 PARK SQUARE, MILTON PARK, ABINGDON OX14 4RN, 
OXFORDSHIRE, ENGLAND 

ISSN: 1502-2250 

29-char Source Abbrev.: SCAND J HOSP TOUR 

ISO Source Abbrev.: Scand. J. Hosp. Tour. 

Source Item Page Count: 18 

ISI Document Delivery No.: 274KN 

AXARLOGLOU K
EUR EC ASS 1 : 1402 DOI 10.1162/154247603322752584 2003 

BALLAS A
Exploring diversity in accounting through faculty journal perceptions 
CONTEMPORARY ACCOUNTING RESEARCH 20 : 619 2003 

BAVELAS JB
SOCIAL-PSYCHOLOGY OF CITATIONS 
CANADIAN PSYCHOLOGICAL REVIEW-PSYCHOLOGIE CANADIENNE 19 : 158 1978 

BEED C
Measuring the quality of academic journals: The case of economics 
JOURNAL OF POST KEYNESIAN ECONOMICS 18 : 369 1996 

BOWER RS
FINANCIAL PRACTICE E 4 : 18 1994 

BRAEUNINGER M
DISCUSSION PAPERS EC : 111 2002 

BROOKS CH
RATING JOURNALS IN HEALTH-CARE ADMINISTRATION - THE PERCEPTIONS OF PROGRAM 
CHAIRPERSONS 
MEDICAL CARE 29 : 755 1991 

BUSH WC
QUALITY INDEX FOR ECONOMIC JOURNALS 
REVIEW OF ECONOMICS AND STATISTICS 56 : 123 1974 

CAMPBELL DFJ
POLITICAL SCI SERIES 48 : 2 1997 

CRANE D
INVISIBLE COLL : 1972 

DIAMOND AM
WHAT IS A CITATION WORTH 
JOURNAL OF HUMAN RESOURCES 21 : 200 1986 

FIGLIO D
TRENDS IN THE PUBLICATION OF EMPIRICAL ECONOMICS 
JOURNAL OF ECONOMIC PERSPECTIVES 8 : 179 1994 

FRANKE RH
THE DEVELOPMENT OF STRATEGIC MANAGEMENT - JOURNAL QUALITY AND ARTICLE 
IMPACT 
STRATEGIC MANAGEMENT JOURNAL 11 : 243 1990 

FREY BS
Publishing as prostitution? - Choosing between one's own ideas and 
academic success 
PUBLIC CHOICE 116 : 205 2003 

GARFIELD E
CITATION ANALYSIS AS A TOOL IN JOURNAL EVALUATION - JOURNALS CAN BE RANKED 
BY FREQUENCY AND IMPACT OF CITATIONS FOR SCIENCE POLICY STUDIES 
SCIENCE 178 : 471 1972 

GARVIN DA
WHAT DOES PRODUCT QUALITY REALLY MEAN 
SLOAN MANAGEMENT REVIEW 26 : 25 1984 

HAIR JF
MULTIVARIATE DATA AN : 1995 

HARDGRAVE BC
Forums for MIS scholars 
COMMUNICATIONS OF THE ACM 40 : 119 1997 

HAWES JM
J ACAD BUSINESS ED 3 : 70 2002 

HECHT F
The journal "impact factor": A misnamed, misleading, misused measure 
CANCER GENETICS AND CYTOGENETICS 104 : 77 1998 

HEISCHMIDT KA
J ED BUSINESS 68 : 152 1993 

HODGSON G
ECON J 109 : 165 1999 

HULL RP
ACCOUNTING HORIZONS 4 : 77 1990 

HULT G
J MARKETING ED 19 : 37 1997 

HUMPHREY C
ACCOUNTING AUDITING 8 : 141 1995 

JENNINGS C
NAT NEUROSCI 1 : 641 1998 

KOROBKIN R
FLORIDA STATE U LAW 26 : 850 1999 

LABAND DN
THE RELATIVE IMPACTS OF ECONOMICS JOURNALS - 1970-1990 
JOURNAL OF ECONOMIC LITERATURE 32 : 640 1994 

LEE TA
ACCOUNTING BUSINESS 19 : 237 1989 

LIEBOWITZ SJ
ASSESSING THE RELATIVE IMPACTS OF ECONOMICS JOURNALS 
JOURNAL OF ECONOMIC LITERATURE 22 : 77 1984 

LINDSEY D
USING CITATION COUNTS AS A MEASURE OF QUALITY IN SCIENCE - MEASURING WHATS 
MEASURABLE RATHER THAN WHATS VALID 
SCIENTOMETRICS 15 : 189 1989 

LUBRANO M
EUROPEAN EC ASS 1 : 1367 2003 

MACMILLAN IC
DELINEATING A FORUM FOR BUSINESS POLICY SCHOLARS 
STRATEGIC MANAGEMENT JOURNAL 10 : 391 1989 

MACROBERTS MH
TESTING THE ORTEGA HYPOTHESIS - FACTS AND ARTIFACTS 
SCIENTOMETRICS 12 : 293 1987 

MAHONEY MJ
COGNITIVE THERAPY RE 1 : 161 1977 

MASON PM
Q J BUSINESS EC 36 : 69 1997 

MCKERCHER B
Rating tourism and hospitality journals 
TOURISM MANAGEMENT 27 : 1235 DOI 10.1016/j.tourman.2005.06.008 2006 

MCKERCHER B
A case for ranking tourism journals 
TOURISM MANAGEMENT 26 : 649 DOI 10.1016/j.tourman.2004.04.003 2005 

MCNULTY JE
J EC FINANCE 23 : 30 1999 

MEDOFF MH
Collaboration and the quality of economics research 
LABOUR ECONOMICS 10 : 597 DOI 10.1016/S0927-5371(03)00072-1 2003 

MORT GS
AUSTRALASIAN MARKETI 12 : 51 2004 

NEARY JP
EUROPEAN EC ASS 1 : 1239 2003 

PAGE SJ
Academic ranking exercises: do they anything meaningful? a personal view 
TOURISM MANAGEMENT 26 : 663 DOI 10.1016/j.tourman.2004.05.007 2005 

PALMER AL
Tourism and statistics - Bibliometric study 1998-2002 
ANNALS OF TOURISM RESEARCH 32 : 167 DOI 10.1016/j.annals.2004.06.003 2005 

PARNELL JA
MIDATLANTIC J BUSINE 33 : 69 1997 

PECHLANER H
J TRAVEL RES 42 : 328 2004 

PECHLANER H
TOURISM ZAGREB 50 : 395 2002 

POLONSKY MJ
J MARKETING ED 21 : 181 1999 

POWER M
Making things auditable 
ACCOUNTING ORGANIZATIONS AND SOCIETY 21 : 289 1996 

PRESCOTT PA
THE POTENTIAL USES OF PILOT WORK 
NURSING RESEARCH 38 : 60 1989 

PRICE DD
METRIC SCI ADVENT SC : 69 1978 

RUSSELL RL
ANN M AC LIB ASS OH : 2000 

RYAN C
The ranking and rating of academics and journals in tourism research 
TOURISM MANAGEMENT 26 : 657 DOI 10.1016/j.tourman.2004.05.001 2005 

SANDELANDS E
LIB REV 45 : 53 1996 

SCHMIDGALL R
CORNELL HOTEL REST A 9 : 74 1998 

SCRIVEN M
EVALUATION THESAURUS : 1991 

SHARPLIN AD
THE RELATIVE IMPORTANCE OF JOURNALS USED IN MANAGEMENT RESEARCH - AN 
ALTERNATIVE RANKING 
HUMAN RELATIONS 38 : 139 1985 

SHELDON PJ
J TOURISM STUDIES 1 : 42 1990 

SOTERIOU AC
J OPER MANAG 17 : 225 1999 

TAHAI A
A revealed preference study of management journals' direct influences 
STRATEGIC MANAGEMENT JOURNAL 20 : 279 1999 

VANTEIJLINGEN ER
The importance of conducting and reporting pilot studies: the example of 
the Scottish Births Survey 
JOURNAL OF ADVANCED NURSING 34 : 289 2001 

VANVUGHT F
QUALITAETSENTWICKLUN : 64 2000 

ZINKHAN GM
Assessing the quality ranking of the Journal of Advertising, 1986-1997 
JOURNAL OF ADVERTISING 28 : 51 1999