From loet at LEYDESDORFF.NET Wed Jun 4 06:06:09 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Wed, 4 Jun 2008 12:06:09 +0200 Subject: Scirus Topic Page on "Measuring Research Output with Science & Technology Indicators"; please, feel free to comment. Message-ID: http://topics.scirus.com/Measuring_Research_Output_with_Science_Technology_I ndicators.html Measuring Research Output with Science & Technology Indicators The measurement of research output and the ranking of universities has become an industry in itself. Ranking, however, is based on reducing the complexity to a single number. The weighting of different dimensions remains a problem. Research output measurements are based on indicators such as impact factors. These indicators have been clearly defined, but for other purposes (Garfield, 1979). For example, impact factors can vary by an order of magnitude between mathematics and the life-sciences. Would a university be well advised to close its mathematics department in order to improve its ranking? Because publication and citation rates differ significantly among fields of science, universities-or analogously nations-are too heterogeneous for accurate comparison (Collins, 1985). Fields of science, however, cannot clearly be decomposed because the journal sets overlap. Subject categorization works well in the core sets, but not at interfaces (Leydesdorff, 2006a). Thus, field-normalization is necessarily burdened with technical decisions which may heavily influence the resulting rankings. Independently of the differences among fields of science, publications come in different types. By using a relatively short time window-as in the case of the impact factor-journals which publish letters and fields with fast-moving research fronts will be favoured. Review journals, for example, have "cited half-life times" significantly longer than letters (Leydesdorff, 2008). Should one then give up? Can information science or sociology help us to improve the measurement? The systems of scientific communication and technological innovation provide us with rich domains for studying the dynamics of science, technology, and innovation (Moed et al., 2004). The communication of knowledge can be measured, modeled, and simulated. However, knowledge transfer is not linear; hence, one needs models from non-linear dynamics. Knowledge can be considered as a meaning which makes a difference and potentially reduces uncertainty (Leydesdorff, 2006b). The study of science, technology, and innovation provides us with measurement tools for variables which are used outside the context of analytical perspectives (Figure 1) when legitimating allocation decisions. Figure 1: Different perspectives in the study of science and technology. In a recent research project, we were granted access to the funding decisions of one of the research councils in the Netherlands (Van den Besselaar & Leydesdorff, 2007). We found that in the case of matched pairs of positive and negative funding decisions, the rejected authors had significantly higher publication and citation rates than the funded ones. Funding decisions are riddled with institutional bias, programmatic preferences, etc. (Wenneras & Wold, 1997; Bornmann & Daniel, 2006). Thus, one is caught between the Scylla of peer-review and the Charybdis of statistical analysis. Intellectual caution is the advice! When Harvard University appears at the top of the rankings, one could raise a question about publications and citations per dollar. In terms of productivity, European universities may be more efficient than American ones because of the huge differences in their budgets (Dosi et al., 2006). more > _____ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ Visiting Professor 2007-2010, ISTIC, Beijing; Honorary Fellow 2007-2010, SPRU, University of Sussex Now available: The Knowledge-Based Economy: Modeled, Measured, Simulated, 385 pp.; US$ 18.95; The Self-Organization of the Knowledge-Based Society ; The Challenge of Scientometrics -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: attd48e0.jpg Type: image/jpeg Size: 10633 bytes Desc: not available URL: From garfield at CODEX.CIS.UPENN.EDU Wed Jun 4 13:49:46 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Wed, 4 Jun 2008 13:49:46 -0400 Subject: Schrank, B (Schrank, B.); Amering, M (Amering, M.) Publication trends in high impact factor journals 1994-2004 EUROPEAN PSYCHIATRY, 23: S48-S48 Suppl. 2 APR 2008 Message-ID: Email Address: beate.schrank at gmail.com Author(s): Schrank, B (Schrank, B.); Amering, M (Amering, M.) Title: Publication trends in high impact factor journals 1994-2004 Source: EUROPEAN PSYCHIATRY, 23: S48-S48 Suppl. 2 APR 2008 Language: English Document Type: Meeting Abstract Addresses: Med Univ & Gen Hosp, Dept Psychiat, Vienna, Austria Cited Reference Count: 0 Times Cited: 0 Publisher: ELSEVIER FRANCE-EDITIONS SCIENTIFIQUES MEDICALES ELSEVIER Publisher Address: 23 RUE LINOIS, 75724 PARIS, FRANCE ISSN: 0924-9338 29-char Source Abbrev.: EUR PSYCHIAT ISO Source Abbrev.: Eur. Psychiat. Source Item Page Count: 1 Subject Category: Psychiatry ISI Document Delivery No.: 288LL From eugene.garfield at THOMSONREUTERS.COM Wed Jun 4 15:11:09 2008 From: eugene.garfield at THOMSONREUTERS.COM (Eugene Garfield) Date: Wed, 4 Jun 2008 15:11:09 -0400 Subject: Stock &Stock book on Knowledge Representation Message-ID: At my request Wolfgang Stock has prepared an English contents page of his new book published in German and co-authored with his wife. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Contents Knowledge Representation.doc Type: application/msword Size: 32256 bytes Desc: Contents Knowledge Representation.doc URL: From garfield at CODEX.CIS.UPENN.EDU Wed Jun 4 15:57:45 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Wed, 4 Jun 2008 15:57:45 -0400 Subject: Knudson, DV; Chow, JW North American perception of the prestige of biomechanics serials GAIT & POSTURE, 27 (4): 559-563 MAY 2008 Message-ID: E-mail Address: dknudson at csuchico.edu Author(s): Knudson, DV (Knudson, Duane V.); Chow, JW (Chow, John W.) Title: North American perception of the prestige of biomechanics serials Source: GAIT & POSTURE, 27 (4): 559-563 MAY 2008 Language: English Document Type: Article Author Keywords: impact factor; journal quality; citation; Bibliometrics Keywords Plus: JOURNAL IMPACT FACTOR; QUALITY Abstract: Biomechanics is a discipline with many applications and sub- areas so scholars often publish their work in journals in different subject categories used in the ISI Journal Citation Reports (JCR). It is not known whether the quality/prestige of journals in the discipline of biomechanics matches the ISI Impact Factor (IF) ratings reported in JCR. A survey of the membership of the American Society of Biomechanics (ASB) was conducted to rate the quality/prestige of typical papers in serials publishing biomechanics research on a five point scale. Seventy-eight of 610 ASB members responded to the survey. Mean journal prestige ratings were only weakly correlated (r = 0.35) with the IF for 2005, with serial ratings differing across the interest areas of the ASB respondents. It was concluded that IF's should be used with caution in evaluating the prestige of journals publishing biomechanics research. Furthermore, investigators should consider interest area specific ratings within biomechanics when selecting journals for publishing their research. (c) 2007 Elsevier B.V. All rights reserved. Addresses: Calif State Univ Chico, Dept Kinesiol, Chico, CA 95929 USA; Methodist Rehabil Ctr, Ctr Neurosci & Neurol Recovery, Jackson, MS 39216 USA Reprint Address: Knudson, DV, Calif State Univ Chico, Dept Kinesiol, 400 W 1st St, Chico, CA 95929 USA. E-mail Address: dknudson at csuchico.edu Cited Reference Count: 19 Times Cited: 0 Publisher: ELSEVIER IRELAND LTD Publisher Address: ELSEVIER HOUSE, BROOKVALE PLAZA, EAST PARK SHANNON, CO, CLARE, 00000, IRELAND ISSN: 0966-6362 29-char Source Abbrev.: GAIT POSTURE ISO Source Abbrev.: Gait Posture Source Item Page Count: 5 Subject Category: Neurosciences; Orthopedics; Sport Sciences ISI Document Delivery No.: 299CF ANDERSEN J J MICROBIOL IMMUNOL 39 : 436 2006 BOLLEN J J STATUS SCIENTOMETR 69 : 1 2006 CAMERON BD LIB ACAD 5 : 105 2005 DONOHUE JM A multi-method evaluation of journals in the decision and management sciences by US academics OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE 28 : 17 2000 DUL J Objective and subjective rankings of scientific journals in the field of ergonomics: 2004-2005 HUMAN FACTORS AND ERGONOMICS IN MANUFACTURING 15 : 327 2005 FALAGAS ME ACTA TROP 99 : 155 2006 FOSTER WR IMPACT FACTOR AS THE BEST OPERATIONAL MEASURE OF MEDICAL JOURNALS LANCET 346 : 1301 1995 FRANKLIN J Revision and complication rates in 654 Exeter total hip replacements, with a maximum follow-up of 20 years BMC MUSCULOSKELETAL DISORDERS 4 : ARTN 6 2003 GARFIELD E The history and meaning of the journal impact factor JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 295 : 90 2006 GILMONTOYA JA World dental research production: an ISI database approach (1999-2003) EUROPEAN JOURNAL OF ORAL SCIENCES 114 : 102 2006 HAMILTON S THE JOURNAL COMMUNICATION-SYSTEM FOR MIS RESEARCH DATA BASE 14 : 3 1983 JONES AW The distribution of forensic journals, reflections on authorship practices, peer-review and role of the impact factor FORENSIC SCIENCE INTERNATIONAL 165 : 115 DOI 10.1016/j.forsciint.2006.05.013 2007 KURMIS AP Current concepts review - Understanding the limitations of the journal impact factor JOURNAL OF BONE AND JOINT SURGERY-AMERICAN VOLUME 85 : 2449 2003 NEDERHOF AJ DEVELOPMENT OF BIBLIOMETRIC INDICATORS FOR UTILITY OF RESEARCH TO USERS IN SOCIETY - MEASUREMENT OF EXTERNAL KNOWLEDGE TRANSFER VIA PUBLICATIONS IN TRADE JOURNALS SCIENTOMETRICS 32 : 37 1995 SAHA S Impact factor: a valid measure of journal quality? JOURNAL OF THE MEDICAL LIBRARY ASSOCIATION 91 : 42 2003 SEGLEN PO BRIT MED J 314 : 497 1997 SELLERS SL Evaluation of social work journal quality: Citation versus reputation approaches JOURNAL OF SOCIAL WORK EDUCATION 40 : 143 2004 SMITH R Unscientific practice nourishes in science BRITISH MEDICAL JOURNAL 316 : 1036 1998 STARBUCK WH How much better are the most-prestigious journals? The statistics of academic publication ORGANIZATION SCIENCE 16 : 180 DOI 10.1287/orsc.1040.0107 2005 From garfield at CODEX.CIS.UPENN.EDU Thu Jun 5 12:30:53 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 5 Jun 2008 12:30:53 -0400 Subject: Ausloos, M; Lambiotte, R; Scharnhorst, A; Hellsten, I Andrzej Pekalski networks of scientific intersets with internal degrees of freedom through self-citation analysis INTL JOUR OF MODERN PHYSICS C, 19 (3): 371-384 MAR 2008 Message-ID: E-mail Address: Marcel.Ausloos at ulg.ac.be; Renaud.Lambiotte at ulg.ac.be; andrea.scharnhorst at vks.knaw.nl; iina.hellsten at falw.vu.nl Author(s): Ausloos, M (Ausloos, M.); Lambiotte, R (Lambiotte, R.); Scharnhorst, A (Scharnhorst, A.); Hellsten, I (Hellsten, I.) Title: Andrzej Pekalski networks of scientific intersets with internal degrees of freedom through self-citation analysis Source: INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 19 (3): 371-384 MAR 2008 Language: English Document Type: Article Author Keywords: scientometry; sex male; network; publications; citations; optimal percolation method Keywords Plus: MAGNETIC LATTICE-GAS; EVOLVING POPULATION; OXYGEN DIFFUSION; MONTE-CARLO; MODEL; TEMPERATURE; EVOLUTION; DYNAMICS Abstract: Old and recent theoretical works by Andrzej Pekalski (APE) are recalled as possible sources of interest for describing network formation and clustering in complex (scientific) communities, through self- organization and percolation processes. Emphasis is placed on APE self- citation network over four decades. The method is that used for detecting scientists' field mobility by focusing on author's self-citation, co- authorships and article topics networks as in Refs. 1 and 2. It is shown that APE's self-citation patterns reveal important information on APE interest for research topics over time as well as APE engagement on different scientific topics and in different networks of collaboration. Its interesting complexity results from "degrees of freedom" and external fields leading to so called internal shock resistance. It is found that APE network of scientific interests belongs to independent clusters and occurs through rare or drastic events as in irreversible "preferential attachment processes", similar to those found in usual mechanics and thermodynamics phase transitions. Addresses: GRAPES, B-4000 Liege, Belgium; VKS KNAW, Royal Netherlands Acad Arts & Sci, Virtual Knowledge Studio Human & Social Sci, NL-1019 AT Amsterdam, Netherlands; Fac Earth & Life Sci FALW, NL-1018 HV Amsterdam, Netherlands Reprint Address: Ausloos, M, GRAPES, B5a Sart Tilman, B-4000 Liege, Belgium. E-mail Address: Marcel.Ausloos at ulg.ac.be; Renaud.Lambiotte at ulg.ac.be; andrea.scharnhorst at vks.knaw.nl; iina.hellsten at falw.vu.nl Cited Reference Count: 40 Times Cited: 0 Publisher: WORLD SCIENTIFIC PUBL CO PTE LTD Publisher Address: 5 TOH TUCK LINK, SINGAPORE 596224, SINGAPORE ISSN: 0129-1831 29-char Source Abbrev.: INT J MOD PHYS C ISO Source Abbrev.: Int. J. Mod. Phys. C Source Item Page Count: 14 Subject Category: Computer Science, Interdisciplinary Applications; Physics, Mathematical ISI Document Delivery No.: 300RJ AUSLOOS M Drastic events make evolving networks EUROPEAN PHYSICAL JOURNAL B 57 : 89 DOI 10.1140/epjb/e2007-00159-6 2007 AUSLOOS M MAGNETIC EDEN MODEL EUROPHYSICS LETTERS 24 : 629 1993 AUSLOOS M PHASE-DIAGRAMS OF MODEL MAGNETO-FLUIDS IEEE TRANSACTIONS ON MAGNETICS 16 : 233 1980 AUSLOOS M ONE-DIMENSIONAL RANDOM MAGNETIC LATTICE GAS JOURNAL OF MAGNETISM AND MAGNETIC MATERIALS 39 : 21 1983 AUSLOOS M LECTURE NOTES PHYSIC 438 : 221 1994 AUSLOOS M SIMPLE-MODEL OF A DISORDERED MAGNETIC LATTICE GAS PHYSICAL REVIEW A 28 : 3080 1983 AUSLOOS M MAGNETIC LATTICE GAS PHYSICAL REVIEW A 22 : 2218 1980 AUSLOOS M MODEL OF OXYGEN DIFFUSION IN YBA2CU3O6+X WITH NEXT-NEAREST-NEIGHBOR HOPPING - A MONTE-CARLO STUDY PHYSICAL REVIEW B 52 : 4577 1995 AUSLOOS M Model of wealth and goods dynamics in a closed market PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS 373 : 560 DOI 10.1016/j.physa.2006.04.112 2007 AUSLOOS M Lattice gas model of gradual evolution PHYSICA A 248 : 155 1998 AUSLOOS M PHYSICAL-PROPERTIES OF A SPIN MODEL DESCRIBED BY AN EFFECTIVE HAMILTONIAN WITH 2 KINDS OF RANDOM MAGNETIC BONDS SOLID STATE COMMUNICATIONS 26 : 977 1978 CEBRAT S The role of dominant mutations in the population expansion COMPUTATIONAL SCIENCE - ICCS 2004, PROCEEDINGS 3039 : 765 2004 DROZ M MEAN-FIELD LIKE RENORMALIZATION-GROUP STUDY OF RANDOM 2-COMPONENT MAGNETIC SYSTEMS PHYSICS LETTERS A 107 : 89 1985 DROZ M Different strategies of evolution in a predator-prey system PHYSICA A 298 : 545 2001 FOWLER JH Does self-citation pay? SCIENTOMETRICS 72 : 427 2007 FRONCZAK P Analysis of scientific productivity using maximum entropy principle and fluctuation-dissipation theorem PHYSICAL REVIEW E 75 : ARTN 026103 2007 HELLSTEN I IRREVERSIBLE PROZESS : 375 2006 HELLSTEN I Self-citations, co-authorships and keywords: A new approach to scientists' field mobility? SCIENTOMETRICS 72 : 469 DOI 10.1007/s11192-007-1680-5 2007 HUCKABY DA PHASE-TRANSITIONS IN LATTICE GASES OF ORIENTABLE MOLECULES PHYSICAL REVIEW A 26 : 3528 1982 LAMBIOTTE R On the genre-fication of music: a percolation approach EUROPEAN PHYSICAL JOURNAL B 50 : 183 DOI 10.1140/epjb/e2006-00115-0 2006 LAMBIOTTE R Uncovering collective listening habits and music genres in bipartite networks PHYSICAL REVIEW E 72 : ARTN 066107 2005 LEYDESDORFF L DIMENSIONS OF CITATION ANALYSIS SCIENCE TECHNOLOGY & HUMAN VALUES 15 : 305 1990 MACROBERTS MH PROBLEMS OF CITATION ANALYSIS - A CRITICAL-REVIEW JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 40 : 342 1989 MROZ I Conditions for adaptation of an evolving population PHYSICAL REVIEW LETTERS 76 : 3025 1996 NEWMAN MEJ The structure of scientific collaboration networks PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 98 : 404 2001 PABJAN B Model of prison riots PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS 375 : 307 DOI 10.1016/j.physa.2006.08.069 2007 PASTERKAMP G Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles SCIENTOMETRICS 70 : 153 DOI 10.1007/s11192-007-0109-5 2007 PEKALSKI A ACTA PHYS POLOM 30 : 839 1966 PEKALSKI A A short guide to predator-prey lattice models COMPUTING IN SCIENCE & ENGINEERING 6 : 62 2004 PEKALSKI A LECT NOTES PHYS 438 : 1994 PEKALSKI A LECT NOTES PHYS 206 : 1984 PEKALSKI A A model of population dynamics PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS 252 : 325 1998 PEKALSKI A CRITICAL-TEMPERATURE OF INHOMOGENEOUS MIXTURES OF ISING AND HEISENBERG SUBSTANCES PHYSICA A 101 : 507 1980 PEKALSKI A MONTE-CARLO SIMULATION OF OXYGEN DIFFUSION IN PLANAR MODEL OF 123-YBCO - LOW-TEMPERATURE REGIME AND EFFECT OF TRAPPING BARRIER PHYSICA C 226 : 188 1994 PERSSON O LOCATING THE NETWORK OF INTERACTING AUTHORS IN SCIENTIFIC SPECIALTIES SCIENTOMETRICS 33 : 351 1995 SANYAL S EFFECT CITATION PATT : SCHREIBER M EPL-EUROPHYS LETT 78 : 30002 2007 SZNAJDWERON K Statistical physics model of an evolving population PHYSICA A 274 : 91 1999 VANDEWALLE N MAGNETIC DIFFUSION-LIMITED AGGREGATION PHYSICAL REVIEW E 51 : 597 1995 WOUTERS P THESIS U AMSTERDAM : 1999 From garfield at CODEX.CIS.UPENN.EDU Thu Jun 5 16:06:41 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 5 Jun 2008 16:06:41 -0400 Subject: Machacek, M (Machacek, Martin); Kolcunova, E (Kolcunova, Eva) Hirsch index and rankings of Czech economists POLITICKA EKONOMIE, 56 (2): 229-241 2008 Message-ID: E-mail Address: martin.machacek at vsb.cz; eva.kolcunova at vsb.cz Author(s): Machacek, M (Machacek, Martin); Kolcunova, E (Kolcunova, Eva) Title: Hirsch index and rankings of Czech economists Source: POLITICKA EKONOMIE, 56 (2): 229-241 2008 Language: Czech Document Type: Article Author Keywords: bibliometric indicators; Hirsch index; Czech economists; rankings; international comparison Abstract: The article contributes to the growing body of literature dealing with the bibliometric evaluation of the Czech economic research. In particular, this article introduces a recently invented measure of both the scientific output-and impact - the Hirsch index (h) - into the Czech academic economics. While the theoretical part of the article contains a discussion of the strenghts and weaknesses of the Hirsch approach, the empirical part presents two original top50s of the Czech economists ranked by their individual h's. The first of our charts comes from the Web of Science's General Search dataset, and the second one reflects the use of the Web of Science's Cited Reference Search dataset. Both datasets cover the 1980-2006 period. It appears that the rate of correspondence among the top 25 economists in each chart and the top25 of the celebrated Turnovec's citation-based ranking (2005) amounts to 60%. In addition, our empirical results reveal that the elite Czech economists attain h's being 3-10 times lower than the h's of the foreign academic "superstars". Addresses: Tech Univ Ostrava, VSB, CZ-70121 Ostrava, Czech Republic Reprint Address: Machacek, M, Tech Univ Ostrava, VSB, Sokolska Tr 33, CZ- 70121 Ostrava, Czech Republic. E-mail Address: martin.machacek at vsb.cz; eva.kolcunova at vsb.cz Cited Reference Count: 15 Times Cited: 0 Publisher: VYSOKA SKOLA EKONOMICKA Publisher Address: NAM W CHURCHILLA 4, PRAGUE 13067, CZECH REPUBLIC ISSN: 0032-3233 29-char Source Abbrev.: POLIT EKON ISO Source Abbrev.: Polit. Ekon. Source Item Page Count: 13 Subject Category: Economics; Political Science ISI Document Delivery No.: 295TE BANKS MG SCIENTOMETRICS 2006 : 161 2006 BATISTA PD SCIENTOMETRICS 2005 : 179 2006 CAHLIK T VYR K CESK SPOL EK P : 2006 EGGHE L SCIENTOMETRICS 2006 : 121 2006 EGGHE L SCIENTOMETRICS 2006 : 131 2006 FAKTOR I VESMIR 2006 : 555 2006 GLANZEL W SCIENTOMETRICS 2006 : 315 2006 HIRSCH JE An index to quantify an individual's scientific research output PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 102 : 16569 DOI 10.1073/pnas.0507655102 2005 LIANG L SCIENTOMETRICS : 153 2006 MACHACEK M FINANC UVER : 563 2005 MACHACEK M VYR K CESK SPOL EK P : 2006 MACHACEK M VYROCI UMRTI JOAN VI : 135 2004 MUNICH D FINANC UVER : 522 2006 OSWALD AJ ECONOMICA : 21 2007 TURNOVEC F FINANC UVER : 531 2005 From garfield at CODEX.CIS.UPENN.EDU Fri Jun 6 11:54:50 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Fri, 6 Jun 2008 11:54:50 -0400 Subject: Da Rocha, FF et al Brazilian scientific production in the 40 psychiatric journals with high impact factor in 2006 REVISTA DA ASSOCIACAO MEDICA BRASILEIRA, 53 (6): 543-546 NOV-DEC 2007 Message-ID: Email Address: fil_bh at yahoo.com.br Author(s): Da Rocha, FF (Da Rocha, Felipe Filardi); Fuscaldi, T (Fuscaldi, Thiago); Castro, V (Castro, Viviam); Do Carmo, W (Do Carmo, William); Amaral, D (Amaral, Debora); Correa, H (Correa, Humberto) Title: Brazilian scientific production in the 40 psychiatric journals with high impact factor in 2006 Source: REVISTA DA ASSOCIACAO MEDICA BRASILEIRA, 53 (6): 543-546 NOV-DEC 2007 Language: Portuguese Document Type: Article Author Keywords: bibliometric analyses; journals; psychiatry; research; impact factor Keywords Plus: MENTAL-HEALTH RESEARCH; UNIVERSITIES Abstract: OBJECTIVE. The Brazilian scientific production published in 2006 in the twenty psychiatric Journals with high impact factor (IF) according to the journal of Citation Report (JCR), 2006, was evaluated. METHODS. All articles from 94 journals with an IF higher than the average (n = 40) were selected. We assessed the articles that had at least one author affiliated to a Brazillan institutions as well as those with only Brazilian authors or a first1senior author belonging to a Brazillian Institution. Secondly, the distribution of the author(s) by state was determined RESULTS. Among 7996 articles surveyed 96 (1.20%) had at least one author from a Brazilian institution and in eight, the first senior author belonged to a Brazillian institution, not including the 59 publications that were written only by Brazillan authors. The distribution by state showed Sao Paulo as ranking first with 46 articles (479196) and absolute predominance of the South-Southeast region (98.95%). CONCLUSION. Although, Brazillian publications on psychiatry had demonstrated apparent quantitative and qualitative growth, Scientific production on the subject remains highly concentrated in a few states. Addresses: Univ Fed Minas Gerais, Fac Med, Dept Saude Mental, BR-30130100 Belo Horizonte, MG, Brazil Reprint Address: Correa, H, Univ Fed Minas Gerais, Fac Med, Dept Saude Mental, Av Alfredo Balena 190, BR-30130100 Belo Horizonte, MG, Brazil. Cited Reference Count: 11 Times Cited: 1 Publisher: ASSOC MEDICA BRASILEIRA Publisher Address: RUA SAO CARLOS DO PINHAL 324, CAIXA POSTAL 8904, SAO PAULO, SP, BRAZIL ISSN: 0104-4230 29-char Source Abbrev.: REV ASSOC MED BRAS ISO Source Abbrev.: Rev. Assoc. Med. Bras. Source Item Page Count: 4 ISI Document Delivery No.: 300TM BRESSAN RA The modest but growing Brazilian presence in psychiatric, psychobiological and mental health research: assessment of the 1998-2002 period BRAZILIAN JOURNAL OF MEDICAL AND BIOLOGICAL RESEARCH 38 : 649 2005 DAROCHA FF REV BRAS PSIQUIATR : 2007 GALILEU D J BRAS PSIQUIATR 55 : 120 2006 GARFIELD E SCI J CITATION REPOR : 1995 GUIMARAES J CIENC SAUDE COLETIVA 9 : 307 2004 KIELING C Assessing the quality of a scientific journal: the case of Revista Brasileira de Psiquiatria REVISTA BRASILEIRA DE PSIQUIATRIA 29 : 177 2007 KING DA The scientific impact of nations NATURE 430 : 311 DOI 10.1038/430311a 2004 MARI JJ REV BRAS PSIQUIATR 24 : 61 2002 RAZZOUK D Leading countries in mental health research in Latin America and the Caribbean REVISTA BRASILEIRA DE PSIQUIATRIA 29 : 118 2007 VELLOSO A Concentration of science in Brazilian governmental universities SCIENTOMETRICS 61 : 207 2004 ZORZETTO R The scientific production in health and biological sciences of the top 20 Brazilian universities BRAZILIAN JOURNAL OF MEDICAL AND BIOLOGICAL RESEARCH 39 : 1513 2006 From garfield at CODEX.CIS.UPENN.EDU Fri Jun 6 12:30:24 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Fri, 6 Jun 2008 12:30:24 -0400 Subject: Kwon, O; Seo, J; Noh, K; Kim, J; Kim, JS; Shin, SY Categorizing influential patents using bibliometric analysis of patent citations network INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 10 (3): 313-326 MAY 2007 Message-ID: E-mail Address: dbajin at kisti.re.kr; jinny at kisti.re.kr; infor at kisti.re.kr; aresto at kisti.re.kr; jskim at venus.uos.ac.kr; sung.shin at sdstate.edu Author(s): Kwon, O (Kwon, OhJin); Seo, J (Seo, Jinny); Noh, K (Noh, KyoungRan); Kim, J (Kim, JeongHo); Kim, JS (Kim, Jin Suk); Shin, SY (Shin, Sung Y.) Title: Categorizing influential patents using bibliometric analysis of patent citations network Source: INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 10 (3): 313-326 MAY 2007 Language: English Document Type: Article Author Keywords: bibliographic coupling; co-citation analysis; influential patent search Abstract: Recently, research for network has been actively progressing. Internet, bio-metabolic, and coauthor networks of scientific thesis has a decreasing distribution to power law. However, researches on network utilizing patent information have not been very active. It suggests the method calculating large sparse matrix by supercomputer, examining patent network distribution by bibliographic coupling and co-citation, and identifying influential patents. The majority of studies, which are targeted to find Hub patents, are using the number of forward citation of patents. Yet the most recent technological convergences among different fields have been enforced, and the development of this fusion technology has been rapidly progressing. Therefore the forward citation of patent occurs in the applicable field of technologies as well as in other fields of technology; the method to find influential patents within the applicable field of technology is using only the number of forward citation of patents that may cause severe distortions. This study will explore three types of influential patents by minimizing the distortion phenomenon accompanied by the number of patent forward citation. To serve this purpose, the patent classification method is using bibliographic coupling and co-citation analysis used in knowledge search. Addresses: KISTI, Seoul, South Korea; Univ Seoul, Seoul, South Korea; S Dakota State Univ, EE & CS Dept, Brookings, SD 57007 USA Reprint Address: Kwon, O, KISTI, 206-9 CheongRangri Dong, Seoul, South Korea. E-mail Address: dbajin at kisti.re.kr; jinny at kisti.re.kr; infor at kisti.re.kr; aresto at kisti.re.kr; jskim at venus.uos.ac.kr; sung.shin at sdstate.edu Cited Reference Count: 14 Times Cited: 0 Publisher: INT INFORMATION INST Publisher Address: FAC ENG, HOSEI UNIV, KOGANEI, TOKYO, 184-8584, JAPAN ISSN: 1343-4500 29-char Source Abbrev.: INFORMATION ISO Source Abbrev.: Information Source Item Page Count: 14 ISI Document Delivery No.: 293KT BLACKFORD S BALS TECHNICAL FORUM : 2001 BREITZMAN AF The many applications of patent analysis JOURNAL OF INFORMATION SCIENCE 28 : 187 2002 BRESCHI S CESPRI : 1 2004 GARFIELD E SOCIAL SCI CITATION : 2003 JAFFE AB NBER WORKING PAPER S 6507 : 1998 JAFFE AB GEOGRAPHIC LOCALIZATION OF KNOWLEDGE SPILLOVERS AS EVIDENCED BY PATENT CITATIONS QUARTERLY JOURNAL OF ECONOMICS 108 : 577 1993 KARKI MMS WORLD PATENT INFORMA 19 : 269 1997 KESSLER MM BIBLIOGRAPHIC COUPLING BETWEEN SCIENTIFIC PAPERS AMERICAN DOCUMENTATION 14 : 10 1963 KIM HH KOOMITRADE : 132 1993 KWON OJ 2005 IPMS ANN C 2005 77 KWON OJ KOSTI : 689 2005 OGAWA T FINDING BASIC PATENT : 41 2005 TRIPPE AJ WORLD PATENT INFORM 25 : 211 2003 VANRAAN AFJ Reference-based publication networks with episodic memories SCIENTOMETRICS 63 : 549 DOI 10.1007/s11192-005-0227-x 2005 From loet at LEYDESDORFF.NET Sat Jun 7 05:57:30 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Sat, 7 Jun 2008 11:57:30 +0200 Subject: Online programs for scientometric analyses upgraded for Vista Message-ID: Dear colleagues, I upgraded my programs at the website (e.g., www.leydesdorff.net/indicators/index.htm ) for the Vista environment. There may still be incompatibilities. Please, let me know if you run into problems. (It is often just a single line of code.) With best wishes, Loet ________________________________ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net From loet at LEYDESDORFF.NET Sun Jun 8 04:16:53 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Sun, 8 Jun 2008 10:16:53 +0200 Subject: Scopus data and ISI-formats Message-ID: Scopus to ISI-format (Scop2ISI.exe at ) This program enables one to read a file which is exported from the Scopus database in the csv-format. The input file should be named scopus.csv. The program and the input file should be in the same folder (directory). The program produces a file isi.txt which contains the information in the tagged-format of the ISI output. This file can be used as input to most of my programs. (The file has to be renamed to data.txt for this purpose.) See for further programs at http://www.leydesdorff.net/indicators/index.htm . One major difference between the Scopus and ISI output is the use of the abbreviated journal names in the ISI output. These are used in the cited references by the ISI, but Scopus uses the full journal names. The program BibJourn.Exe is affected by this difference. (HistCiteT hitherto has the same problem.) I have not yet made a version of this routine for Scopus data. The other routines should work smoothly like in the case of ISI data. The current version is in the development phase. Please, feel free to feedback with suggestions for improvements. ________________________________ Loet Leydesdorff, Amsterdam School of Communications Research (ASCoR), Kloveniersburgwal 48, 1012 CX Amsterdam; loet at leydesdorff.net From lutz.bornmann at GESS.ETHZ.CH Mon Jun 9 11:24:53 2008 From: lutz.bornmann at GESS.ETHZ.CH (Bornmann Lutz) Date: Mon, 9 Jun 2008 17:24:53 +0200 Subject: New paper Message-ID: Dear colleague, Please find attached a recently published paper (pdf-file) that might be of interest to you: "Reliability, fairness, and predictive validity of the peer review process for the selection of research fellowship recipients of the Boehringer Ingelheim Fonds." The paper is published in the book: Barbara M. Kehm (Ed.), Hochschule im Wandel. Die Universit?t als Forschungsgegenstand. Festschrift f?r Ulrich Teichler (p. 365-376), 2008, Frankfurt am Main: Campus. Sincerely yours, Lutz Bornmann ------------------------------------------------------------------------------------------------------------- Dr. Lutz Bornmann ETH Zurich, D-GESS Professorship for Social Psychology and Research on Higher Education Zaehringerstr. 24 / ZAE CH-8092 Zurich Phone: 0041 44 632 48 25 Fax: 0041 44 632 12 83 http://www.psh.ethz.ch/ bornmann at gess.ethz.ch Download of publications: www.lutz-bornmann.de/Publications.htm -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Datei.pdf Type: application/pdf Size: 104380 bytes Desc: Datei.pdf URL: From garfield at CODEX.CIS.UPENN.EDU Mon Jun 9 16:43:13 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 9 Jun 2008 16:43:13 -0400 Subject: Cappell, MS; et al A significant decline in the Amer domination of research in gastro with increasing globalization from 1980 to 2005: An analysis of Amer authorship among 8,251 articles AMER JOUR OF GASTRO, 103 (5): 1065-1074 MAY 2008 Message-ID: E-mail Addresses: mscappell at yahoo.com Author(s): Cappell, MS (Cappell, Mitchell S.); Davis, M (Davis, Michael) Title: A significant decline in the American domination of research in gastroenterology with increasing globalization from 1980 to 2005: An analysis of American authorship among 8,251 articles Source: AMERICAN JOURNAL OF GASTROENTEROLOGY, 103 (5): 1065-1074 MAY 2008 Language: English Document Type: Editorial Material Keywords Plus: NONTEACHING HOSPITALS; SURGICAL JOURNALS; INTERNATIONALIZATION; REPRESENTATION; ROENTGENOLOGY; RADIOLOGY; TRENDS; IMPACT Abstract: AIM: To determine whether the relative American contribution to gastroenterology research, as determined by authorship in journals, decreased from 1980 to 2005. METHODS: Country of residence for authors was manually determined for 8,251 articles, encompassing every gastroenterologic article published in 1980 and 2005 in nine gastroenterology and four leading medical journals (8 American and 5 European journals). Country of residence was also determined for all editorial board members for the same years in the same journals. RESULTS: In all eight analyzed American journals, the relative frequency of non-American authors significantly and sharply increased from 1980 to 2005, and of American authors correspondingly decreased. The effect was invariant: (a) regardless of journal field: general medicine (e.g., N Engl J Med, from 10.1% in 1980 to 27.2% in 2005, odds ratio [OR] 3.34, OR confidence interval [CI] 2.40-4.62, P < 0.0001) versus general gastroenterology (e.g., Am J Gastroenterol, from 20.8% in 1980 to 51.9% in 2005, OR 4.29, OR CI 2.81-6.55, P < 0.0001); (b) regardless of journal gastroenterology subspecialty (e.g., Hepatology vs Endoscopy); (c) regardless of journal circulation: high circulation (e.g., Ann Intern Med, OR 3.50, OR CI 2.05-5.96, P < 0.0001) versus lower circulation (e.g., J Clin Gastroenterol, OR 6.88, OR CI 2.86-16.5, P < 0.0001); (d) regardless of journal impact factor: high impact (e.g., N Engl J Med, see above) versus lower impact (e.g., Dig Dis Sci, OR 3.06, OR CI 2.08-4.51, P < 0.0001); (e) regardless of article topic within a journal (e.g., colon vs upper gastrointestinal tract); (f) regardless of article length within a journal; (g) regardless of number of authors per article or order of authorship; and (h) regardless of whether international representation on the journal's editorial board increased (e.g., Am J Gastroenterol) or decreased (J Clin Gastroenterol) from 1980 to 2005. Contrariwise, in three of five analyzed European journals, the opposite effect occurred: the relative frequency of non-American authors statistically significantly decreased from 1980 to 2005 (e.g., Aliment Pharmacol Ther, from 87.9% in 1980 to 75.9% in 2005, OR 0.43, OR CI 0.20-0.94, P < 0.033), and of Americans authors correspondingly increased. The same trend generally held for the editorial boards of analyzed journals: the relative frequency of non-American board members significantly increased in five American journals (e.g., Am J Gastroenterol, from 4.2% in 1980 to 31.3% in 2005, OR 10.5, OR CI 1.68-63.5, P= 0.006), and decreased in all five analyzed European journals. Interstate and transnational collaborations (coauthorship) increased in publications from 1980 to 2005 (e.g., transnational, from 2.8% in 1980 to 14.1% in 2005 in N Engl J Med, OR 5.62, OR CI 3.25-9.73, P < 0.0001). CONCLUSIONS: From 1980 to 2005, American representation in American gastroenterologic journals significantly declined, whereas American representation in European gastroenterologic journals moderately increased. The latter finding, together with increased transnational collaboration and increased international representation in editorial boards, suggests that increasing globalization of information, partly due to computers and the Internet, may be an important etiologic factor. This may result in an improving quality of research performed outside America. Other potential etiologic factors include improving standard of living outside America and increasing clinical volume of academic gastroenterologists in America. Addresses: William Beaumont Hosp, Div Gastroenterol, Royal Oak, MI 48073 USA; Albert Einstein Med Ctr, Dept Internal Med, Philadelphia, PA 19141 USA Reprint Address: Cappell, MS, William Beaumont Hosp, Div Gastroenterol, MOB 233,3601 W Thirteen Mile Rd, Royal Oak, MI 48073 USA. Cited Reference Count: 33 Times Cited: 0 Publisher: BLACKWELL PUBLISHING Publisher Address: 9600 GARSINGTON RD, OXFORD OX4 2DQ, OXON, ENGLAND ISSN: 0002-9270 29-char Source Abbrev.: AMER J GASTROENTEROL ISO Source Abbrev.: Am. J. Gastroenterol. Source Item Page Count: 10 Subject Category: Gastroenterology & Hepatology ISI Document Delivery No.: 299IT *NAT AC SCI NAT AC RIS GATH STORM EN EM : 2005 *US DEP HHS PUBL US DEP HHS : 2006 *US DEP LAB CAR GUID IND 2006 07 : ANTMAN KH DECLINING AMERICAN REPRESENTATION IN LEADING CLINICAL-RESEARCH JOURNALS NEW ENGLAND JOURNAL OF MEDICINE 323 : 610 1990 CAREK PJ Does community- or university-based residency sponsorship affect future practice profiles? FAMILY MEDICINE 34 : 592 2002 CHEN MY Internationalization of the American journal of roentgenology: 1980-2002 AMERICAN JOURNAL OF ROENTGENOLOGY 181 : 907 2003 ELSTER AD THE INTERNATIONALIZATION OF THE AMERICAN JOURNAL OF ROENTGENOLOGY - 1980- 1992 AMERICAN JOURNAL OF ROENTGENOLOGY 162 : 519 1994 FLEISS JL STAT METHODS RATES P : 1981 FRIEDMAN TL WORLD IS FLAT BRIEF : 2005 KEEFFE EB Presidential address GASTROENTEROLOGY 129 : 2096 DOI 10.1053/j.gastro.2005.10.045 2005 KING DA The scientific impact of nations NATURE 430 : 311 DOI 10.1038/430311a 2004 KOLBITSCH C National publication output in medical research ANASTHESIOLOGIE INTENSIVMEDIZIN NOTFALLMEDIZIN SCHMERZTHERAPIE 34 : 214 1999 KUPERSMITH J Quality of care in teaching hospitals: A literature review ACADEMIC MEDICINE 80 : 458 2005 LEMONICK M TIME MAGAZINE 0213 : 2006 LIPPE B DECLINING AMERICAN REPRESENTATION IN LEADING CLINICAL-RESEARCH JOURNALS NEW ENGLAND JOURNAL OF MEDICINE 323 : 609 1990 LUMB PD The world federation: Enhancing global critical care practice and performance CRITICAL CARE CLINICS 22 : 383 DOI 10.1016/j.ccc.2006.03.002 2006 MEZRICH R DECLINING AMERICAN REPRESENTATION IN LEADING CLINICAL-RESEARCH JOURNALS NEW ENGLAND JOURNAL OF MEDICINE 323 : 610 1990 MOORE JD MODERN HEALTHCARE 29 : 34 1999 NAHRWOLD DL UNITED-STATES RESEARCH PUBLISHED IN MAJOR SURGICAL JOURNALS IS DECREASING ANNALS OF SURGERY 222 : 263 1995 PATEL V International representation in psychiatric literature - Survey of six leading journals BRITISH JOURNAL OF PSYCHIATRY 178 : 406 2001 POLANCZYK CA Hospital outcomes in major teaching, minor teaching, and nonteaching hospitals in New York state AMERICAN JOURNAL OF MEDICINE 112 : 255 2002 RAHMAN M PUBLIC HLTH 117 : 278 2003 RAY CE Changes in the american interventional radiology literature: Comparison over a 10-year time period CARDIOVASCULAR AND INTERVENTIONAL RADIOLOGY 29 : 599 DOI 10.1007/s00270- 005-0209-7 2006 ROGERS LF Globalization: Trends in the Editorial content of the AJR AMERICAN JOURNAL OF ROENTGENOLOGY 177 : 745 2001 ROSENTHAL GE Severity-adjusted mortality and length of stay in teaching and nonteaching hospitals - Results of a regional study JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 278 : 485 1997 STANLEY RJ The European Congress of Radiology AMERICAN JOURNAL OF ROENTGENOLOGY 186 : 1215 DOI 10.2214/AJR.06.5046 2006 STERN RS Growth of international contributors to dermatologic literature ARCHIVES OF DERMATOLOGY 135 : 1074 1999 STOSSEL TP DECLINING AMERICAN REPRESENTATION IN LEADING CLINICAL-RESEARCH JOURNALS NEW ENGLAND JOURNAL OF MEDICINE 322 : 739 1990 SUMATHIPALA A BMC MED ETHICS 5 : E5 2004 SZOKOL JW Declining proportion of publications by American authors in major anesthesiology journals ANESTHESIA AND ANALGESIA 96 : 513 DOI 10.1213/01.ANE.0000041597.75561.A4 2003 TAYLOR GA Impact of clinical volume on scholarly activity in an academic children's hospital: trends, implications, and possible solutions PEDIATRIC RADIOLOGY 31 : 786 2001 TOMPKINS RK Internationalization of general surgical journals - Origin and content of articles published in North America and Great Britain from 1983 to 1998 ARCHIVES OF SURGERY 136 : 1345 2001 YANKAUER A DECLINING AMERICAN REPRESENTATION IN LEADING CLINICAL-RESEARCH JOURNALS NEW ENGLAND JOURNAL OF MEDICINE 323 : 609 1990 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 10 10:52:48 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 10 Jun 2008 10:52:48 -0400 Subject: Rutherford, BR; Hellerstein, DJ Divergent fates of the medical humanities in psychiatry and internal medicine: Should psychiatry be rehumanized? ACADEMIC PSYCHIATRY, 32 (3): 206-213 MAY-JUN 2008 Message-ID: E-mail Address: brr8 at columbia.edu Author(s): Rutherford, BR (Rutherford, Bret R.); Hellerstein, DJ (Hellerstein, David J.) Title: Divergent fates of the medical humanities in psychiatry and internal medicine: Should psychiatry be rehumanized? Source: ACADEMIC PSYCHIATRY, 32 (3): 206-213 MAY-JUN 2008 Language: English Document Type: Article Keywords Plus: STUDENTS; EMPATHY Abstract: objective: To determine the degree to which the medical humanities have been integrated into the fields of internal medicine and psychiatry, the authors assessed the presence of medical humanities articles in selected psychiatry and internal medicine journals from 1950 to 2000. Methods: The journals searched were the three highest-ranking psychiatry and internal medicine journals on the Institute for Scientific Information's Impact Factor rankings that were published in English and aimed at a clinical audience. Operationalized criteria defining the medical humanities allowed the percentage of text in the selected journals constituting medical humanities to be quantified. Journals were hand searched at 10-year intervals from 1950 to 2000. Mixed effects models were used to describe the change in medical humanities over time. Results: The percentage of text within psychiatry journals meeting the criteria for medical humanities declined from a peak of 17% in 1970 to a low of 2% in 2000, while the percentage of humanities articles in internal medicine journals roughly doubled from 5% to 11% over the same time period. A linear model increasing over time best fit the medical humanities in the internal medicine journals, while a cubic model decreasing overtime best fit the psychiatry humanities data. Humanities articles in medical journals had a greater breadth and diversity than those in psychiatry journals. Conclusion: Medical humanities publications dramatically decreased over time in psychiatry journals while they more than doubled in internal medicine journals. These data suggest the need for further empirical research and discussion of the potential roles of the humanities in psychiatry. Addresses: New York State Psychiat Inst & Hosp, Dept Psychiat, New York, NY 10032 USA; Adm New York State Psychiat Inst, New York, NY USA Reprint Address: Rutherford, BR, New York State Psychiat Inst & Hosp, Dept Psychiat, 1051 Riverside Dr,Box 98, New York, NY 10032 USA. E-mail Address: brr8 at columbia.edu Cited Reference Count: 37 Times Cited: 0 Publisher: AMER PSYCHIATRIC PUBLISHING, INC Publisher Address: 1000 WILSON BOULEVARD, STE 1825, ARLINGTON, VA 22209- 3901 USA ISSN: 1042-9670 29-char Source Abbrev.: ACAD PSYCHIATRY ISO Source Abbrev.: Acad. Psych. Source Item Page Count: 8 Subject Category: Education & Educational Research; Psychiatry ISI Document Delivery No.: 299XI BAKER A A randomized controlled trial of a smoking cessation intervention among people with a psychotic disorder AMERICAN JOURNAL OF PSYCHIATRY 163 : 1934 2006 BAUM M Teaching the humanities to medical students CLINICAL MEDICINE 2 : 246 2002 CHARON R Literature and medicine: Origins and destinies ACADEMIC MEDICINE 75 : 23 2000 CHARON R Reading, writing, and doctoring: Literature and medicine AMERICAN JOURNAL OF THE MEDICAL SCIENCES 319 : 285 2000 CHARON R LITERATURE AND MEDICINE - CONTRIBUTIONS TO CLINICAL-PRACTICE ANNALS OF INTERNAL MEDICINE 122 : 599 1995 CHARON R EMPATHY PRACTICE MED : 147 1993 CHARON R Narrative medicine - A model for empathy, reflection, profession, and trust JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 286 : 1897 2001 CHARON R Narrative and medicine NEW ENGLAND JOURNAL OF MEDICINE 350 : 862 2004 DASGUPTA S Personal illness narratives: Using reflective writing to teach empathy ACADEMIC MEDICINE 79 : 351 2004 DRUSS RG Piano sonata in a major AMERICAN JOURNAL OF PSYCHIATRY 163 : 195 2006 DUKAKIS K SHOCK HEALING POWER : 2006 ERNST E Life-threatening adverse reactions after acupuncture? A systematic review PAIN 71 : 123 1997 EVANS M Medical humanities at the University of Wales Swansea JOURNAL OF MEDICAL ETHICS 27 : 51 2001 GORDON J Medical humanities: to cure sometimes, to relieve often, to comfort always MEDICAL JOURNAL OF AUSTRALIA 182 : 5 2005 GREENHALGH T NARRATIVE BASED MED : 1998 HALPERN J DETACHED EMPATHY HUM : 2001 ILLICH L LIMITS MED MED NEMES : 1976 JAMISON KR TOUCHED FIRE MANIC D : 1996 JAMISON KR UNQUIET MIND : 1995 JONES E ESSAYS APPL PSYCHO A : 1951 KANDEL E BANQUET SPEECH NOBEL : 2000 KLEINMAN A ILLNESS NARRATIVES S : 1988 KRAEPELIN EK CLIN PSYCHIAT TXB ST : 1915 LEWIS B Listening to Chekhov: Narrative approaches to depression LITERATURE AND MEDICINE 25 : 46 2006 MORGAN DG 'Please see and advise': a qualitative study of patients' experiences of psychiatric outpatient care SOCIAL PSYCHIATRY AND PSYCHIATRIC EPIDEMIOLOGY 34 : 442 1999 NOVACK DH Toward creating physician-healers: Fostering medical students' self- awareness, personal growth, and well-being ACADEMIC MEDICINE 74 : 516 1999 OYEBODE F ADV PSYCHIAT TREAT 8 : 397 2002 PERRY S MEDICAL-STUDENTS SELECTING PSYCHIATRIC CAREERS - A DISTINCT BREED JOURNAL OF PSYCHIATRIC EDUCATION 12 : 170 1988 SACKS T MAN WHO MISTOOK HIS : 1985 SAPOLSKY R PRIMATES MEMOIR UNCO : 2002 SHORTER E HIST PSYCHIAT ERA AS : 1997 SKELTON JR Teaching literature and medicine to medical students, part II: why literature and medicine? LANCET 356 : 2001 2000 SNOW C 2 CULTURES SCI REVOL 1961 SOLOMON A NOONDAY DEMON ATLAS : 2002 STEVENS R AM MED PUBLIC INTERE : 1971 WALTER G AUST NZ J PSYCHIAT 23 : 547 1999 ZELEZNIK C J MED EDUC 52 : 548 1977 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 10 11:13:52 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 10 Jun 2008 11:13:52 -0400 Subject: Sutter, D (Sutter, Daniel); Pjesky, R (Pjesky, Rex) Where would Adam Smith publish today? The near absence of math-free research in top journals ECON JOURNAL WATCH, 4 (2): 230-U5 MAY 2007 Message-ID: E-mail Address: dssutter at utpa.edu; pjesky at nsuok.edu Author(s): Sutter, D (Sutter, Daniel); Pjesky, R (Pjesky, Rex) Title: Where would Adam Smith publish today? The near absence of math-free research in top journals Source: ECON JOURNAL WATCH, 4 (2): 230-U5 MAY 2007 Language: English Document Type: Article Keywords Plus: ACADEMIC ECONOMICS; UPDATE Abstract: IF HE WERE AROUND TODAY, WOULD ADAM SMITH BE ABLE TO PUBLISH in top economics journals, assuming he would want to? Our investigation shows that he would have serious difficulty unless he mastered some mathematical techniques and modes of thinking. Critics have accused top economics journals of being closed to math-free analysis and scholarship. If valid, such a closedness could significantly affect the economics profession. An inability to publish in prominent journals disadvantages kinds of thought and research that either do not much rely on math, or perhaps are compromised or degraded by math - for example, the kind of research that earned Nobel prizes for Myrdal, Hayek, Coase, Schelling, Buchanan, and that surely would have earned a prize for Keynes had he lived long enough. It appears that these pantheon economists in their prime today would be totally unable to place their classic works in top journals. Their contributions would fall to obscurity unless they could do the math, which they might well be able to do, and unless the substance and clarity would survive the make-over. The math modes tend to advantage individuals with the requisite human capital, mentalities, and characters. The combination of the pyramidal structure of the discipline and majoritarian department politics might make the selection effects long lived (Klein 2005). And with tenure, decisions made today could have impacts for decades to come. Economics is a field calling for exploration of how the accumulation of models, data, and other learning are best formulated and interpreted, and such exploration should involve diverse voices heterogeneous with respect to training. Few critics of formalism contend that there should not be any outlets or prestige for mathematical articles. Model building definitely has virtues, and regression analysis is obviously tremendously important, and we do not seek to denigrate these types of research. But scholars with a deep understanding of history, politics, policy analysis, law, and business, among other fields enrich the discipline. Such a heterogeneous cast of characters would produce diverse research. Economics is impoverished if only some types of learning reaches top journals and some of the diverse characters are permanently banished to the profession's back benches. In evaluating such concerns, it is good to have evidence on whether the top journals are open to math-free research. Sometimes commentators see patterns that do not exist. Consider the "hot hand" phenomenon in basketball. Many fans and announcers believe that players will get hot and go on a rush where they can hardly miss a shot. But Gilovich, Vallone and Tversky (1985) found no support for the hot hand. Faulty perceptions may also underlie charges of media bias. Vallone, Ross and Lepper (1985) found that highly partisan viewers of news segments on Israeli-Palestinian relations perceived bias against their side in the coverage, but the bias was in subjects' selective recall-remembering parts of stories favorable to the other side and forgetting bits favorable to their side. Our investigation seeks to qualify the current percentage of math-free papers in top journals to inform further debate. Several previous studies have examined the mathematical content of economics journals. Leontief (1982) found that over half of the papers in the American Economic Review between 1972 and 1981 contained mathematical models without data. Examining the 1980s, Morgan (1988) documented a similar pattern for the Economic journal and found that the percentage of math-free papers in the American Economic Review continued to fall. Examining four top general interest journals from 1963 through 1996, Coehlo and McClure (2005) found that mathematical research increased over time and that model-building crowded out empirical research. These papers focus on the balance of modeling and empirics. In the present paper, the primary distinction is that between math and "math-free" research. Math- free research in this paper means verbal or graphical analysis, case study evidence, and empirical work which does not rely on multiple regression analysis. Thus math articles here include not only model building but also papers with regression tables. However, our research does speak to the balance of modeling and empirics. Addresses: Univ Texas Pan Amer, Dept Econ & Finance, Edinburg, TX 78541 USA; Northeastern State Univ, Dept Accounting & Finance, Tahlequah, OK 74464 USA Reprint Address: Sutter, D, Univ Texas Pan Amer, Dept Econ & Finance, Edinburg, TX 78541 USA. E-mail Address: dssutter at utpa.edu; pjesky at nsuok.edu Cited Reference Count: 10 Times Cited: 1 Publisher: INST SPONTANEOUS ORDER ECONOMICS Publisher Address: 9745 KINGS CROWN COURT #102, FAIRFAX, VA 22031 USA ISSN: 1933-527X 29-char Source Abbrev.: ECON J WATCH ISO Source Abbrev.: Econ. J. Watch Source Item Page Count: 12 ISI Document Delivery No.: 299KW ANDERSON S ECON J WATCH 1 : 306 2004 COELHO PRP Theory versus application: Does complexity crowd out evidence? SOUTHERN ECONOMIC JOURNAL 71 : 556 2005 COUPE T J EUROPEAN EC ASS 1 : 1309 2003 GILOVICH T THE HOT HAND IN BASKETBALL - ON THE MISPERCEPTION OF RANDOM SEQUENCES COGNITIVE PSYCHOLOGY 17 : 295 1985 KLEIN DB ECON J WATCH 2 : 133 2005 KOCHER MG The institutional concentration of authors in top journals of economics during the last two decades ECONOMIC JOURNAL 111 : F405 2001 LEONTIEF W ACADEMIC ECONOMICS SCIENCE 217 : 104 1982 MORGAN T THEORY VERSUS EMPIRICISM IN ACADEMIC ECONOMICS - UPDATE AND COMPARISONS JOURNAL OF ECONOMIC PERSPECTIVES 2 : 159 1988 SCOTT LC Trends in rankings of economics departments in the US: An update ECONOMIC INQUIRY 34 : 378 1996 VALLONE RP THE HOSTILE MEDIA PHENOMENON - BIASED PERCEPTION AND PERCEPTIONS OF MEDIA BIAS IN COVERAGE OF THE BEIRUT MASSACRE JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY 49 : 577 1985 From Christina.Pikas at JHUAPL.EDU Wed Jun 11 09:56:02 2008 From: Christina.Pikas at JHUAPL.EDU (Pikas, Christina K.) Date: Wed, 11 Jun 2008 09:56:02 -0400 Subject: Forwarded from PAMnet: GENERAL: IMU on use and abuse of citation stats Message-ID: FYI (PAMnet is the e-mail list for the Physics-Astronomy-Mathematics Division of the Special Libraries Association) Christina -----Original Message----- From: PAMnet [mailto:PAMNET at LISTSERV.ND.EDU] On Behalf Of Carol Hutchins Sent: Wednesday, June 11, 2008 7:04 AM To: PAMNET at LISTSERV.ND.EDU Subject: GENERAL: IMU on use and abuse of citation stats -------- Original Message -------- IMU-Net 29b: June 2008 Special issue on "Citation Statistics", a report analyzing impact factors and similar statistics based on citations Dear colleagues, This is the first special issue of IMU-Net. Today the IMU has released an important document, called "Citation Statistics", which we want to bring to your attention. IMU-Net 24 (July 2007) announced the creation of a committee on "Quantitative assessment of research" that was asked to investigate various aspects of impact factors and similar statistics based on citations. The committee was appointed jointly by the Executive Committees of the International Mathematical Union (IMU), the International Council for Industrial and Applied Mathematics (ICIAM), and the Institute of Mathematical Statistics (IMS). It consisted of: - John Ewing (Providence, USA), chair, appointed by IMU - Robert Adler (Haifa, Israel), appointed by IMS - Peter Taylor (Melbourne, Australia), appointed by ICIAM. The terms of reference given to the committee can be found at: http://www.mathunion.org/Publications/2007/Charge-ComOnQuantAssessmRes07 0521.pdf The committee has addressed this charge by reviewing and discussing current practices along with an extensive literature on the use of citations to evaluate research. Its report, written from the perspective of mathematical scientists, was submitted to the Executive Committees of IMU, ICIAM, and IMS, and all three endorsed the report. The three organizations are making the report "Citation Statistics" public today. The report can be found at the following URL: http://www.mathunion.org/Publications/Report/CitationStatistics A press release that was mailed out today to journalists is at: http://www.mathunion.org/Publications/PressRelease/2008-06-11/CitationSt atistics This effort was triggered by numerous requests from IMU member countries, mathematical societies, important mathematical institutions, and individuals who reported the increasing use (and misuse) of impact factors and similarly of other citation-based indicators to measure the quality of research of individuals, departments, or whole institutions. IMU suggests that the readers of IMU-Net not only read the report but also distribute it to administrators and decision-makers who are involved in the assessment of research quality, in order to give them a mathematical science perspective. IMU, ICIAM and IMS have agreed that, in order to assure as wide distribution as possible, journals, newsletters and similar publications that are interested in publishing this report will have the non-exclusive right to publish it in one of their issues. Please contact the newsletters/journals you are connected with and suggest publication of the report "Citation Statistics". All 3 organizations, representing the world community of pure, applied, and industrial mathematics and statistics, hope that the careful analysis and recommendations in this report will be considered by decision-makers who are making use of citation data in research assessment. Best regards L. Lovasz IMU President ------------------------------------------------------------------------ IMU-Net is a Bimonthly Email Newsletter from the International Mathematical Union Editor: Mireille Chaleyat-Maurel, University Paris Descartes, Paris, France ------------------------------------------------------------------------ SUBSCRIBING TO IMU-NET There are two ways of subscribing to IMU-Net: 1. Click on http://www.mathunion.org/IMU-Net with a Web browser and go to the "Subscribe" button to subscribe to IMU-Net online. 2. Send an e-mail to imu-net-request at mathunion.org with the Subject-line: Subject: subscribe In both cases you will get an e-mail to confirm your subscription so that misuse will be minimized. IMU will not use the list of IMU-Net addresses for any purpose other than sending IMU-Net, and will not make it available to others. Previous issues can be seen at: http://www.mathunion.org/Publications/Newsletter/archive/ ________________________________________________________________________ ____ IMU-Net is the electronic newsletter of the International Mathematical Union. More details about IMU-Net can be found at: http://www.mathunion.org/IMU-Net/ You can find here, for instance, detailed information about subscribing to the IMU-Net mailing list and unsubscribing from it. From Jessica.Shepherd at GUARDIAN.CO.UK Wed Jun 11 10:12:11 2008 From: Jessica.Shepherd at GUARDIAN.CO.UK (Jessica Shepherd) Date: Wed, 11 Jun 2008 15:12:11 +0100 Subject: Jessica Shepherd/Guardian/GNL is out of the office. Message-ID: I will be out of the office starting 11/06/2008 and will not return until 12/06/2008. I am out of the office on Wednesday June 11. For any urgent messages,call my mobile on 07957147308 or please contact Sharon Bainbridge on 020 72399943 or Stephanie Kerstein on 020 7239 9559. Many thanks. Jessica ------------------------------------------------------------------ Visit guardian.co.uk - the UK's most popular newspaper website http://guardian.co.uk http://observer.co.uk ------------------------------------------------------------------ The Newspaper Marketing Agency Opening Up Newspapers ------------------------------------------------------------------ The Guardian Public Services Awards 2008, in partnership with Hays Specialist Recruitment, recognise and reward outstanding performance from public, private and voluntary sector teams. To find out more and nominate a deserving team or individual, visit http://society.guardian.co.uk/publicservicesawards ------------------------------------------------------------------ Please consider the environment before printing this email This e-mail and all attachments are confidential and may also be privileged. If you are not the named recipient, please notify the sender and delete the e-mail and all attachments immediately. Do not disclose the contents to another person. You may not use the information for any purpose, or store, or copy, it in any way. Guardian News & Media Limited is not liable for any computer viruses or other material transmitted with or as part of this e-mail. You should employ virus checking software. Guardian News & Media Limited A member of Guardian Media Group PLC Registered Office Number 1 Scott Place, Manchester M3 3GG Registered in England Number 908396 From garfield at CODEX.CIS.UPENN.EDU Wed Jun 11 11:56:31 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Wed, 11 Jun 2008 11:56:31 -0400 Subject: Yang, H (Yang, Hua); Zhao, YY (Zhao, Yue-Yang)Variations of author origins in World Journal of Gastroenterology during 2001-2007 WORLD JOURNAL OF GASTROENTEROLOGY, 14 (19): 3108-3111 MAY 21 2008 Message-ID: Author's E-mail: yangh at cmu2h.org Author(s): Yang, H (Yang, Hua); Zhao, YY (Zhao, Yue-Yang) Title: Variations of author origins in World Journal of Gastroenterology during 2001-2007 Source: WORLD JOURNAL OF GASTROENTEROLOGY, 14 (19): 3108-3111 MAY 21 2008 Language: English Document Type: Article CC Editions/Collections: Clinical Medicine (CM) Discipline: GASTROENTEROLOGY & HEPATOLOGY Keywords: bibliometrics, World Journal of Gastroenterology, Science Citation Index Abstract: AIM: To discuss the variations and distributions of authors who published their papers in World Journal of Gastroenterology (WJG) during 2001-2007 and evaluate the development of WJG and gastroenterology core journals in recent years by comparing the contributions of the authors. METHODS: WJG articles published in 2001-2007 were searched from MEDLINE database (by ISI Web of Knowledge). The variations (cooperation degree, cooperation rate) and distributions of the first authors were analyzed with bibliometric methods. SCIE was used to collect articles published in Am J Gastroenterol, Gastroenterology, Scand J Gastroenterol and WJG in 2007, and comparison of the data was made. Comparison indicators included the article number of annual journals, cooperation degree of authors, cooperation rate, mean number of articles published in each WJG issue, number of countries of the first WJG authors, geographical distribution and article contribution ratio of all WJG authors and domestic authors. RESULTS: Of the 5851 articles covered in MEDLINE, 173, 236, 633, 826, 1496, 1382 and 1105 articles were cited from 2001 to 2007. The cooperation degree was 5.11, 5.56, 5.75, 5.76, 6.31, 5.90 and 5.64 respectively. The cooperation rates was 94.80%, 99.15%, 98.89%, 98.55%, 99.13%, 96.67% and 95.66%, respectively. The mean number of articles published in each WJG issue from 2001 to 2007 was 28, 39, 52, 34, 31, 28 and 23, respectively. The number of countries of the first WJG authors was 8, 8, 27, 32, 49, 61 and 56, respectively. The first authors of WJG came from 3 continents in 2001 and covered 6 continents in 2006-2007. The number of articles written by Asian authors was 136 (79.07%), 227 (96.19%), 575 (90.98%), 713 (87.81%), 1111 (75.32%), 712 (53.98%) and 555 (53.21%), respectively in 2001-2007. The number of articles written by European & American authors increased from 36 (20.93%) and 8 (3.39%) in 2001-2002 to 563 (42.68%) and 452(43.34%) in 2006-2007. The number of countries except for China contributing papers was increased. The number of articles written by first authors of Japan rose from 0 (0%) in 2001-2002 to 287 (12.15%) in 2006- 2007. The number of articles written by American authors increased from 6 (1.47%) in 2001-2002 to 158 (6.69%) in 2006-2007. The number of articles written by Chinese authors was 136 (79.07%), 227 (96.19%), 548 (86.71%), 669 (82.39%), 884 (59.93%), 380 (28.81%) and 320 (30.68%), respectively, in 2001 to 2007. The number of articles published in Am J Gastroentero% Gastroenterology, Scand J Gastroenterol and WJG was 565, 586, 238 and 1118, respectively in 2007. The cooperation degree was 4.77, 6.14, 5.95 and 5.64, respectively, in 2007. The cooperation rate was 95.40%, 84.18%, 96.63% and 95.66%, respectively, in 2007. The number of countries of authors contributing papers was 44, 35, 42 and 62, respectively, in 2007. CONCLUSION: The geographical distribution of WJG authors is wide for the past 2 years. WJG has made a step onto international publishing, and drawn even more attentions from gastroenterology researchers. Its authors are distributed over 74 countries in 6 global continents, and the journal has become the main intermediary for international gastroenterology researchers to demonstrate their research accomplishments. (C) 2008 WJG. All rights reserved. Addresses: China Med Univ, Lib Shengjing Hosp, Shenyang 110004, Liaoning Prov, Peoples R China Reprint Address: YANG, H, CHINA MED UNIV, LIB SHENGJING HOSP, 36 SANHAO ST, SHENYANG 110004, LIAONING PROV, PEOPLES R CHINA Author's E-mail: yangh at cmu2h.org Publisher: W J G PRESS Publisher City: BEIJING Publisher Address: APT 1066, YISHOU GARDEN, NO 58, NORTH LANGXINZHUANG RD, PO BOX 2345, BEIJING 100023, PEOPLES R CHINA Publisher Web Address: http://www.wjgnet.com ISSN: 1007-9327 29-char Source Abbrev: WORLD J GASTROENTEROL ISO Source Abbrev: World J. Gastroenterol. Source Item Page Count: 4 ISI Document Delivery No.: 305IQ From notsjb at LSU.EDU Wed Jun 11 12:14:00 2008 From: notsjb at LSU.EDU (Stephen J Bensman) Date: Wed, 11 Jun 2008 11:14:00 -0500 Subject: Int. Math Union on use and abuse of citation stats Message-ID: Below is a report by the International Mathematical Union on citation statistics. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA IMU-Net 29b: June 2008 Special issue on "Citation Statistics", a report analyzing impact factors and similar statistics based on citations Dear colleagues, This is the first special issue of IMU-Net. Today the IMU has released an important document, called "Citation Statistics", which we want to bring to your attention. IMU-Net 24 (July 2007) announced the creation of a committee on "Quantitative assessment of research" that was asked to investigate various aspects of impact factors and similar statistics based on citations. The committee was appointed jointly by the Executive Committees of the International Mathematical Union (IMU), the International Council for Industrial and Applied Mathematics (ICIAM), and the Institute of Mathematical Statistics (IMS). It consisted of: - John Ewing (Providence, USA), chair, appointed by IMU - Robert Adler (Haifa, Israel), appointed by IMS - Peter Taylor (Melbourne, Australia), appointed by ICIAM. The terms of reference given to the committee can be found at: http://www.mathunion.org/Publications/2007/Charge-ComOnQuantAssessmRes07 0521.pdf The committee has addressed this charge by reviewing and discussing current practices along with an extensive literature on the use of citations to evaluate research. Its report, written from the perspective of mathematical scientists, was submitted to the Executive Committees of IMU, ICIAM, and IMS, and all three endorsed the report. The three organizations are making the report "Citation Statistics" public today. The report can be found at the following URL: http://www.mathunion.org/Publications/Report/CitationStatistics A press release that was mailed out today to journalists is at: http://www.mathunion.org/Publications/PressRelease/2008-06-11/CitationSt atistics This effort was triggered by numerous requests from IMU member countries, mathematical societies, important mathematical institutions, and individuals who reported the increasing use (and misuse) of impact factors and similarly of other citation-based indicators to measure the quality of research of individuals, departments, or whole institutions. IMU suggests that the readers of IMU-Net not only read the report but also distribute it to administrators and decision-makers who are involved in the assessment of research quality, in order to give them a mathematical science perspective. IMU, ICIAM and IMS have agreed that, in order to assure as wide distribution as possible, journals, newsletters and similar publications that are interested in publishing this report will have the non-exclusive right to publish it in one of their issues. Please contact the newsletters/journals you are connected with and suggest publication of the report "Citation Statistics". All 3 organizations, representing the world community of pure, applied, and industrial mathematics and statistics, hope that the careful analysis and recommendations in this report will be considered by decision-makers who are making use of citation data in research assessment. Best regards L. Lovasz IMU President ------------------------------------------------------------------------ IMU-Net is a Bimonthly Email Newsletter from the International Mathematical Union Editor: Mireille Chaleyat-Maurel, University Paris Descartes, Paris, France ------------------------------------------------------------------------ SUBSCRIBING TO IMU-NET There are two ways of subscribing to IMU-Net: 1. Click on http://www.mathunion.org/IMU-Net with a Web browser and go to the "Subscribe" button to subscribe to IMU-Net online. 2. Send an e-mail to imu-net-request at mathunion.org with the Subject-line: Subject: subscribe In both cases you will get an e-mail to confirm your subscription so that misuse will be minimized. IMU will not use the list of IMU-Net addresses for any purpose other than sending IMU-Net, and will not make it available to others. Previous issues can be seen at: http://www.mathunion.org/Publications/Newsletter/archive/ ________________________________________________________________________ ____ IMU-Net is the electronic newsletter of the International Mathematical Union. More details about IMU-Net can be found at: http://www.mathunion.org/IMU-Net/ You can find here, for instance, detailed information about subscribing to the IMU-Net mailing list and unsubscribing from it. ************************************************** To send an email to PAMnet: pamnet at listserv.nd.edu To view PAMnet Archives: http://listserv.nd.edu/archives/pamnet.html To unsubscribe to PAMnet: http://listserv.nd.edu/archives/pamnet.html then click on Join or leave the list (or change settings) To modify subscription settings: http://listserv.nd.edu/archives/pamnet.html then click on Join or leave the list (or change settings) From garfield at CODEX.CIS.UPENN.EDU Thu Jun 12 11:11:26 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 12 Jun 2008 11:11:26 -0400 Subject: Ullah, M (Ullah, Midrar); Butt, IF (Butt, Idrees Farooq); Haroon, M (Haroon, Muhammad)The Journal of Ayub Medical College: a 10-year bibliometric study HEALTH INFORMATION AND LIBRARIES JOURNAL, 25 (2): 116-124 JUN 2008 Message-ID: Author's E-mail: midrarullah2007 at yahoo.com Author(s): Ullah, M (Ullah, Midrar); Butt, IF (Butt, Idrees Farooq); Haroon, M (Haroon, Muhammad) Title: The Journal of Ayub Medical College: a 10-year bibliometric study Source: HEALTH INFORMATION AND LIBRARIES JOURNAL, 25 (2): 116-124 JUN 2008 Language: English Document Type: Article CC Editions/Collections: Social & Behavioral Sciences (SBS) Discipline: LIBRARY & INFORMATION SCIENCES Keywords Plus: CITATION ANALYSIS Abstract: Objective: To conduct a bibliometric evaluation of the Journal of Ayub Medical College (JAMC), Abbottabad, Pakistan. Methods The data of articles, citations and authors of JAMC from 1997 to 2006 were collected and analysed in terms of bibliometric parameters. Results: The number of articles published per year ranges between 27 and 97; most of the articles (47.2%) have 11-20 citations. Three-author contributions ranked the highest (134; 23.43%); the most prolific authors contributed seven articles; 295 (51.57%) of the authors are geographically affiliated to the North West Frontier Province (NWFP), Pakistan; the most popular subject is Internal Medicine; journal self-cited references are 43; 7769 (77.94%) of the citations were from foreign journals; the most productive institution is Ayub Medical College, Abbottabad, Pakistan. Conclusion: The number of papers published in JAMC per issue has been increasing over the last 10 years, and the core region is NWFP, Pakistan. Original articles are the main type of papers for this journal. The publication is open for all fields of medical sciences. Addresses: Natl Univ Sci & Technol, Army Med Coll, Rawalpindi 46000, Pakistan POF Hosp, Wah Med Coll, Wah Cantt, Pakistan Reprint Address: ULLAH, M, NATL UNIV SCI & TECHNOL, ARMY MED COLL, ABID MAJEED RD, RAWALPINDI 46000, PAKISTAN Author's E-mail: midrarullah2007 at yahoo.com Publisher: BLACKWELL PUBLISHING Publisher City: OXFORD Publisher Address: 9600 GARSINGTON RD, OXFORD OX4 2DQ, OXON, ENGLAND Publisher Web Address: http://www.blackwellpublishing.com ISSN: 1471-1834 29-char Source Abbrev: HEALTH INFO LIBR J ISO Source Abbrev: Heatlth Info. Libr. J. Source Item Page Count: 9 ISI Document Delivery No.: 304HK From garfield at CODEX.CIS.UPENN.EDU Thu Jun 12 11:16:25 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 12 Jun 2008 11:16:25 -0400 Subject: [Careful! Your bibliographic references may be examined] Culebras-Fernandez, J; Garcia de Lorenzo, A; Wanden-Nerghe, C; David Castiel, L; Sanz-Valero, J Nutr Hosp 23 (2) : 85-8 2008 Mar-Apr Message-ID: Email Address: jmculebras at telefonica.net PubMed ID: 18449441 Publication Type: English Abstract; Journal Article Title: [Careful! Your bibliographic references may be examined] Vernacular Title: Cuidado!, sus referencias bibliograficas pueden ser estudiadas Author(s): Culebras-Fernandez, J; Garcia de Lorenzo, A; Wanden-Nerghe, C; David Castiel, L; Sanz-Valero, J Source: Nutr Hosp 23 (2) : 85-8 2008 Mar-Apr Language: Spanish Abstract: Reference to previous work represents a conceptual association of recognized scientific ideas that are beneficial for the citing author. I.e., a reference is an express recognition of an intellectual compromise towards a previous source of information. After all, advancement of science is supported by previous research. At present, the way to know and to measure the importance of a published item comes through its posterior citations, circumstance that obliges scientific journals to control the pertinence and relevance of the cited work. Therefore, when submitting a manuscript for consideration to a scientific journal, it must be beard in mind that the included references will be examined. Address: Complejo Asistencial de Leon, Leon, Espana. jmculebras at telefonica.net Citation Subset: Index Medicus ISSN: 0212-1611 NLM Unique ID: 9100365 Country: Spain Date Created: 01 May 2008 From garfield at CODEX.CIS.UPENN.EDU Thu Jun 12 11:28:57 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 12 Jun 2008 11:28:57 -0400 Subject: [Eval of two methods for correcting the impact factor using the investigation done at the "Del Rio Hortega" University Hospital (1999-2004) as the data source] Gonzalez-Sagrado, M et al, J L Nutr Hosp 23 (2) : 111-8 2008 Mar-Apr Message-ID: Email Address: gonzalez-sagrado at arrakis.es PubMed ID: 18449446 Publication Type: English Abstract; Journal Article Title: [Evaluation of two methods for correcting the impact factor using the investigation done at the "Del Rio Hortega" University Hospital (1999- 2004) as the data source] Vernacular Title: Evaluacion de dos metodos de correccion del Factor de Impacto utilizando la investigacion del H.U. "Del rio Hortega" (1999-2007) como fuentes de datos. Author(s): Gonzalez-Sagrado, M; Luis Roman, D A de; Conde-Vicente, R; Izaola, O; Aller, R; Perez-Castrillon, J L Source: Nutr Hosp 23 (2) : 111-8 2008 Mar-Apr Language: Spanish Abstract: BACKGROUND AND OBJECTIVE: To adjust the Impact Factor (IF) provided by the Institute for Scientific Information (ISI) is necessary for improving bibliometric analysis among the various areas of knowledge. Our objective was to evaluate two parameters (the maximum and the median value of each subject area) for IF adjustment using the original (not corrected) IF as the reference method in a tertiary hospital biomedical investigation model. MATERIAL AND METHOD: We retrieved articles from Hospital Universitario "Del Rio Hortega" from Valladolid (Spain) for the period 1999-2004 as data source. We have describe the characteristics of the followed IF distributions: IF Corrected by the Maximum value (IFCORMAX), IF Corrected by the Median value (IFCORMED) and IF without adjustments (IF). Besides, we have analyzed both the inter-annual and the inter-subject differences obtained by the three methods. RESULTS: The three analyzed IF series shown not normal distributions that are positively skewed. The IF adjusted by the median showed the highest coefficient of variation (CV = 357.3%). The IF adjusted by the Maximum value increased the "weight" of journals with the highest not corrected IF for each subject category. Inter-annual differences were similarly estimated by the three methods. The IF adjusted by the median increased the inter-subject difference from 7.3% to 12.4%. CONCLUSIONS: Our results suggests that IF adjusted by the maximum value of each discipline is the best method to correct the ISI-IF values, because journals with the high IF are always rewarded, while IF adjusted by the median infra-estimated most of them. Address: Unidad de Apoyo a la Investigacion, Hospital Universitario Del Rio Hortega, Valladolid, Spain. gonzalez-sagrado at arrakis.es Citation Subset: Index Medicus ISSN: 0212-1611 NLM Unique ID: 9100365 Country: Spain Date Created: 01 May 2008 From eugene.garfield at THOMSONREUTERS.COM Thu Jun 12 18:11:22 2008 From: eugene.garfield at THOMSONREUTERS.COM (Eugene Garfield) Date: Thu, 12 Jun 2008 18:11:22 -0400 Subject: National Academy of Sciences posts Hundreds of Memoirs online Message-ID: PDF files for scientists like Thomas Edison, Joseph Henry and dozens of others at: www.nasonline.org/memoirs. 900 full texts ofmemoirs published earlier than 1995 have been added to the files already posted since 1995. A great addition to biographical databases. -------------- next part -------------- An HTML attachment was scrubbed... URL: From garfield at CODEX.CIS.UPENN.EDU Fri Jun 13 11:00:14 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Fri, 13 Jun 2008 11:00:14 -0400 Subject: Ketcham, CM (Ketcham, Catherine M.) Predicting impact factor one year in advance LABORATORY INVESTIGATION, 87 (6): 520-526 JUN 2007 Message-ID: E-mail Address: ketcham at pathology.ufl.edu Author(s): Ketcham, CM (Ketcham, Catherine M.) Title: Predicting impact factor one year in advance Source: LABORATORY INVESTIGATION, 87 (6): 520-526 JUN 2007 Language: English Document Type: Article Author Keywords: impact factor; pathology; citations; Thomson ISI; Web of Science Keywords Plus: PRESTIGE Abstract: The first impact factor (IF) to reflect the sole efforts of a new editorial team occurs 4 years into what is usually a 5-year editorship, owing to the lag times of: paper accrual and publication, accumulation of citations in derivative literature, and compiling of such citations by the Thomson ISI Web of Knowledge(SM) service. Through weekly collection of citation data from the Web of Science (R) over the past 2 years, we now demonstrate that the evolution of IF can be tracked weekly over the course of a calendar year, enabling prediction of the next year's IF beginning at the middle of the previous year. The methodology used to track the developing IF for Lab Invest is presented in this study and a prediction made for the 2006 IF, along with IF predictions for other general pathology journals (American Journal of Pathology, Journal of Pathology, Modern Pathology, American Journal of Surgical Pathology, and Human Pathology). Despite the fact that the 2006 IF for Lab Invest will not be issued until June 2007, it became apparent as early as July 2006 that the Lab Invest IF would be greatly improved over 2004 and 2005 by a predicted 0.5 units. However, as important as IF can be to a journal, it is vital not to let IF considerations influence every aspect of the editors' decisions. Rather, the significance of early prediction lies in earlier validation of editorial policies for journal management as a whole, and reassurance that the philosophy for journal operations is on track. Addresses: Univ Florida, Coll Med, Dept Pathol Immunol & Lab Med, Gainesville, FL 32610 USA Reprint Address: Ketcham, CM, Univ Florida, Coll Med, Dept Pathol Immunol & Lab Med, POB 100275,1600 SW Archer Rd, Gainesville, FL 32610 USA. E-mail Address: ketcham at pathology.ufl.edu Cited Reference Count: 23 Times Cited: 2 Publisher: NATURE PUBLISHING GROUP Publisher Address: 75 VARICK STREET, 9TH FLOOR, NEW YORK, NY 10013-1917 USA ISSN: 0023-6837 29-char Source Abbrev.: LAB INVEST ISO Source Abbrev.: Lab. Invest. Source Item Page Count: 7 Subject Category: Medicine, Research & Experimental; Pathology ISI Document Delivery No.: 168ZA NATURE 435 : 1003 2005 *PLOS MED ED PLOS MED 3 : E291 2006 ALAWQATI Q Impact factors and prestige KIDNEY INTERNATIONAL 71 : 183 DOI 10.1038/sj.ki.5002094 2007 BALL P Prestige is factored into journal ratings NATURE 439 : 770 DOI 10.1038/439770a 2006 CRAWFORD JM Original research in pathology: judgment, or evidence-based medicine? LABORATORY INVESTIGATION 87 : 104 DOI 10.1038/labinvest.3700511 2007 DONG P BIOMED DIGIT LIB 2 : 7 2005 GARFIELD E Journal impact factor: a brief review CANADIAN MEDICAL ASSOCIATION JOURNAL 161 : 979 1999 GARFIELD E The history and meaning of the journal impact factor JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 295 : 90 2006 GARFIELD E Impact factors, and why they won't go away NATURE 411 : 522 2001 HACHINSKI V The impact of impact factors STROKE 32 : 2729 2001 HECHT F The journal "impact factor": A misnamed, misleading, misused measure CANCER GENETICS AND CYTOGENETICS 104 : 77 1998 LEHMANN S Measures for measures NATURE 444 : 1003 DOI 10.1038/4441003a 2006 MONASTERSKY R CHRON HIGHER EDUC 52 : A12 2005 NEUBERGER J Impact factors: uses and abuses EUROPEAN JOURNAL OF GASTROENTEROLOGY & HEPATOLOGY 14 : 209 2002 PERNEGER TV Relation between online "hit counts" and subsequent citations: prospective study of research papers in the BMJ BRITISH MEDICAL JOURNAL 329 : 546 2004 PIPER HM The hills and valleys of an impact factor CARDIOVASCULAR RESEARCH 67 : 175 DOI 10.1016/j.cardiores.2005.06.001 2005 SCULLY C Impact factors and their significance; overrated or misused? BRITISH DENTAL JOURNAL 198 : 391 DOI 10.1038/sj.bdj.4812185 2005 SEGLEN PO Why the impact factor of journals should not be used for evaluating research BRITISH MEDICAL JOURNAL 314 : 498 1997 SMITH R Commentary: The power of the unrelenting impact factor - Is it a force for good or harm? INTERNATIONAL JOURNAL OF EPIDEMIOLOGY 35 : 1129 DOI 10.1093/ije/dyl191 2006 SMOLLER BR Impact factor: certainly a factor, but just whom does it impact? Important lessons from another discipline JOURNAL OF CUTANEOUS PATHOLOGY 33 : 458 2006 STRAUB SC Infection, Genetics & Evolution: a journal with a high impact but no Impact Factor (as yet) INFECTION GENETICS AND EVOLUTION 7 : 145 DOI 10.1016/j.meegid.2006.11.001 2007 VAKIL N The journal impact factor: Judging a book by its cover AMERICAN JOURNAL OF GASTROENTEROLOGY 100 : 2436 DOI 10.1111/j.1572- 0241.2005.00324.x 2005 WHITEHOUSE GH Impact factors: facts and myths EUROPEAN RADIOLOGY 12 : 715 2002 From garfield at CODEX.CIS.UPENN.EDU Fri Jun 13 11:11:01 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Fri, 13 Jun 2008 11:11:01 -0400 Subject: Hart, PA (Hart, Phil A.); Ibdah, JA (Ibdah, Jamal A.); Marshall, JB (Marshall, John B.) Internationalisation of high-impact gastroenterology journals, 1970-2005 GUT, 56 (6): 895-896 JUN 2007 Message-ID: E-mail Address: marshallj at health.missouri.edu Author(s): Hart, PA (Hart, Phil A.); Ibdah, JA (Ibdah, Jamal A.); Marshall, JB (Marshall, John B.) Title: Internationalisation of high-impact gastroenterology journals, 1970- 2005 Source: GUT, 56 (6): 895-896 JUN 2007 Language: English Document Type: Letter Keywords Plus: ARTICLES; TRENDS Addresses: Univ Missouri, Sch Med, Div Gastroenterol, Columbia, MO 65212 USA Reprint Address: Marshall, JB, Univ Missouri, Sch Med, Div Gastroenterol, M580,1 Hosp Dr, Columbia, MO 65212 USA. E-mail Address: marshallj at health.missouri.edu Cited Reference Count: 10 Times Cited: 0 Publisher: B M J PUBLISHING GROUP Publisher Address: BRITISH MED ASSOC HOUSE, TAVISTOCK SQUARE, LONDON WC1H 9JR, ENGLAND ISSN: 0017-5749 29-char Source Abbrev.: GUT ISO Source Abbrev.: Gut Source Item Page Count: 2 Subject Category: Gastroenterology & Hepatology ISI Document Delivery No.: 170WI *I SCI INF J CIT REP : 2005 BERK PD HEPATOLOGY AND HEPATOLOGY - THE TRENDS CONTINUE HEPATOLOGY 21 : 875 1995 BISELL DM HEPATOLOGY 34 : 1252 2001 BLIZIOTIS IA Worldwide trends in quantity and quality of published articles in the field of infectious diseases BMC INFECTIOUS DISEASES 5 : ARTN 16 2005 CHEN MY Internationalization of the American journal of roentgenology: 1980-2002 AMERICAN JOURNAL OF ROENTGENOLOGY 181 : 907 2003 LARUSSO NF GASTROENTEROLOGY - AN INTERNATIONAL JOURNAL GASTROENTEROLOGY 108 : 625 1995 RAHMAN M A decline in the US share of research articles NEW ENGLAND JOURNAL OF MEDICINE 347 : 1211 2002 STOSSEL TP DECLINING AMERICAN REPRESENTATION IN LEADING CLINICAL-RESEARCH JOURNALS NEW ENGLAND JOURNAL OF MEDICINE 322 : 739 1990 SZOKOL JW Declining proportion of publications by American authors in major anesthesiology journals ANESTHESIA AND ANALGESIA 96 : 513 DOI 10.1213/01.ANE.0000041597.75561.A4 2003 TOMPKINS RK Internationalization of general surgical journals - Origin and content of articles published in North America and Great Britain from 1983 to 1998 ARCHIVES OF SURGERY 136 : 1345 2001 From garfield at CODEX.CIS.UPENN.EDU Fri Jun 13 11:31:46 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Fri, 13 Jun 2008 11:31:46 -0400 Subject: Willett, P (Willett, Peter) A bibliometric analysis of the Journal of Molecular Graphics and Modelling JOURNAL OF MOLECULAR GRAPHICS & MODELLING, 26 (3): 602-606 OCT 2007 Message-ID: E-mail Address: p.willett at sheffield.ac.uk Author(s): Willett, P (Willett, Peter) Title: A bibliometric analysis of the Journal of Molecular Graphics and Modelling Source: JOURNAL OF MOLECULAR GRAPHICS & MODELLING, 26 (3): 602-606 OCT 2007 Language: English Document Type: Article Author Keywords: author productivity; bibliometrics; citation analysis; Journal of Molecular Graphics and Modelling Keywords Plus: INFORMATION-SCIENCE; CITATION; DOCUMENTATION; INFORMETRICS; PORTRAIT; LIBRARY; LAW Abstract: This paper reviews the articles published in Volumes 2-24 of the Journal of Molecular Graphics and Modelling (formerly the Journal of Molecular Graphics), focusing on the changes that have occurred in the subject over the years, and on the most productive and most cited authors and institutions. The most cited papers are those describing systems or algorithms, but the proportion of these types of article is decreasing as more applications of molecular graphics and molecular modelling are reported. (C) 2007 Elsevier Inc. All rights reserved. Addresses: Univ Sheffield, Dept Informat Studies, Sheffield S1 4DP, S Yorkshire, England; Univ Sheffield, Krebs Inst Biomolec Res, Sheffield S1 4DP, S Yorkshire, England Reprint Address: Willett, P, Univ Sheffield, Dept Informat Studies, 211 Portbello St, Sheffield S1 4DP, S Yorkshire, England. E-mail Address: p.willett at sheffield.ac.uk Cited Reference Count: 24 Times Cited: 0 Publisher: ELSEVIER SCIENCE INC Publisher Address: 360 PARK AVE SOUTH, NEW YORK, NY 10010-1710 USA ISSN: 1093-3263 29-char Source Abbrev.: J MOL GRAPH MODEL ISO Source Abbrev.: J. Mol. Graph. Source Item Page Count: 5 Subject Category: Biochemical Research Methods; Biochemistry & Molecular Biology; Computer Science, Interdisciplinary Applications; Crystallography; Mathematical & Computational Biology ISI Document Delivery No.: 226XR BEHRENS H A bibliometric study in crystallography ACTA CRYSTALLOGRAPHICA SECTION B-STRUCTURAL SCIENCE 62 : 993 DOI 10.1107/S0108768106030278 2006 BONNEVIE E A multifaceted portrait of a library and information science Journal: the case of the Journal of Information Science JOURNAL OF INFORMATION SCIENCE 29 : 11 2003 BORGMAN CL Scholarly communication and bibliometrics ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY 36 : 3 2002 CRONIN B CITATION PROCESS ROL : 1984 EGGHE L THE DUALITY OF INFORMETRIC SYSTEMS WITH APPLICATIONS TO THE EMPIRICAL LAWS JOURNAL OF INFORMATION SCIENCE 16 : 17 1990 FAIRTHORNE RA PROGRESS IN DOCUMENTATION - EMPIRICAL HYPERBOLIC DISTRIBUTIONS (BRADFORD- ZIPF-MANDELBROT) FOR BIBLIOMETRIC DESCRIPTION AND PREDICTION JOURNAL OF DOCUMENTATION 25 : 319 1969 GARFIELD E CITATION INDEXING TH : 1979 HOOD WW The literature of bibliometrics, scientometrics, and informetrics SCIENTOMETRICS 52 : 291 2001 JACSO P As we may search - Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases CURRENT SCIENCE 89 : 1537 2005 LEYDESDORFF L Visualization of the citation impact environments of scientific journals: An online mapping exercise JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 25 2007 MEHO L IN PRESS J AM SOC IN : NEBELONGBONNEVIE E Journal citation identity and journal citation image: a portrait of the Journal of Documentation JOURNAL OF DOCUMENTATION 62 : 30 DOI 10.1108/00220410610642039 2006 NISONGER TE JASIS and library and information science journal rankings: A review and analysis of the last half-century JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 50 : 1004 1999 ONODERA N A bibliometric study on chemical information and computer sciences focusing on literature of JCICS JOURNAL OF CHEMICAL INFORMATION AND COMPUTER SCIENCES 41 : 878 2001 PAO ML LOTKA LAW - A TESTING PROCEDURE INFORMATION PROCESSING & MANAGEMENT 21 : 305 1985 PAO ML AN EMPIRICAL-EXAMINATION OF LOTTKA LAW JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 37 : 26 1986 PRICE DJD GENERAL THEORY OF BIBLIOMETRIC AND OTHER CUMULATIVE ADVANTAGE PROCESSES JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 27 : 292 1976 PUDOVKIN AI Algorithmic procedure for finding semantically related journals JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 53 : 1113 DOI 10.1002/asi.10153 2002 REDMAN J A citation analysis of the Cambridge Crystallographic Data Centre JOURNAL OF APPLIED CRYSTALLOGRAPHY 34 : 375 2001 ROUSSEAU B CYBERMETRICS 4 : 2000 THELWALL M Webometrics ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY 39 : 81 2005 WILLETT P IN PRESS ASLIB P : WILSON CS Informetrics ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY 34 : 107 1999 YOUNG AP LIB Q 73 : 10 2006 From garfield at CODEX.CIS.UPENN.EDU Fri Jun 13 12:34:09 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Fri, 13 Jun 2008 12:34:09 -0400 Subject: Zhang, L (Zhang, Li) Discovering information use in agricultural economics: A citation study JOURNAL OF ACADEMIC LIBRARIANSHIP, 33 (3): 403-413 MAY 2007 Message-ID: E-mail Address: lzhang at library.msstate.edu Author(s): Zhang, L (Zhang, Li) Title: Discovering information use in agricultural economics: A citation study Source: JOURNAL OF ACADEMIC LIBRARIANSHIP, 33 (3): 403-413 MAY 2007 Language: English Document Type: Article Keywords Plus: JOURNALS; PROMOTION Abstract: This citation study investigated the research needs and activity of U.S. agricultural economists. journals were the dominant format of cited sources. Books, government publications, and working papers formed the other important types of references, whereas electronic sources were sparsely used. Subject scatter in this interdisciplinary field was changed over time. Addresses: Mississippi State Univ Lib, Mississippi State, MS 39762 USA Reprint Address: Zhang, L, Mississippi State Univ Lib, Mississippi State, MS 39762 USA. E-mail Address: lzhang at library.msstate.edu Cited Reference Count: 23 Times Cited: 0 Publisher: ELSEVIER SCIENCE INC Publisher Address: 360 PARK AVE SOUTH, NEW YORK, NY 10010-1710 USA ISSN: 0099-1333 29-char Source Abbrev.: J ACAD LIBR ISO Source Abbrev.: J. Acad. Librariansh. Source Item Page Count: 11 Subject Category: Information Science & Library Science ISI Document Delivery No.: 170EO PETERSONS COLL SEARC : RES RANDOMIZER : 2006 *AM AGR EC WHAT IS AGR EC : 2005 ACKERSON LG COLLECTION MANAGEMEN 26 : 63 2001 ADEWOLE S SELECTING LIVESTOCK PERIODICALS THROUGH CITATION ANALYSIS TECHNIQUE INFORMATION PROCESSING & MANAGEMENT 23 : 629 1987 BURTON M The ranking of agricultural economics journals JOURNAL OF AGRICULTURAL ECONOMICS 47 : 109 1996 DENNIS AR Research standards for promotion and tenure in information systems MIS QUARTERLY 30 : 1 2006 DOTE G J AGR FOOD INFORMATI 3 : 47 1996 FRANDSEN TF Journal interaction - A bibliometric analysis of economics journals JOURNAL OF DOCUMENTATION 61 : 385 DOI 10.1108/00220410510598544 2005 HURD JM Information use by molecular biologists: Implications for library collections and services COLLEGE & RESEARCH LIBRARIES 60 : 31 1999 HYLAND K Self-citation and self-reference: Credibility and promotion in academic publication JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 54 : 251 DOI 10.1002/asi.10204 2003 KELSEY P Establishing a core list of journals for forestry: A citation analysis from faculty at southern universities COLLEGE & RESEARCH LIBRARIES 64 : 357 2003 MAHAPATRA M SUBJECT DISPERSION STUDIES IN AGRICULTURAL-ECONOMICS LIBRI 34 : 341 1984 HERALD LIB SCI JUL 25 : 185 1986 OLSEN WC AGR EC RURAL SOCIOLO : 12 1991 PATIL YM AGROPEDOLOGY 6 : 107 1996 RINIA EJ Citation delay in interdisciplinary knowledge exchange SCIENTOMETRICS 51 : 293 2001 ROBINSON LIT USE US EC : 56 1999 ROBINSON LIT USE US EC : 61 1999 ROBINSON LIT USE US EC : 63 1999 ROBINSON WC BEHAV SOCIAL SCI LIB 22 : 53 2004 SHARIF MA COLLECT BUILD 23 : 172 2004 SMYTH R AUSTR AC RES LIB 30 : 119 1999 From notsjb at LSU.EDU Fri Jun 13 13:54:17 2008 From: notsjb at LSU.EDU (Stephen J Bensman) Date: Fri, 13 Jun 2008 12:54:17 -0500 Subject: Review Articles, Paradigms, and the Impact Factor Message-ID: I have just had the following article published: "Distributional Differences of the Impact Factor in the Sciences vs. the Social Sciences: An Analysis of the Probabilistic Structure of the 2005 Journal Citation Reports," Journal of the American Society for Information Science and Technology 59 (July 2008): 1366-1382. Although I generally do not like to call attention to my own work, I consider this article very significant. Then, too, there is also the consideration once expressed by John L. Lewis, president of the United Mine Workers, in his King James English that "he who tooteth not his own horn, that same shall not be tooteth." An executive summary of the article is below. The paper analyzes the relationship between Kuhnian paradigms, review articles, and impact factors. It comes to the conclusion that a key characteristic of the journal literature of a scientific discipline as opposed to others is that this literature is dominated in the impact factor by review journals. Sciences need consensual paradigms in order to proceed, and the function of review journals is to define such paradigms. The study is only exploratory, and its limitations are spelled out in the last paragraph. The hypothesis needs to be tested by further studies, which I cannot do. Therefore I am bringing the paper to attention of others, who may want to investigate this question. If interested, please contact me, and I will provide access to the article. I must warn you that you must love the Poisson process. One of the referees did not, and he thought that not only should this paper not be published, but I should have been executed for having written it. He was outvoted 3 to 1. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu This paper examines the overall probability structure of the 2005 Science Citation Index (SCI) and Social Sciences Citation Index (SSCI) Journal Citation Reports (JCR) by analyzing the distributions of their journals by the Impact Factor. The Impact Factor is an estimate of the mean citation rate per citable item published in a given journal during the preceding two years. One major purpose of this analysis is to determine whether there is any criterion for the macro-classification of disciplines as to whether their journal literature conforms to a science or a social science model. Using the chi-squared index of dispersion test, it was found that the Impact Factor distribution of the SCI journals corresponded with a distribution generally modeled by the negative binomial distribution (NBD), which arises as a result of the stochastic processes of probabilistic heterogeneity and contagion. Contagion is when the occurrence of an event raises the probability of its subsequent occurrence, and it is the stochastic model of the "Matthew Effect." In contrast, the test found that the SSCI Impact Factor distribution fit the Poisson distribution, which is the model for random, rare events, although it came close to rejecting the Poisson in favor of a distribution of the NBD type. Both Impact Factor distributions were positively skewed-the SCI much more so than the SSCI-indicating excess variance. An examination of the journals highest in the Impact Factor revealed that in both JCRs the high-impact journals tended to class in subject categories well funded by the National Institutes of Health, and, therefore, it seems that the probability structures of the JCRs are affected by the same biomedical "multiplier effect" that influenced the development of American universities after World War II. It was also found that review journals play a much more important role in the sciences than in the social sciences. Review articles tend to be more highly cited because of their important function of defining the paradigms governing a given discipline, and their importance was causal in the higher skewness of the SCI Impact Factor distribution. Because the sciences are generally considered to have higher paradigm consensus than the social sciences, the greater importance of review journals in the sciences was judged to be a classificatory principle by which to gauge whether a discipline's journal literature conforms to the science or the social science model. As an example, the behavioral sciences were analyzed from this perspective, and it was found that certain SSCI subject categories in Psychology appear to adhere to the SCI model of dominant review journals, thereby increasing the variance and skew of the SSCI Impact Factor distribution. For both the SCI and SSCI JCRs, surprisingly high correlations were found between the journal Impact Factors and Total Cites, indicating that the larger, older, and more prestigious journals tend to have higher current mean citation rates per article-another sign of the operation of the Matthew Effect.. -------------- next part -------------- An HTML attachment was scrubbed... URL: From garfield at CODEX.CIS.UPENN.EDU Fri Jun 13 14:43:30 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Fri, 13 Jun 2008 14:43:30 -0400 Subject: Willett, P (Willett, Peter) A bibliometric analysis of the Journal of Molecular Graphics and Modelling JOURNAL OF MOLECULAR GRAPHICS & MODELLING, 26 (3): 602-606 OCT 2007 Message-ID: There is a citation analysis of papers, also known as a HistCite, for the JOURNAL OF MOLECULAR GRAPHICS & MODELLING at http://garfield.library.upenn.edu/histcomp/j-molecular-graph/index-tl.html From harnad at ECS.SOTON.AC.UK Sun Jun 15 12:01:47 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Sun, 15 Jun 2008 12:01:47 -0400 Subject: Citation statistics Message-ID: On Thu, 12 Jun 2008, Charles Oppenheim wrote: >> Re: >> International Mathematical Union announces Citation Statistics report >> Numbers with a number of problems >> Robert Adler, John Ewing (Chair), Peter Taylor >> http://www.mathunion.org/Publications/Report/CitationStatistics > > CHARLES OPPEHEIM: > I've now read the whole report. Yes, it tilts at the > usual windmills, and rightly dismissed the use of Impact > factors for anything but crude comparisons, but it fails > to address the fundamental issue, which is: citation and > other metrics correlate superbly with subjective peer > review. Both methods have their faults, but they are > clearly measuring the same (or closely related) things. > Ergo, if you have evaluate research in some way, there is > no reason NOT to use them! It also keeps referring to > examples from the field of maths, which is a very strange > subject citation-wise. I have now read the IMU report too, and agree with Charles that it makes many valid points but it misunderstands the one fundamental point concerning the question at hand: Can and should metrics be used in place of peer-panel based rankings in the UK Research Assessment Exercise (RAE) and its successors and homologues elsewhere? And there the answer is a definite Yes. The IMU critique points out that research metrics in particular and statistics in general are often misused, and this is certainly true. It also points out that metrics are often used without validation. This true is correct. There is also a simplistic tendency to try to use one single metric, rather than multiple metrics that can complement and correct one another. There too, a practical and methodological error is correctly pointed out. It is also true that the ?journal impact factor? has many flaws, and should on no account be used to rank individual papers of researchers, and especially not alone, as a single metric. But what all this valuable, valid cautionary discussion overlooks is not only the possibility but the empirically demonstrated fact that there exist metrics that are highly correlated with human expert rankings. It follows that to the degree that such metrics account for the same variance, they can substitute for the human rankings. The substitution is desirable, because expert rankings are extremely costly in terms of expert time and resources. Moreover, a metric that can be shown to be highly correlated with an already validated variable predictor variable (such as expert rankings) thereby itself becomes a validated predictor variable. And this is why the answer to the basic question of whether the RAE?s decision to convert to metrics was a sound one is: Yes. Nevertheless, the IMU?s cautions are welcome: Metrics do need to be validated; they do need to be multiple, rather than a single, unidimensional index; they do have to be separately validated for each discipline, and the weights on the multiple metrics need to be calibrated and adjusted both for the discipline being assessed and for the properties on which it is being ranked. The RAE 2008 database provides the ideal opportunity to do all this discipline-specific validation and calibration, because it is providing parallel data from both peer panel rankings and metrics. The metrics, however, should be as rich and diverse as possible, to capitalize on this unique opportunity for joint validation. Here are some comments on particular points in the IMU report. (All quotes are from the report): > The meaning of a citation can be even more subjective than peer review. True. But if there is a non-metric criterion measure ? such as peer review ? on which we already rely, then metrics can be cross- validated against that criterion measure, and this is exactly what the RAE 2008 database makes it possible to do, for all disciplines, at the level of an entire sizeable nation?s total research output.. > The sole reliance on citation data provides at best an incomplete and often shallow understanding of research?an understanding that is valid only when reinforced by other judgments. This is correct. But the empirical fact has turned out to be that a department?s total article/author citation counts are highly correlated with its peer rankings in the RAE in every discipline tested. This does not mean that citation counts are the only metric that should be used, or that they account for 100% of the variance in peer rankings. But it is strong evidence that citation counts should be among the metrics used, and it constitutes a (pairwise) validation. > Using the impact factor alone to judge a journal is like using weight alone to judge a person's health. Using only the journal impact factor (the average citation counts of article published in that journal) in place of the actual citation counts for individual articles and authors is of course as absurd as using only the average marks of a candidate?s secondary school, instead of the candidate?s own actual marks, to decide on university admission. However, the journal?s average might still be used as one of the battery of candidate metrics to be validated and collaborated jointly, discipline by discipline, as it may give further, valid independent information about the level of the publication venue itself, over and above the individual citation counts. > For papers, instead of relying on the actual count of citations to compare individual papers, people frequently substitute the impact factor of the journals in which the papers appear. As noted, this is a foolish error if the journal impact factor is used alone, but it may enhance predictivity and hence validity if added to a battery of jointly validated metrics. > The validity of statistics such as the impact factor and h? index is neither well understood nor well studied. The h-index (and its variants) were created ad hoc, without validation. They turn out to be highly correlated with citation counts (for obvious reasons, since they are in part based on them). Again, they are all welcome in a battery of metrics to be jointly cross- validated against peer rankings or other already-validated or face- valid metrics. > citation data provide only a limited and incomplete view of research quality, and the statistics derived from citation data are sometimes poorly understood and misused. It is certainly true that there are many more potential metrics of research performance productivity, impact and quality than just citation metrics (e.g., download counts, student counts, research funding, etc.). They should all be jointly validated, discipline by discipline and each metric should be weighted according to what percentage of the criterion variance (e.g., RAE 2008 peer rankings) it predicts. > relying primarily on metrics (statistics) derived from citation data rather than a variety of methods, including judgments by scientists themselves? The whole point is to cross-validate the metrics against the peer judgments, and then use the weighted metrics in place of the peer judgments, in accordance with their validated predictive power. > bibliometrics (using counts of journal articles and their citations) will be a central quality index in this system [RAE] Yes, but the successor of RAE is not yet clear on which metrics it will use, and whether and how it will validate them. There is still some risk that a small number of metrics will simply be picked a priori, without systematic validation. It is to be hoped that the IMU critique, along with other critiques and recommendations, will result in the use of the 2008 parallel metric/peer data for a systematic and exhaustive cross-validation exercise, separately for each discipline. Future assessments can then use the metric battery, with initialized weights (specific to each discipline), and can calibrate and optimize them across the years, as more data accumulates ? including spot- checks cross-validating periodically against ?light-touch? peer rankings and other validated or face-valid measures. > sole reliance on citation?based metrics replaces one kind of judgment with another. Instead of subjective peer review one has the subjective interpretation of a citation's meaning. Correct. This is why multiple metrics are needed, and why they need to be systematically cross-validated against already-validated or face- valid criteria (such as peer judgment). > Research usually has multiple goals, both short?term and long, and it is therefore reasonable that its value must be judged by multiple criteria. Yes, and this means multiple, validated metrics. (Time-course parameters, such as growth and decay rates of download, citation and other metrics are themselves metrics.) > many things, both real and abstract, that cannot be simply ordered, in the sense that each two can be compared Yes, we should not compare the incomparable and incommensurable. But whatever we are already comparing, by other means, can be used to cross-validate metrics. (And of course it should be done discipline by discipline, and sometimes even by sub-discipline, rather than by treating all research as if it were of the same kind, with the same metrics and weights.) > plea to use multiple methods to assess the quality of research Valid plea, but the multiple ?methods? means multiple metrics, to be tested for reliability and validity against already validated methods. > Measures of esteem such as invitations, membership on editorial boards, and awards often measure quality. In some disciplines and in some countries, grant funding can play a role. And peer review?the judgment of fellow scientists?is an important component of assessment. These are all sensible candidate metrics to be included, alongside citation and other candidate metrics, in the multiple regression equation to be cross-validated jointly against already validated criteria, such as peer rankings (especially in RAE 2008). > lure of a simple process and simple numbers (preferably a single number) seems to overcome common sense and good judgment. Validation should definitely be done with multiple metrics, jointly, using multiple regression analysis, not with a single metric, and not one at a time. > special citation culture of mathematics, with low citation counts for journals, papers, and authors, makes it especially vulnerable to the abuse of citation statistics. Metric validation and weighting should been done separately, field by field. > For some fields, such as bio?medical sciences, this is appropriate because most published articles receive most of their citations soon after publication. In other fields, such as mathematics, most citations occur beyond the two?year period. Chronometrics ? growth and decay rates and other time-based parameters for download, citations and other time-based, cumulative measures ? should be among the battery of candidate metrics for validation. > The impact factor varies considerably among disciplines... The impact factor can vary considerably from year to year, and the variation tends to be larger for smaller journals. All true. Hence the journal impact factor ? perhaps with various time constants ? should be part of the battery of candidate metrics, not simply used a priori. > The most important criticism of the impact factor is that its meaning is not well understood. When using the impact factor to compare two journals, there is no a priori model that defines what it means to be "better". The only model derives from the impact factor itself ? a larger impact factor means a better journal... How does the impact factor measure quality? Is it the best statistic to measure quality? What precisely does it measure? Remarkably little is known... And this is because the journal impact factor (like most other metrics) has not been cross-validated against face-valid criteria, such as peer rankings. > employing other criteria to refine the ranking and verify that the groups make sense In other words, systematic cross-validation is needed. > impact factor cannot be used to compare journals across disciplines All metrics should be independently validated for each discipline. > impact factor may not accurately reflect the full range of citation activity in some disciplines, both because not all journals are indexed and because the time period is too short. Other statistics based on longer periods of time and more journals may be better indicators of quality. Finally, citations are only one way to judge journals, and should be supplemented with other information Chronometrics. And multiple metrics. > The impact factor and similar citation?based statistics can be misused when ranking journals, but there is a more fundamental and more insidious misuse: Using the impact factor to compare individual papers, people, programs, or even disciplines Individual citation counts and other metrics: Multiple metrics, jointly validated. > the distribution of citation counts for individual papers in a journal is highly skewed, approximating a so?called power law... highly skewed distribution and the narrow window of time used to compute the impact factor To the extent that distributions are pertinent, they too can be parametrized and taken into account in validating metrics. Comparing like with like (e.g., discipline by discipline) should also help maximize comparability. > using the impact factor as a proxy for actual citation counts for individual papers No need to use one metric as a proxy for another. Jointly validate them all. > if you want to rank a person's papers using only citations to measure the quality of a particular paper, you must begin by counting that paper's citations. The impact factor of the journal in which the paper appears is not a reliable substitute. Correct, but this obvious truth does not need to be repeated so many times, and it is an argument against single metrics in general; and journal impact factor as a single factor in particular. But there?s nothing wrong with using it in a battery of metrics for validation. > h?index Hirsch extols the virtues of the h?index by claiming that "h is preferable to other single?number criteria commonly used to evaluate scientific output of a researcher?"[Hirsch 2005, p. 1], but he neither defines "preferable" nor explains why one wants to find "single?number criteria."... Much of the analysis consists of showing "convergent validity," that is, the h?index correlates well with other publication/citation metrics, such as the number of published papers or the total number of citations. This correlation is unremarkable, since all these variables are functions of the same basic phenomenon The h-index is again a single metric. And cross-validation only works against either an already validated or a face-valid criterion, not just another unvalidated metric. And the only way multiple metrics, all inter-correlated, can be partitioned and weighted is with multiple regression analysis ? and once again against a criterion, such as peer rankings. > Some might argue that the meaning of citations is immaterial because citation?based statistics are highly correlated with some other measure of research quality (such as peer review). Not only might some say it: Many have said it, and they are quite right. That means citation counts have been validated against peer review, pairwise. Now it is time to cross-validate and entire spectrum of candidate metrics, so each can be weighted for its predictive contribution. > The conclusion seems to be that citation?based statistics, regardless of their precise meaning, should replace other methods of assessment, because they often agree with them. Aside from the circularity of this argument, the fallacy of such reasoning is easy to see. The argument is circular only if unvalidated metrics are being cross- correlated with other unvalidated metrics. Then it?s a skyhook. But when they are cross-validated against a criterion like peer rankings, which have been the predominant basis for the RAE for 20 years, they are being cross-validated against a face-valid criterion ? for which they can indeed be subsequently substituted, if the correlation turns out to be high enough. > "Damned lies and statistics" Yes, one can lie with unvalidated metrics and statistics. But we are talking here about validating metics against validated or face-valid criteria. In that case, the metrics lie no more (or less) than the criteria did, before the substitution. > Several groups have pushed the idea of using Google Scholar to implement citation?based statistics, such as the h?index, but the data contained in Google Scholar is often inaccurate (since things like author names are automatically extracted from web postings)... This is correct. But Google Scholar?s accuracy is growing daily, with growing content, and there are ways to triangulate author identity from such data even before the (inevitable) unique author identifier is adopted. > Citation statistics for individual scientists are sometimes difficult to obtain because authors are not uniquely identified... True, but a good approximation is -- or will soon be ? possible (not for arbitrary search on the works of ?Lee,? but, for example, for all the works of all the authors in the UK university LDAPs). > Citation counts seem to be correlated with quality, and there is an intuitive understanding that high?quality articles are highly? cited. The intuition is replaced by objective data once the correlation with peer rankings of quality is demonstrated (and replaced in proportion to the proportion of the criterion variance accounted for) by the predictor metric. > But as explained above, some articles, especially in some disciplines, are highly?cited for reasons other than high quality, and it does not follow that highly?cited articles are necessarily high quality. This is why validation/weighting of metrics must be done separately, discipline by discipline, and why citation metrics alone are not enough: multiple metrics are needed to take into account multiple influences on quality and impact, and to weight them accordingly. > The precise interpretation of rankings based on citation statistics needs to be better understood. Once a sufficiently broad and predictive battery of metrics is validated and its weights initialized (e.g., in RAE 2008), further interpretation and fine-tuning can follow. > In addition, if citation statistics play a central role in research assessment, it is clear that authors, editors, and even publishers will find ways to manipulate the system to their advantage. True, but inasmuch as the new metric batteries will be Open Access, there will also be multiple metrics for detecting metric anomalies, inconsistency and manipulation, and for naming and shaming the manipulators, which will serve to control the temptation. Harnad, S. (2001) Research access, impact and assessment. Times Higher Education Supplement 1487: p. 16. http://cogprints.org/1683/ Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) Mandated online RAE CVs Linked to University Eprint Archives: Improving the UK Research Assessment Exercise whilst making it cheaper and easier. Ariadne 35. http://www.ariadne.ac.uk/issue35/harnad/ Brody, T., Kampa, S., Harnad, S., Carr, L. and Hitchcock, S. (2003) Digitometric Services for Open Archives Environments. In Proceedings of European Conference on Digital Libraries 2003, pp. 207-220, Trondheim, Norway. http://eprints.ecs.soton.ac.uk/7503/ Harnad, S. (2007) Open Access Scientometrics and the UK Research Assessment Exercise. In Proceedings of 11th Annual Meeting of the International Society for Scientometrics and Informetrics 11(1), pp. 27-33, Madrid, Spain. Torres-Salinas, D. and Moed, H. F., Eds. http://eprints.ecs.soton.ac.uk/13804/ Brody, T., Carr, L., Harnad, S. and Swan, A. (2007) Time to Convert to Metrics. Research Fortnight pp. 17-18. http://eprints.ecs.soton.ac.uk/14329/ Brody, T., Carr, L., Gingras, Y., Hajjem, C., Harnad, S. and Swan, A. (2007) Incentivizing the Open Access Research Web: Publication- Archiving, Data-Archiving and Scientometrics. CTWatch Quarterly 3(3). http://eprints.ecs.soton.ac.uk/14418/ Harnad, S. (2008) Self-Archiving, Metrics and Mandates. Science Editor 31(2) 57-59 Harnad, S. (2008) Validating Research Performance Metrics Against Peer Rankings. Ethics in Science and Environmental Politics 8 (11 doi: 10.3354/esep00088 http://eprints.ecs.soton.ac.uk/15619/ > On Wed, 11 Jun 2008 18:05:36 +0200 > "Armbruster, Chris" wrote: >> It is true that Thomson is misspelled as Thompson, but >> it is so consistently. It also the case that the Leiden >> stalwarts A.J.F. van Raan (wide body of work on >> performance measurement, university ranking etc.) and >> H.F. Moed (Book: Citation analysis in research >> evaluation) are not cited. >> >> Nevertheless, after reading the report, I would caution >> against dismissing it. Science and scientists should be >> concerned about the politicisation of metrics. >> Politicisation comes from governments and research >> funders but is also going on inside academic >> institutions. Moreover, in a general sense the citation >> and usage metrics currently available are not 'fit for >> purpose'. Worse still, politicisation carries with it the >> significant risk of arresting the development of tools >> for metric research evaluation. Evaluation is often >> narrowly defined as assessment and performance of >> institutions and indivudals for the purpose of awarding >> or denying funding and employment. This is something >> entirely different from metric evaluation as research >> information service to aid scientists in reducing the >> complexity of scientific information in their daily >> research. >> >> All we have at the moment are some 'quick fix metrics'. >> And these are increasingly used to make and legitimate >> all kinds of decisions. It is thus welcome that >> mathematicians and statisticians scrutinise current >> practices and show up the lack of validity and >> reliability of many measures, technical faults as well as >> the misguided judgements of peers, university management, >> funding agencies and government. >> >> My own contribution (working paper) may be found with >> SSRN: >> Armbruster, Chris, "Access, Usage and Citation Metrics: >> What Function for Digital Libraries and Repositories in >> Research Evaluation?" (January 29, 2008). >> Available at SSRN: http://ssrn.com/abstract=1088453 >> >> If the link is broken, please use a search engine *SSRN >> plus title* >> >> Chris Armbruster >> >> -----Original Message----- >> From: American Scientist Open Access Forum on behalf of >> C.Oppenheim at lboro.ac.uk >> Sent: Wed 11/06/2008 14:56 >> To: >> AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM at LISTSERVER.SIGMAXI.ORG >> Subject: Re: Citation statistics >> >> I haven't had a chance to read the report yet, but I'd >> be suspicious of any report that fails to spell "Thomson" >> correctly and fails to cite Ton van Raan, THE expert on >> the subject. >> >> Charles >> >> Professor Charles Oppenheim >> Head >> Department of Information Science >> Loughborough University >> Loughborough >> Leics LE11 3TU >> >> Tel 01509-223065 >> Fax 01509 223053 >> e mail c.oppenheim at lboro.ac.uk >> -----Original Message----- >> From: American Scientist Open Access Forum >> [mailto:AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM at LISTSERVER.SIGMAXI.ORG] >> On Behalf Of Jean Kempf >> Sent: 11 June 2008 12:01 >> To: >> AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM at LISTSERVER.SIGMAXI.ORG >> Subject: Citation statistics >> >> Here's a report on citation statistics written by a >> statistician >> >> http://www.mathunion.org/Publications/Report/CitationStatistics >> >> A press release that was mailed out today to journalists >> is at: >> >> http://www.mathunion.org/Publications/PressRelease/2008-06-11/CitationStatistics -------------- next part -------------- An HTML attachment was scrubbed... URL: From loet at LEYDESDORFF.NET Sun Jun 15 14:08:02 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Sun, 15 Jun 2008 20:08:02 +0200 Subject: Citation statistics In-Reply-To: <4CC42781-AB36-4E43-9EBC-DAA627EC9CD6@ecs.soton.ac.uk> Message-ID: > > But what all this valuable, valid cautionary discussion overlooks is not > only the possibility but the *empirically demonstrated fact* that there > exist metrics that are highly correlated with human expert rankings. > Dear Steven, It seems to me that it is difficult to generalize from one setting in which human experts and certain ranks coincided to the *existence *of such correlations across the board. Much may depend on how the experts are selected. I did some research in which referee reports did not correlate with citation and publication measures. Human experts are necessarily selected from a population of experts, and it is often difficult to delineate between fields of expertise. Similarly, we know from quite some research that citation and publication practices are field-specific and that fields are not so easy to delineate. Results may be very sensitive to choices made, for example, in terms of citation windows. Thus, I am bit doubtful about your claims of an "empirically demonstrated fact." With best wishes, Loet -------------- next part -------------- An HTML attachment was scrubbed... URL: From harnad at ECS.SOTON.AC.UK Mon Jun 16 09:20:26 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Mon, 16 Jun 2008 14:20:26 +0100 Subject: Citation statistics In-Reply-To: Message-ID: On Sun, 15 Jun 2008, Loet Leydesdorff wrote: >> SH: But what all this valuable, valid cautionary discussion overlooks is not >> only the possibility but the *empirically demonstrated fact* that there >> exist metrics that are highly correlated with human expert rankings. > > It seems to me that it is difficult to generalize from one setting in which > human experts and certain ranks coincided to the *existence *of such > correlations across the board. Much may depend on how the experts are > selected. I did some research in which referee reports did not correlate > with citation and publication measures. Much may depend on how the experts are selected, but that was just as true during the 20 years in which rankings by experts were the sole criterion for the rankings in the UR Research Assessment Exercise (RAE). (In validating predictive metrics one must not endeavor to be Holier than the Pope: Your predictor can at best hope to be as good as, but not better than, your criterion.) That said: All correlations to date between total departmental author citation counts (not journal impact factors!) and RAE peer rankings have been positive, sizable, and statistically significant for the RAE, in all disciplines and all years tested. Variance there will be, always, but a good-sized component from citations alone seems to be well-established. Please see the studies of Professor Oppenheim and others, for example as cited in: Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) Mandated online RAE CVs Linked to University Eprint Archives: Improving the UK Research Assessment Exercise whilst making it cheaper and easier. Ariadne 35. http://www.ariadne.ac.uk/issue35/harnad/ > Human experts are necessarily selected from a population of experts, and it > is often difficult to delineate between fields of expertise. Correct. And the RAE rankings are done separately, discipline by discipline; the validation of the metrics should be done that way too. Perhaps there is sometimes a case for separate rankings even at sub-disciplinary level. I expect the departments will be able to sort that out. (And note that the RAE correlations do not constitute a validation of metrics for evaluating individuals: I am confident that that too will be possible, but it will require many more metrics and much more validation.) > Similarly, we > know from quite some research that citation and publication practices are > field-specific and that fields are not so easy to delineate. Results may be > very sensitive to choices made, for example, in terms of citation windows. As noted, some of the variance in peer judgments will depend on the sample of peers chosen; that is unavoidable. That is also why "light touch" peer re-validation, spot-checks, updates and optimizations on the initialized metric weights are also a good idea, across the years. As to the need to evaluate sub-disciplines independently: that question exceeds the scope of metrics and metric validation. > Thus, I am bit doubtful about your claims of an "empirically demonstrated > fact." Within the scope mentioned -- the RAE peer rankings, for disciplines such as they have been partitioned for the past two decades -- there is ample grounds for confidence in the empirical results to date. (And please note that this has nothing to do with journal impact factors, journal field classification, or journal rankings. It is about the RAE and the ranking of university departments by peer panels, as correlated with citation counts.) Stevan Harnad AMERICAN SCIENTIST OPEN ACCESS FORUM: http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-Forum.html http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ UNIVERSITIES and RESEARCH FUNDERS: If you have adopted or plan to adopt a policy of providing Open Access to your own research article output, please describe your policy at: http://www.eprints.org/signup/sign.php http://openaccess.eprints.org/index.php?/archives/71-guid.html http://openaccess.eprints.org/index.php?/archives/136-guid.html OPEN-ACCESS-PROVISION POLICY: BOAI-1 ("Green"): Publish your article in a suitable toll-access journal http://romeo.eprints.org/ OR BOAI-2 ("Gold"): Publish your article in an open-access journal if/when a suitable one exists. http://www.doaj.org/ AND in BOTH cases self-archive a supplementary version of your article in your own institutional repository. http://www.eprints.org/self-faq/ http://archives.eprints.org/ http://openaccess.eprints.org/ From garfield at CODEX.CIS.UPENN.EDU Mon Jun 16 09:40:20 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 16 Jun 2008 09:40:20 -0400 Subject: Coverdale, JH; Roberts, LW; Balon, R; Louie, AK; Beresin, EV Improving the "Impact" of Academic Psychiatry ACADEMIC PSYCHIATRY, 32 (3): 169-172 MAY-JUN 2008 Message-ID: Email Address: jhc at bcm.tmc.edu URL: http://ap.psychiatryonline.org/cgi/content/full/32/3/169 Author(s): Coverdale, JH (Coverdale, John H.); Roberts, LW (Roberts, Laura Weiss); Balon, R (Balon, Richard); Louie, AK (Louie, Alan K.); Beresin, EV (Beresin, Eugene V.) Title: Improving the "Impact" of Academic Psychiatry Source: ACADEMIC PSYCHIATRY, 32 (3): 169-172 MAY-JUN 2008 Comment: "While the authors of this editorial are concerned with the topic of academic psychiatry what they say should be read by any editor or publisher seeking to improve the quality and thereby the impact of his or her journal. And certainly bibliometricians can use their guidelines in advising administrators on the complex question of comparing the quality of journals." EG Language: English Document Type: Editorial Material Keywords Plus: JOURNALS Cited Reference Count: 13 Times Cited: 0 Publisher: AMER PSYCHIATRIC PUBLISHING, INC Publisher Address: 1000 WILSON BOULEVARD, STE 1825, ARLINGTON, VA 22209- 3901 USA ISSN: 1042-9670 29-char Source Abbrev.: ACAD PSYCHIATRY ISO Source Abbrev.: Acad. Psych. Source Item Page Count: 4 Subject Category: Education & Educational Research; Psychiatry ISI Document Delivery No.: 299XI BALON R Globalization of medical and psychiatric education and the focus of Academic psychiatry on the success of "International" authors ACADEMIC PSYCHIATRY 32 : 151 2008 BLOCH S The Impact Factor: Time for change AUSTRALIAN AND NEW ZEALAND JOURNAL OF PSYCHIATRY 35 : 563 2001 BROWN H How impact factors changed medical publishing - and science BRITISH MEDICAL JOURNAL 334 : 561 2007 CALLAHAM M Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 287 : 2847 2002 COVERDALE J Enhancing the international status of Academic Psychiatry ACADEMIC PSYCHIATRY 31 : 177 2007 COVERDALE J Writing the methods ACADEMIC PSYCHIATRY 30 : 361 2006 GARFIELD E The history and meaning of the journal impact factor JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 295 : 90 2006 HOWARD L Impact factors of psychiatric journals BRITISH JOURNAL OF PSYCHIATRY 170 : 109 1997 JOYCE PR Mental health research in Australia and New Zealand AUSTRALIAN AND NEW ZEALAND JOURNAL OF PSYCHIATRY 39 : 531 2005 LEWISON G Fair assessment of the merits of psychiatric research BRITISH JOURNAL OF PSYCHIATRY 190 : 314 DOI 10.1192/bjp.bp.106.024919 2007 MARTYN C Advice to a new editor BRITISH MEDICAL JOURNAL 334 : 586 2007 OPTHOF T Sense and nonsense about the impact factor CARDIOVASCULAR RESEARCH 33 : 1 1997 ROBERTS LW How to review a manuscript: A "Down-to-Earth" approach ACADEMIC PSYCHIATRY 28 : 81 2004 From garfield at CODEX.CIS.UPENN.EDU Mon Jun 16 09:59:58 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 16 Jun 2008 09:59:58 -0400 Subject: Wouters, P (Wouters, Paul) Towards the origins of scientometrics the emergence of the Science Citation Index ACTES DE LA RECHERCHE EN SCIENCES SOCIALES, (164): 10-+ SEP 2006 Message-ID: E-mail Address: paul.wouters at vks.knaw.nl Note: The editor of the French social science journal Julien Duval translated the following paper by Paul Wouters. We somehow overlooked the fact that it had appeared earlier in an ASIS Monograph under a different title. The full reference is : Wouters, P.F. The creation of the SCI, in: Mary Ellen Bowden, Trudi Bellardo Hahn and Robert V. Williams (Eds) Proceedings of the 1998 Conference on the History and Heritage of Science Information Systems, American Society for Information Science Monographies, pp. 127-136. The full proceedings of that conference are worth your attention. Contact Paul Wolters for a reprint in English at paul.wouters at vks.knaw.nl Author(s): Wouters, P (Wouters, Paul) Title: Towards the origins of scientometrics the emergence of the Science Citation Index Source: ACTES DE LA RECHERCHE EN SCIENCES SOCIALES, (164): 10-+ SEP 2006 Language: French Document Type: Article Abstract: The article analyzes the emergence of the Science Citation Index (SCI) and argues that the concept of citation indexing was not a "natural" outgrowth of the scientific field. It originated in the area of US legal publishing and information services, and was translated into a scientific reference service by an information entrepreneur, Eugene Garfield. The actual creation of the Science Citation Index and the subsequent development of the field of scientometrics were strongly shaped by the political and technological context of the late 1950s -early 1960s. The way the US responded to the Sputnik crisis and the Soviet challenge provided the opportunity for Garfield to build the Science Citation Index in close cooperation with the Nobel laureate Joshua Lederberg and to gain the legitimacy that his project previously lacked. Addresses: Royal Netherlands Acad Arts & Sci, Virtual Knowledge Studio Human & Soc Sci, VKS, 1090 HC Amsterdam, Netherlands Reprint Address: Wouters, P, Royal Netherlands Acad Arts & Sci, Virtual Knowledge Studio Human & Soc Sci, VKS, Cruquiusweg 31, 1090 HC Amsterdam, Netherlands. E-mail Address: paul.wouters at vks.knaw.nl Cited Reference Count: 33 Times Cited: 0 Publisher: EDITIONS SEUIL Publisher Address: 27 RUE JACOB, PARIS, 75006, FRANCE ISSN: 0335-5322 29-char Source Abbrev.: ACTES RECH SCI SOC ISO Source Abbrev.: Actes Rech. Sci. Soc. Source Item Page Count: 13 Subject Category: Social Sciences, Interdisciplinary ISI Document Delivery No.: 076DS ADAIR WC AM DOC 6 : 31 1955 ADAIR WC COMMUNICATION 0310 : 1953 ADAIR WC SCIENCE 122 : 108 1955 ALLEN G COMMUNICATION 0124 : 1957 BAZEMAN C SHAPING WRITTEN KNOW : 1998 COLE J MEASURING QUALITY OF SOCIOLOGICAL RESEARCH - PROBLEMS IN USE OF SCIENCE CITATION INDEX AMERICAN SOCIOLOGIST 6 : 23 1971 GARFIELD E ACTES C INT INF SCI 1 : 461 1959 GARFIELD E APPL NEWSPAPER PUBLI : 1962 GARFIELD E ARCH PRIVEES : 1960 GARFIELD E CITATION INDEXES OLD : 1956 GARFIELD E COMMUNICATION 0306 : 1962 GARFIELD E COMMUNICATION 0316 : 1953 GARFIELD E COMMUNICATION 0521 : 1959 GARFIELD E COMMUNICATION 0709 : 1962 GARFIELD E COMMUNICATION 1110 : 1961 GARFIELD E ENTRETIENS AUTEUR : 1992 GARFIELD E IAAAS : 1955 GARFIELD E BREAKING THE SUBJECT INDEX BARRIER - A CITATION INDEX FOR CHEMICAL PATENTS JOURNAL OF THE PATENT OFFICE SOCIETY 39 : 583 1957 GARFIELD E NATL SCI FDN : 1959 GARFIELD E SHEPARDIZING SCI LIT : 1954 GRAY D COMMUNICATION 1023 : 1958 KESSLER MM EXPT STUDY BIBLIO CO : 1961 LARKEY SV B MED LIBR ASSOC 37 : 121 1949 LEDERBERG J COMMUNICATION 0226 : 1962 LEDERBERG J COMMUNICATION 0509 : 1959 LEDERBERG J COMMUNICATION 0618 : 1959 LEDERBERG J COMMUNICATION 1109 : 1962 MERTON RK NORMATIVE STRUCTURE : 1973 MILLER E B MED LIB ASS 49 : 1 1961 TUKEY JW KEEPING RESEARCH IN CONTACT WITH THE LITERATURE - CITATION INDICES AND BEYOND JOURNAL OF CHEMICAL DOCUMENTATION 2 : 34 1962 TUKEY W STAT TECHNIQUES RES : 1962 WOUTERS P THESIS U AMSTERDAM : 1999 ZUCKERMAN H SCI ELITE NOBEL LAUR : 1996 From notsjb at LSU.EDU Mon Jun 16 10:00:51 2008 From: notsjb at LSU.EDU (Stephen J Bensman) Date: Mon, 16 Jun 2008 09:00:51 -0500 Subject: PS Citation statistics Message-ID: For the hell of it, I just checked the correlation between peer ratings and citation per faculty member in the evaluation of US research-doctorate programs conducted by the National Research Council in 1993. It was a mere 0.56--not high enough to solicit much confidence. The corresponding correlations for chemistry and physics were 0.81 and 0.70. These correlations would rise significantly if total cites per program were substituted, but it does indicate that math is somewhat of a different kettle of fish. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu -----Original Message----- From: Stephen J Bensman Sent: Monday, June 16, 2008 8:49 AM To: 'ASIS&T Special Interest Group on Metrics' Subject: RE: [SIGMETRICS] Citation statistics In re the discussion here. Mathematics be a peculiar field in that it acts more like a humanities than a science. The literature cited is much older, and cites and library use are distributed much more randomly. Moreover, I have a funny feeling that the impact factor distribution may be Poisson or binomial due to the absence of dominant review journals due to an inability to form consensual paradigms. I discussed this matter with the chairman of the LSU math department, and he stated that mathematicians not only do not know the answers, they do not even know the questions. He also pointed out that it is always "Mathematics and the Sciences" in group classifications, indicating that math is something different. It is like "Social and the Behavioral Sciences." If this is the case, and math acts more like a humanities than a science, then citation analysis may be out of the question, and it is necessary to rely on peer judgment. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu -----Original Message----- From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad Sent: Monday, June 16, 2008 8:20 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Citation statistics On Sun, 15 Jun 2008, Loet Leydesdorff wrote: >> SH: But what all this valuable, valid cautionary discussion overlooks is not >> only the possibility but the *empirically demonstrated fact* that there >> exist metrics that are highly correlated with human expert rankings. > > It seems to me that it is difficult to generalize from one setting in which > human experts and certain ranks coincided to the *existence *of such > correlations across the board. Much may depend on how the experts are > selected. I did some research in which referee reports did not correlate > with citation and publication measures. Much may depend on how the experts are selected, but that was just as true during the 20 years in which rankings by experts were the sole criterion for the rankings in the UR Research Assessment Exercise (RAE). (In validating predictive metrics one must not endeavor to be Holier than the Pope: Your predictor can at best hope to be as good as, but not better than, your criterion.) That said: All correlations to date between total departmental author citation counts (not journal impact factors!) and RAE peer rankings have been positive, sizable, and statistically significant for the RAE, in all disciplines and all years tested. Variance there will be, always, but a good-sized component from citations alone seems to be well-established. Please see the studies of Professor Oppenheim and others, for example as cited in: Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) Mandated online RAE CVs Linked to University Eprint Archives: Improving the UK Research Assessment Exercise whilst making it cheaper and easier. Ariadne 35. http://www.ariadne.ac.uk/issue35/harnad/ > Human experts are necessarily selected from a population of experts, and it > is often difficult to delineate between fields of expertise. Correct. And the RAE rankings are done separately, discipline by discipline; the validation of the metrics should be done that way too. Perhaps there is sometimes a case for separate rankings even at sub-disciplinary level. I expect the departments will be able to sort that out. (And note that the RAE correlations do not constitute a validation of metrics for evaluating individuals: I am confident that that too will be possible, but it will require many more metrics and much more validation.) > Similarly, we > know from quite some research that citation and publication practices are > field-specific and that fields are not so easy to delineate. Results may be > very sensitive to choices made, for example, in terms of citation windows. As noted, some of the variance in peer judgments will depend on the sample of peers chosen; that is unavoidable. That is also why "light touch" peer re-validation, spot-checks, updates and optimizations on the initialized metric weights are also a good idea, across the years. As to the need to evaluate sub-disciplines independently: that question exceeds the scope of metrics and metric validation. > Thus, I am bit doubtful about your claims of an "empirically demonstrated > fact." Within the scope mentioned -- the RAE peer rankings, for disciplines such as they have been partitioned for the past two decades -- there is ample grounds for confidence in the empirical results to date. (And please note that this has nothing to do with journal impact factors, journal field classification, or journal rankings. It is about the RAE and the ranking of university departments by peer panels, as correlated with citation counts.) Stevan Harnad AMERICAN SCIENTIST OPEN ACCESS FORUM: http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-For um.html http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ UNIVERSITIES and RESEARCH FUNDERS: If you have adopted or plan to adopt a policy of providing Open Access to your own research article output, please describe your policy at: http://www.eprints.org/signup/sign.php http://openaccess.eprints.org/index.php?/archives/71-guid.html http://openaccess.eprints.org/index.php?/archives/136-guid.html OPEN-ACCESS-PROVISION POLICY: BOAI-1 ("Green"): Publish your article in a suitable toll-access journal http://romeo.eprints.org/ OR BOAI-2 ("Gold"): Publish your article in an open-access journal if/when a suitable one exists. http://www.doaj.org/ AND in BOTH cases self-archive a supplementary version of your article in your own institutional repository. http://www.eprints.org/self-faq/ http://archives.eprints.org/ http://openaccess.eprints.org/ From notsjb at LSU.EDU Mon Jun 16 09:48:38 2008 From: notsjb at LSU.EDU (Stephen J Bensman) Date: Mon, 16 Jun 2008 08:48:38 -0500 Subject: Citation statistics In-Reply-To: A Message-ID: In re the discussion here. Mathematics be a peculiar field in that it acts more like a humanities than a science. The literature cited is much older, and cites and library use are distributed much more randomly. Moreover, I have a funny feeling that the impact factor distribution may be Poisson or binomial due to the absence of dominant review journals due to an inability to form consensual paradigms. I discussed this matter with the chairman of the LSU math department, and he stated that mathematicians not only do not know the answers, they do not even know the questions. He also pointed out that it is always "Mathematics and the Sciences" in group classifications, indicating that math is something different. It is like "Social and the Behavioral Sciences." If this is the case, and math acts more like a humanities than a science, then citation analysis may be out of the question, and it is necessary to rely on peer judgment. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu -----Original Message----- From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad Sent: Monday, June 16, 2008 8:20 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Citation statistics On Sun, 15 Jun 2008, Loet Leydesdorff wrote: >> SH: But what all this valuable, valid cautionary discussion overlooks is not >> only the possibility but the *empirically demonstrated fact* that there >> exist metrics that are highly correlated with human expert rankings. > > It seems to me that it is difficult to generalize from one setting in which > human experts and certain ranks coincided to the *existence *of such > correlations across the board. Much may depend on how the experts are > selected. I did some research in which referee reports did not correlate > with citation and publication measures. Much may depend on how the experts are selected, but that was just as true during the 20 years in which rankings by experts were the sole criterion for the rankings in the UR Research Assessment Exercise (RAE). (In validating predictive metrics one must not endeavor to be Holier than the Pope: Your predictor can at best hope to be as good as, but not better than, your criterion.) That said: All correlations to date between total departmental author citation counts (not journal impact factors!) and RAE peer rankings have been positive, sizable, and statistically significant for the RAE, in all disciplines and all years tested. Variance there will be, always, but a good-sized component from citations alone seems to be well-established. Please see the studies of Professor Oppenheim and others, for example as cited in: Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) Mandated online RAE CVs Linked to University Eprint Archives: Improving the UK Research Assessment Exercise whilst making it cheaper and easier. Ariadne 35. http://www.ariadne.ac.uk/issue35/harnad/ > Human experts are necessarily selected from a population of experts, and it > is often difficult to delineate between fields of expertise. Correct. And the RAE rankings are done separately, discipline by discipline; the validation of the metrics should be done that way too. Perhaps there is sometimes a case for separate rankings even at sub-disciplinary level. I expect the departments will be able to sort that out. (And note that the RAE correlations do not constitute a validation of metrics for evaluating individuals: I am confident that that too will be possible, but it will require many more metrics and much more validation.) > Similarly, we > know from quite some research that citation and publication practices are > field-specific and that fields are not so easy to delineate. Results may be > very sensitive to choices made, for example, in terms of citation windows. As noted, some of the variance in peer judgments will depend on the sample of peers chosen; that is unavoidable. That is also why "light touch" peer re-validation, spot-checks, updates and optimizations on the initialized metric weights are also a good idea, across the years. As to the need to evaluate sub-disciplines independently: that question exceeds the scope of metrics and metric validation. > Thus, I am bit doubtful about your claims of an "empirically demonstrated > fact." Within the scope mentioned -- the RAE peer rankings, for disciplines such as they have been partitioned for the past two decades -- there is ample grounds for confidence in the empirical results to date. (And please note that this has nothing to do with journal impact factors, journal field classification, or journal rankings. It is about the RAE and the ranking of university departments by peer panels, as correlated with citation counts.) Stevan Harnad AMERICAN SCIENTIST OPEN ACCESS FORUM: http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-For um.html http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ UNIVERSITIES and RESEARCH FUNDERS: If you have adopted or plan to adopt a policy of providing Open Access to your own research article output, please describe your policy at: http://www.eprints.org/signup/sign.php http://openaccess.eprints.org/index.php?/archives/71-guid.html http://openaccess.eprints.org/index.php?/archives/136-guid.html OPEN-ACCESS-PROVISION POLICY: BOAI-1 ("Green"): Publish your article in a suitable toll-access journal http://romeo.eprints.org/ OR BOAI-2 ("Gold"): Publish your article in an open-access journal if/when a suitable one exists. http://www.doaj.org/ AND in BOTH cases self-archive a supplementary version of your article in your own institutional repository. http://www.eprints.org/self-faq/ http://archives.eprints.org/ http://openaccess.eprints.org/ From harnad at ECS.SOTON.AC.UK Mon Jun 16 10:26:41 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Mon, 16 Jun 2008 10:26:41 -0400 Subject: PS Citation statistics In-Reply-To: Message-ID: On 16-Jun-08, at 10:00 AM, Stephen J Bensman wrote: > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > For the hell of it, I just checked the correlation between peer > ratings > and citation per faculty member in the evaluation of US > research-doctorate programs conducted by the National Research Council > in 1993. It was a mere 0.56--not high enough to solicit much > confidence. The corresponding correlations for chemistry and physics > were 0.81 and 0.70. These correlations would rise significantly if > total cites per program were substituted, but it does indicate that > math > is somewhat of a different kettle of fish. Good evidence for the need to validate a battery of metrics, not just citation counts. But certainly not evidence that a battery of metrics could not raise that correlation still higher... Stevan Harnad American Scientist Open Access Forum http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-Forum.html Chaire de recherche du Canada Professor of Cognitive Science Institut des sciences cognitives Electronics & Computer Science Universite du Quebec a Montreal University of Southampton Montreal, Quebec Highfield, Southampton Canada H3C 3P8 SO17 1BJ United Kingdom http://www.crsc.uqam.ca/ http://users.ecs.soton.ac.uk/harnad/ > > > Stephen J. Bensman > LSU Libraries > Louisiana State University > Baton Rouge, LA 70803 > USA > notsjb at lsu.edu > -----Original Message----- > From: Stephen J Bensman > Sent: Monday, June 16, 2008 8:49 AM > To: 'ASIS&T Special Interest Group on Metrics' > Subject: RE: [SIGMETRICS] Citation statistics > > In re the discussion here. Mathematics be a peculiar field in that it > acts more like a humanities than a science. The literature cited is > much older, and cites and library use are distributed much more > randomly. Moreover, I have a funny feeling that the impact factor > distribution may be Poisson or binomial due to the absence of dominant > review journals due to an inability to form consensual paradigms. I > discussed this matter with the chairman of the LSU math department, > and > he stated that mathematicians not only do not know the answers, they > do > not even know the questions. He also pointed out that it is always > "Mathematics and the Sciences" in group classifications, indicating > that > math is something different. It is like "Social and the Behavioral > Sciences." If this is the case, and math acts more like a humanities > than a science, then citation analysis may be out of the question, and > it is necessary to rely on peer judgment. > > Stephen J. Bensman > LSU Libraries > Louisiana State University > Baton Rouge, LA 70803 > USA > notsjb at lsu.edu > > -----Original Message----- > From: ASIS&T Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad > Sent: Monday, June 16, 2008 8:20 AM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: Re: [SIGMETRICS] Citation statistics > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > On Sun, 15 Jun 2008, Loet Leydesdorff wrote: > >>> SH: But what all this valuable, valid cautionary discussion >>> overlooks > is not >>> only the possibility but the *empirically demonstrated fact* that > there >>> exist metrics that are highly correlated with human expert rankings. >> >> It seems to me that it is difficult to generalize from one setting in > which >> human experts and certain ranks coincided to the *existence *of such >> correlations across the board. Much may depend on how the experts are >> selected. I did some research in which referee reports did not > correlate >> with citation and publication measures. > > Much may depend on how the experts are selected, but that was just as > true during the 20 years in which rankings by experts were the sole > criterion for the rankings in the UR Research Assessment Exercise > (RAE). (In validating predictive metrics one must not endeavor to be > Holier than the Pope: Your predictor can at best hope to be as good > as, > but not better than, your criterion.) > > That said: All correlations to date between total departmental author > citation counts (not journal impact factors!) and RAE peer rankings > have been positive, sizable, and statistically significant for the > RAE, in all disciplines and all years tested. Variance there will be, > always, but a good-sized component from citations alone seems to be > well-established. Please see the studies of Professor Oppenheim and > others, for example as cited in: > > Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) Mandated > online > RAE CVs Linked to University Eprint Archives: Improving the UK > Research > Assessment Exercise whilst making it cheaper and easier. Ariadne > 35. > http://www.ariadne.ac.uk/issue35/harnad/ > >> Human experts are necessarily selected from a population of experts, > and it >> is often difficult to delineate between fields of expertise. > > Correct. And the RAE rankings are done separately, discipline by > discipline; the validation of the metrics should be done that way too. > > Perhaps there is sometimes a case for separate rankings even at > sub-disciplinary level. I expect the departments will be able to sort > that out. (And note that the RAE correlations do not constitute a > validation of metrics for evaluating individuals: I am confident that > that too will be possible, but it will require many more metrics and > much more validation.) > >> Similarly, we >> know from quite some research that citation and publication practices > are >> field-specific and that fields are not so easy to delineate. Results > may be >> very sensitive to choices made, for example, in terms of citation > windows. > > As noted, some of the variance in peer judgments will depend on the > sample of peers chosen; that is unavoidable. That is also why "light > touch" peer re-validation, spot-checks, updates and optimizations on > the > initialized metric weights are also a good idea, across the years. > > As to the need to evaluate sub-disciplines independently: that > question > exceeds the scope of metrics and metric validation. > >> Thus, I am bit doubtful about your claims of an "empirically > demonstrated >> fact." > > Within the scope mentioned -- the RAE peer rankings, for disciplines > such as they have been partitioned for the past two decades -- there > is > ample grounds for confidence in the empirical results to date. > > (And please note that this has nothing to do with journal impact > factors, > journal field classification, or journal rankings. It is about the RAE > and the ranking of university departments by peer panels, as > correlated > with citation counts.) > > Stevan Harnad > AMERICAN SCIENTIST OPEN ACCESS FORUM: > http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-For > um.html > http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ > > UNIVERSITIES and RESEARCH FUNDERS: > If you have adopted or plan to adopt a policy of providing Open Access > to your own research article output, please describe your policy at: > http://www.eprints.org/signup/sign.php > http://openaccess.eprints.org/index.php?/archives/71-guid.html > http://openaccess.eprints.org/index.php?/archives/136-guid.html > > OPEN-ACCESS-PROVISION POLICY: > BOAI-1 ("Green"): Publish your article in a suitable toll-access > journal > http://romeo.eprints.org/ > OR > BOAI-2 ("Gold"): Publish your article in an open-access journal > if/when > a suitable one exists. > http://www.doaj.org/ > AND > in BOTH cases self-archive a supplementary version of your article > in your own institutional repository. > http://www.eprints.org/self-faq/ > http://archives.eprints.org/ > http://openaccess.eprints.org/ From dwojick at HUGHES.NET Mon Jun 16 10:32:59 2008 From: dwojick at HUGHES.NET (David E. Wojick) Date: Mon, 16 Jun 2008 10:32:59 -0400 Subject: Citation statistics In-Reply-To: <4CC42781-AB36-4E43-9EBC-DAA627EC9CD6@ecs.soton.ac.uk> Message-ID: Dear Stevan, What is being peer reviewed and ranked in the RAE? Since impact factor measures past performance I presume it is also a rankng of what has happened, defined in some way. Cheers, David Steve Harnad writes: >I have now read the IMU report too, and agree with Charles that it makes many valid points but it misunderstands the one fundamental point concerning the question at hand: Can and should metrics be used in place of peer-panel based rankings in the UK Research Assessment Exercise (RAE) and its successors and homologues elsewhere? And there the answer is a definite Yes. The IMU critique points out that research metrics in particular and statistics in general are often misused, and this is certainly true. It also points out that metrics are often used without validation. This true is correct. There is also a simplistic tendency to try to use one single metric, rather than multiple metrics that can complement and correct one another. There too, a practical and methodological error is correctly pointed out. It is also true that the "journal impact factor" has many flaws, and should on no account be used to rank individual papers of researchers, and especially not alone, as a single metric. But what all this valuable, valid cautionary discussion overlooks is not only the possibility but the empirically demonstrated fact that there exist metrics that are highly correlated with human expert rankings. It follows that to the degree that such metrics account for the same variance, they can substitute for the human rankings. The substitution is desirable, because expert rankings are extremely costly in terms of expert time and resources. Moreover, a metric that can be shown to be highly correlated with an already validated variable predictor variable (such as expert rankings) thereby itself becomes a validated predictor variable. And this is why the answer to the basic question of whether the RAE's decision to convert to metrics was a sound one is: Yes. Nevertheless, the IMU's cautions are welcome: Metrics do need to be validated; they do need to be multiple, rather than a single, unidimensional index; they do have to be separately validated for each discipline, and the weights on the multiple metrics need to be calibrated and adjusted both for the discipline being assessed and for the properties on which it is being ranked. The RAE 2008 database provides the ideal opportunity to do all this discipline-specific validation and calibration, because it is providing parallel data from both peer panel rankings and metrics. The metrics, however, should be as rich and diverse as possible, to capitalize on this unique opportunity for joint validation. snip From garfield at CODEX.CIS.UPENN.EDU Mon Jun 16 11:00:16 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 16 Jun 2008 11:00:16 -0400 Subject: Chavez-Tapia, NC; Tellez-Avila, FI; Hernandez-Calleros, J; Lopez-Arce, G; Franco-Guzman, A; Uribe, M Critical analysis of awards in gastroenterology research. The Mexican experience MEDICINA-BUENOS AIRES, 68 (2): 135-138 2008 Message-ID: E-mail Address: khavez at gmail.com Author(s): Chavez-Tapia, NC (Chavez-Tapia, Norberto C.); Tellez-Avila, FI (Tellez-Avila, Felix I.); Hernandez-Calleros, J (Hernandez-Calleros, Jorge); Lopez-Arce, G (Lopez-Arce, Gustavo); Franco-Guzman, A (Franco- Guzman, Ada); Uribe, M (Uribe, Misael) Title: Critical analysis of awards in gastroenterology research. The Mexican experience Source: MEDICINA-BUENOS AIRES, 68 (2): 135-138 2008 Language: Spanish Document Type: Article Author Keywords: biomedical research; gastroenterology; prizes Abstract: The impact of Mexican gastrointestinal research worldwide is limited and the outcome of the best research papers awarded by the Asociacion Mexicana de Gastroenterologia (AMG) is unknown. The objective of this study was to analyze the publication pattern of the research work, awarded by the AMG and their impact in international journals. The abstracts accepted for the annual meeting of the AMG from 1998 to 2006 were reviewed. Those presented in a plenary session or awarded were included. Their abstracts were searched in electronic databases. When not found, the main author was contacted by e-mail. In those papers published in a journal with an impact factor, the times it was cited were assessed. 35 abstracts were identified, mainly in gastroenterology (57.1%) and hepatology (34.3). Only in 5.7% (n=2) some of the authors were members of the governing board of AMG. The awarded institutions were Instituto Nacional de Ciencias Medicas y Nutricion Salvador Zubiran (48.6%), Universities (Universidad Autonoma de Nuevo Leon, Universidad Nacional Autonoma de Mexico and the Benemerita Universidad Autonoma de Puebla) (31.4%), Instituto Mexicano del Seguro Social (8.6%), Fundacion Clinica Medica Sur (5.7%), Hospital Juarez (2.9%), Private hospital (2.9%). Most of the papers were published within a year (73.7%). Only 2 papers had more than 10 citations in another international journal with impact factor, with a median for all paper of 5 citations (045). Considering all institutions, the rate of publication is 48%. Only half of the awarded works were published and mainly in journals of local distribution. The impact of these studies worldwide is limited. Addresses: Inst Nacl Ciencias Med & Nutr Salvador Zubiran, Dept Gastroenterol, Ciudad De Mexico, Mexico Reprint Address: Chavez-Tapia, NC, Inst Nacl Ciencias Med & Nutr Salvador Subiran, Dept Gastroenterol, Vasco Quiroga 5,Col Secc 16, Del Tlalpan 14000, DF, Mexico. E-mail Address: khavez at gmail.com Cited Reference Count: 8 Times Cited: 0 Publisher: MEDICINA (BUENOS AIRES) Publisher Address: DONATO ALVAREZ 3150, 1427 BUENOS AIRES, ARGENTINA ISSN: 0025-7680 29-char Source Abbrev.: MEDICINA-BUENOS AIRES ISO Source Abbrev.: Med.-Buenos Aires Source Item Page Count: 4 Subject Category: Medicine, General & Internal ISI Document Delivery No.: 302HF *AS MEX GASTR CONV : 2007 CASTRO RC ACTA CIR BRAS 21 : 122 2006 HARRISON L INT J NURS ED SCHOLA 2 : ARTN 24 2005 HERMESLIMA M Whither Latin America? Trends and challenges of science in Latin America IUBMB LIFE 59 : 199 DOI 10.1080/15216540701258751 2007 PEREZTAMAYO R HIST GEN CIENCIA MEX 20 : 2006 RAHMAN M Biomedical publication - global profile and trend PUBLIC HEALTH 117 : 274 DOI 10.1016/S0033-3506(03)00068-4 2003 SILVA H AM J THER 13 : 309 2006 WEISINGER JR Latin American nephrology: Scientific production and impact of the publications KIDNEY INTERNATIONAL 56 : 1584 1999 From harnad at ECS.SOTON.AC.UK Mon Jun 16 11:24:38 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Mon, 16 Jun 2008 11:24:38 -0400 Subject: Citation statistics In-Reply-To: Message-ID: Dear David: Past RAEs (for 20+ years, about every 6-7 years or so) ranked research performance, department by department, for the preceding research interval. It did so using a large submitted dossier (not including citations or the journal impact factor, which was explicitly forbidden), mainly the researchers' 4 best papers each, as evaluated by a peer panel, for each discipline. The rankings turned out to be highly correlated with total departmental citation counts anyway. The proposal now is to replace peer rankings with metrics. My proposal is to replace it with a battery of metrics, validated against the peer rankings, in this last RAE 2008 parallel metric/panel exercise. Chrs, Stevan On 16-Jun-08, at 10:32 AM, David E. Wojick wrote: > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > Dear Stevan, > > What is being peer reviewed and ranked in the RAE? Since impact > factor measures past performance I presume it is also a rankng of > what has happened, defined in some way. > Cheers, > David > > Steve Harnad writes: >> I have now read the IMU report too, and agree with Charles that it >> makes many valid points but it misunderstands the one fundamental >> point concerning the question at hand: Can and should metrics be >> used in place of peer-panel based rankings in the UK Research >> Assessment Exercise (RAE) and its successors and homologues >> elsewhere? And there the answer is a definite Yes. > > The IMU critique points out that research metrics in particular and > statistics in general are often misused, and this is certainly true. > It also points out that metrics are often used without validation. > This true is correct. There is also a simplistic tendency to try to > use one single metric, rather than multiple metrics that can > complement and correct one another. There too, a practical and > methodological error is correctly pointed out. It is also true that > the "journal impact factor" has many flaws, and should on no account > be used to rank individual papers of researchers, and especially not > alone, as a single metric. > > But what all this valuable, valid cautionary discussion overlooks is > not only the possibility but the empirically demonstrated fact that > there exist metrics that are highly correlated with human expert > rankings. It follows that to the degree that such metrics account > for the same variance, they can substitute for the human rankings. > The substitution is desirable, because expert rankings are extremely > costly in terms of expert time and resources. Moreover, a metric > that can be shown to be highly correlated with an already validated > variable predictor variable (such as expert rankings) thereby itself > becomes a validated predictor variable. And this is why the answer > to the basic question of whether the RAE's decision to convert to > metrics was a sound one is: Yes. > > Nevertheless, the IMU's cautions are welcome: Metrics do need to be > validated; they do need to be multiple, rather than a single, > unidimensional index; they do have to be separately validated for > each discipline, and the weights on the multiple metrics need to be > calibrated and adjusted both for the discipline being assessed and > for the properties on which it is being ranked. The RAE 2008 > database provides the ideal opportunity to do all this discipline- > specific validation and calibration, because it is providing > parallel data from both peer panel rankings and metrics. The > metrics, however, should be as rich and diverse as possible, to > capitalize on this unique opportunity for joint validation. > snip -------------- next part -------------- An HTML attachment was scrubbed... URL: From garfield at CODEX.CIS.UPENN.EDU Mon Jun 16 11:27:55 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 16 Jun 2008 11:27:55 -0400 Subject: Puljak, L; Vukojevic, K; Kojundzic, SL; Sapunar, D Assessing clinical and life sciences performance of research institutions in Split, Croatia, 2000-2006 CROATIAN MEDICAL JOURNAL, 49 (2): 164-174 APR 2008 Message-ID: E-mail Address: livia at mefst.hr Author(s): Puljak, L (Puljak, Livia); Vukojevic, K (Vukojevic, Katarina); Kojundzic, SL (Kojundzic, Sanja Lovric); Sapunar, D (Sapunar, Damir) Title: Assessing clinical and life sciences performance of research institutions in Split, Croatia, 2000-2006 Source: CROATIAN MEDICAL JOURNAL, 49 (2): 164-174 APR 2008 Language: English Document Type: Article Keywords Plus: RESEARCH PRODUCTIVITY; EUROPE Abstract: Aim To evaluate publications of clinical and life scientists from research institutions in Split, Croatia, and the publication output from government-funded research projects of the University of Split School of Medicine. Methods We analyzed the number of publications from research institutions in Split, Croatia, in the 2000-2006 period, relative impact factors, predominant research fields, output of researchers from the University of Split School of Medicine receiving government research grants, and the average price of published article. Results From 2000 to 2006, clinical and life scientists published 350 articles indexed in Thomson Scientific database Current Contents. The number of articles increased from 30 in 2000 to 76 in 2006, and the average impact factor of journals where these articles were published increased from 2.03 in 2000 to 2.89 in 2006. Twenty percent of articles (72/350) were published in the Croatian Medical journal. Principal investigators of the 12 research projects receiving government grants published 0 to 8 articles related to the project topic in the 2002-2006 research grant cycle. The research grantees published 78 original research articles, with an average price per article of (sic) 29.210. Conclusion Although the number and impact factor of research articles published by clinical and life scientists from Split, Croatia, is increasing, it is still low when the number of scientists is taken into account. There should be better mechanisms of control and evaluation of research performance of government-funded research projects. Addresses: Univ Split, Sch Med, Dept Anat Histol & Embryol, Split 21000, Croatia Reprint Address: Puljak, L, Univ Split, Sch Med, Dept Anat Histol & Embryol, Soltanska 2, Split 21000, Croatia. E-mail Address: livia at mefst.hr Cited Reference Count: 24 Times Cited: 0 Publisher: MEDICINSKA NAKLADA Publisher Address: VLASKA 69, HR-10000 ZAGREB, CROATIA ISSN: 0353-9504 29-char Source Abbrev.: CROAT MED J ISO Source Abbrev.: Croat. Med. J. Source Item Page Count: 11 Subject Category: Medicine, General & Internal ISI Document Delivery No.: 302GX SCI TECHNOLOGY POLIC : *CROAT NAT BANK GEN INF CROAT EC IND : *NAT SCI FDN SCI ENG IND : 2006 *STRAT DEV CROAT 1082003 STRAT DEV CR *THOMS SCI IMP FACT DEF : BANZHAF W Guidelines - From artificial evolution to computational evolution: a research agenda NATURE REVIEWS GENETICS 7 : 729 DOI 10.1038/nrg1921 2006 BELLAS ML Faculty time allocations and research productivity: Gender, race and family effects REVIEW OF HIGHER EDUCATION 22 : 367 1999 BIYANI AK Appalling lethargy CURRENT SCIENCE 83 : 1302 2002 FOX MF RESEARCH, TEACHING, AND PUBLICATION PRODUCTIVITY - MUTUALITY VERSUS COMPETITION IN ACADEMIA SOCIOLOGY OF EDUCATION 65 : 293 1992 HAGLUND K Ubiquitylation and cell signaling EMBO JOURNAL 24 : 3353 DOI 10.1038/sj.emboj.7600808 2005 HOELLER D Ubiquitin and ubiquitin-like proteins in cancer pathogenesis NATURE REVIEWS CANCER 6 : 776 DOI 10.1038/nrc1994 2006 JELASKA S FINANCING SCI HIGHER : JONJIC S CROAT MED J 37 : 2 1996 MARUSIC M Life of small medical journal - How bibliographical indexing and international visibility affected editorial work in Croatian Medical Journal CROATIAN MEDICAL JOURNAL 47 : 372 2006 MARUSIC M CROAT MED J 37 : 273 1996 PETROVECKI M Can Croatia join Europe as competitive knowledge-based society by 2010? CROATIAN MEDICAL JOURNAL 47 : 809 2006 POLASEK O Scientific production of research fellows at the Zagreb University School of Medicine, Croatia CROATIAN MEDICAL JOURNAL 47 : 776 2006 POLASEK O Fellowship outcomes and factors associated with scientific successfulness of junior researchers in Croatia DRUSTVENA ISTRAZIVANJA 16 : 1127 2007 PORTER SR Analyzing faculty workload data using multilevel modeling RESEARCH IN HIGHER EDUCATION 42 : 171 2001 PULJAK L Croatia founded a national body for ethics in science SCIENCE AND ENGINEERING ETHICS 13 : 191 DOI 10.1007/s11948-007-9006-9 2007 SCHMIDT MHH The Cbl interactome and its functions NATURE REVIEWS MOLECULAR CELL BIOLOGY 6 : 907 DOI 10.1038/nrm1762 2005 TOUTKOUSHIAN RK Using publications counts to measure an institution's research productivity RESEARCH IN HIGHER EDUCATION 44 : 121 2003 ZAGROVIC B Childhood of a phoenix: modern biology in Eastern and South-Eastern Europe NATURE REVIEWS MOLECULAR CELL BIOLOGY 9 : 333 DOI 10.1038/nrm2368 2008 ZAHRADKA K Reassembly of shattered chromosomes in Deinococcus radiodurans NATURE 443 : 569 DOI 10.1038/nature05160 2006 From loet at LEYDESDORFF.NET Mon Jun 16 13:40:12 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Mon, 16 Jun 2008 19:40:12 +0200 Subject: Citation statistics In-Reply-To: Message-ID: Dear Stevan, If I correctly understand then your claim is that ranking results based on peer review at the departmental level correlate highly with MEAN departmental citation rates. This would be the case for psychology, wouldn't it? It is an amazing result because one does not expect citation rates to be normally distributed. (The means of the citation rates, of coures, are normally distributed.) In my own department, for example (in communication studies), we have various communities (social-psychologists, information scientists, political science) with very different citation patterns. But perhaps, British psychology departments are exceptionally homongeneous both internally and comparatively. Then, you wish to strengthen this correlation by adding more indicators. The other indicators may correlate better or worse with the ratings. The former ones can add to the correlations, while the latter would worsen them. Or do you wish only to add indicators which improve the correlations with the ratings? I remember from a previous conversation on this subject that you have a kind of multi-variate regression model in mind in which the RAE ratings would be the dependent variable. One can make the model fit to the rankings by estimating the parameters. One can also refine this per discipline. Would one expecat any predictive power in such a model in a new situation (after 4 years)? Why? With best wishes, Loet ________________________________ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR), Kloveniersburgwal 48, 1012 CX Amsterdam. Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 loet at leydesdorff.net ; http://www.leydesdorff.net/ > -----Original Message----- > From: ASIS&T Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad > Sent: Monday, June 16, 2008 3:20 PM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: Re: [SIGMETRICS] Citation statistics > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > On Sun, 15 Jun 2008, Loet Leydesdorff wrote: > > >> SH: But what all this valuable, valid cautionary > discussion overlooks is not > >> only the possibility but the *empirically demonstrated > fact* that there > >> exist metrics that are highly correlated with human expert > rankings. > > > > It seems to me that it is difficult to generalize from one > setting in which > > human experts and certain ranks coincided to the *existence *of such > > correlations across the board. Much may depend on how the > experts are > > selected. I did some research in which referee reports did > not correlate > > with citation and publication measures. > > Much may depend on how the experts are selected, but that was just as > true during the 20 years in which rankings by experts were the sole > criterion for the rankings in the UR Research Assessment Exercise > (RAE). (In validating predictive metrics one must not endeavor to be > Holier than the Pope: Your predictor can at best hope to be > as good as, > but not better than, your criterion.) > > That said: All correlations to date between total departmental author > citation counts (not journal impact factors!) and RAE peer rankings > have been positive, sizable, and statistically significant for the > RAE, in all disciplines and all years tested. Variance there will be, > always, but a good-sized component from citations alone seems to be > well-established. Please see the studies of Professor Oppenheim and > others, for example as cited in: > > Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) > Mandated online > RAE CVs Linked to University Eprint Archives: Improving > the UK Research > Assessment Exercise whilst making it cheaper and easier. > Ariadne 35. > http://www.ariadne.ac.uk/issue35/harnad/ > > > Human experts are necessarily selected from a population of > experts, and it > > is often difficult to delineate between fields of expertise. > > Correct. And the RAE rankings are done separately, discipline by > discipline; the validation of the metrics should be done that way too. > > Perhaps there is sometimes a case for separate rankings even at > sub-disciplinary level. I expect the departments will be able to sort > that out. (And note that the RAE correlations do not constitute a > validation of metrics for evaluating individuals: I am confident that > that too will be possible, but it will require many more metrics and > much more validation.) > > > Similarly, we > > know from quite some research that citation and publication > practices are > > field-specific and that fields are not so easy to > delineate. Results may be > > very sensitive to choices made, for example, in terms of > citation windows. > > As noted, some of the variance in peer judgments will depend on the > sample of peers chosen; that is unavoidable. That is also why "light > touch" peer re-validation, spot-checks, updates and > optimizations on the > initialized metric weights are also a good idea, across the years. > > As to the need to evaluate sub-disciplines independently: > that question > exceeds the scope of metrics and metric validation. > > > Thus, I am bit doubtful about your claims of an > "empirically demonstrated > > fact." > > Within the scope mentioned -- the RAE peer rankings, for disciplines > such as they have been partitioned for the past two decades > -- there is > ample grounds for confidence in the empirical results to date. > > (And please note that this has nothing to do with journal > impact factors, > journal field classification, or journal rankings. It is about the RAE > and the ranking of university departments by peer panels, as > correlated > with citation counts.) > > Stevan Harnad > AMERICAN SCIENTIST OPEN ACCESS FORUM: > http://amsci-forum.amsci.org/archives/American-Scientist-Open- > Access-Forum.html > http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ > > UNIVERSITIES and RESEARCH FUNDERS: > If you have adopted or plan to adopt a policy of providing Open Access > to your own research article output, please describe your policy at: > http://www.eprints.org/signup/sign.php > http://openaccess.eprints.org/index.php?/archives/71-guid.html > http://openaccess.eprints.org/index.php?/archives/136-guid.html > > OPEN-ACCESS-PROVISION POLICY: > BOAI-1 ("Green"): Publish your article in a suitable > toll-access journal > http://romeo.eprints.org/ > OR > BOAI-2 ("Gold"): Publish your article in an open-access > journal if/when > a suitable one exists. > http://www.doaj.org/ > AND > in BOTH cases self-archive a supplementary version of > your article > in your own institutional repository. > http://www.eprints.org/self-faq/ > http://archives.eprints.org/ > http://openaccess.eprints.org/ > From dwojick at HUGHES.NET Mon Jun 16 14:08:29 2008 From: dwojick at HUGHES.NET (dwojick@hughes.net) Date: Mon, 16 Jun 2008 18:08:29 +0000 Subject: Peer review & impact factor correlations, was Citation statistics Message-ID: Dear Stevan, The correlation here may be due to the fact that both methods (peer review and citation statistics) are measuring popularity, or how well one is known. I am studying the logic of citation. Most journal citations are not to direct predecessors, they are used to lay out the context of the research, so the leading figures are typically cited. (This is even likely to create bandwagon effects.) So it may well be the case that citation statistics are as good as peer review, and a lot more efficient. David Wojick ----Original Message---- From: harnad at ECS.SOTON.AC.UK Date: 06/16/2008 11:24 AM To: Subj: Re: [SIGMETRICS] Citation statistics Past RAEs (for 20+ years, about every 6-7 years or so) ranked research performance, department by department, for the preceding research interval. It did so using a large submitted dossier (not including citations or the journal impact factor, which was explicitly forbidden), mainly the researchers' 4 best papers each, as evaluated by a peer panel, for each discipline. The rankings turned out to be highly correlated with total departmental citation counts anyway. The proposal now is to replace peer rankings with metrics. My proposal is to replace it with a battery of metrics, validated against the peer rankings, in this last RAE 2008 parallel metric/panel exercise. Chrs, Stevan On 16-Jun-08, at 10:32 AM, David E. Wojick wrote: Dear Stevan, What is being peer reviewed and ranked in the RAE? Since impact factor measures past performance I presume it is also a rankng of what has happened, defined in some way. Cheers, David Steve Harnad writes: I have now read the IMU report too, and agree with Charles that it makes many valid points but it misunderstands the one fundamental point concerning the question at hand: Can and should metrics be used in place of peer-panel based rankings in the UK Research Assessment Exercise (RAE) and its successors and homologues elsewhere? And there the answer is a definite Yes. The IMU critique points out that research metrics in particular and statistics in general are often misused, and this is certainly true. It also points out that metrics are often used without validation. This true is correct. There is also a simplistic tendency to try to use one single metric, rather than multiple metrics that can complement and correct one another. There too, a practical and methodological error is correctly pointed out. It is also true that the "journal impact factor" has many flaws, and should on no account be used to rank individual papers of researchers, and especially not alone, as a single metric. But what all this valuable, valid cautionary discussion overlooks is not only the possibility but the empirically demonstrated fact that there exist metrics that are highly correlated with human expert rankings. It follows that to the degree that such metrics account for the same variance, they can substitute for the human rankings. The substitution is desirable, because expert rankings are extremely costly in terms of expert time and resources. Moreover, a metric that can be shown to be highly correlated with an already validated variable predictor variable (such as expert rankings) thereby itself becomes a validated predictor variable. And this is why the answer to the basic question of whether the RAE's decision to convert to metrics was a sound one is: Yes. Nevertheless, the IMU's cautions are welcome: Metrics do need to be validated; they do need to be multiple, rather than a single, unidimensional index; they do have to be separately validated for each discipline, and the weights on the multiple metrics need to be calibrated and adjusted both for the discipline being assessed and for the properties on which it is being ranked. The RAE 2008 database provides the ideal opportunity to do all this discipline-specific validation and calibration, because it is providing parallel data from both peer panel rankings and metrics. The metrics, however, should be as rich and diverse as possible, to capitalize on this unique opportunity for joint validation. snip -------------- next part -------------- An HTML attachment was scrubbed... URL: From harnad at ECS.SOTON.AC.UK Mon Jun 16 14:46:53 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Mon, 16 Jun 2008 19:46:53 +0100 Subject: Citation statistics In-Reply-To: Message-ID: On Mon, 16 Jun 2008, Loet Leydesdorff wrote: > If I correctly understand then your claim is that ranking results based on > peer review at the departmental level correlate highly with MEAN > departmental citation rates. This would be the case for psychology, wouldn't > it? With total citations for the departmental researchers included for the interval, which amounts to the same thing. (Charles will be able to give the details better than I.) > It is an amazing result because one does not expect citation rates to be > normally distributed. (The means of the citation rates, of coures, are > normally distributed.) No, citations are not normally distributed. The usual 20/80 rule applies: The top 20% of articles receive 80% of the citations. But probably that rule applies across departments too. > In my own department, for example (in communication > studies), we have various communities (social-psychologists, information > scientists, political science) with very different citation patterns. But > perhaps, British psychology departments are exceptionally homongeneous both > internally and comparatively. Sounds like three different disciplines. It might be useful to analyze sub-departments and their respective citation patterns to make the like-with-like comparison even closer. I don't know that anyone has done that. Eventually, once journals and subject matter are better tagged, it will be possible. > Then, you wish to strengthen this correlation by adding more indicators. The > other indicators may correlate better or worse with the ratings. The former > ones can add to the correlations, while the latter would worsen them. Or do > you wish only to add indicators which improve the correlations with the > ratings? No, the validation process is to do multiple regression, to determine the contribution of each metric to the prediction of the peer rank. The non-predictive metrics would get zero weight; the anti-predictive metrics would simply need to have their polarity flipped. Once the beta weights are initialized, of course, they can still be adjusted if we have further criterion variables (other than the peer rankings), or further criteria (such as an a priori emphasis on some sorts of factors, such as, say, citation growth rate, or download decay rate, interdiscipliarity, etc.). > I remember from a previous conversation on this subject that you have a kind > of multi-variate regression model in mind in which the RAE ratings would be > the dependent variable. One can make the model fit to the rankings by > estimating the parameters. One can also refine this per discipline. Would > one expect any predictive power in such a model in a new situation (after 4 > years)? Why? That's exactly the approach I recommend in the paper I keep linking. (It's also the approach for test validation in psychometrics.) Why do I expect the correlations to replicate? Why would I expect them not to -- unless you think the peer rankings that have been governing the RAE for over two decades are random? In fact, in all fields and all years tested, they have correlated positively and substantially with the peer rankings. And that's only *one* metric. (I am recommending many.) Harnad, S. (2007) Open Access Scientometrics and the UK Research Assessment Exercise. In Proceedings of 11th Annual Meeting of the International Society for Scientometrics and Informetrics 11(1), pp. 27-33, Madrid, Spain. Torres-Salinas, D. and Moed, H. F., Eds. http://eprints.ecs.soton.ac.uk/13804/ Best wishes, Stevan Harnad > With best wishes, > > > Loet > > ________________________________ > > Loet Leydesdorff > Amsterdam School of Communications Research (ASCoR), > Kloveniersburgwal 48, 1012 CX Amsterdam. > Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 > loet at leydesdorff.net ; http://www.leydesdorff.net/ > > > >> -----Original Message----- >> From: ASIS&T Special Interest Group on Metrics >> [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad >> Sent: Monday, June 16, 2008 3:20 PM >> To: SIGMETRICS at LISTSERV.UTK.EDU >> Subject: Re: [SIGMETRICS] Citation statistics >> >> Adminstrative info for SIGMETRICS (for example unsubscribe): >> http://web.utk.edu/~gwhitney/sigmetrics.html >> >> On Sun, 15 Jun 2008, Loet Leydesdorff wrote: >> >>>> SH: But what all this valuable, valid cautionary >> discussion overlooks is not >>>> only the possibility but the *empirically demonstrated >> fact* that there >>>> exist metrics that are highly correlated with human expert >> rankings. >>> >>> It seems to me that it is difficult to generalize from one >> setting in which >>> human experts and certain ranks coincided to the *existence *of such >>> correlations across the board. Much may depend on how the >> experts are >>> selected. I did some research in which referee reports did >> not correlate >>> with citation and publication measures. >> >> Much may depend on how the experts are selected, but that was just as >> true during the 20 years in which rankings by experts were the sole >> criterion for the rankings in the UR Research Assessment Exercise >> (RAE). (In validating predictive metrics one must not endeavor to be >> Holier than the Pope: Your predictor can at best hope to be >> as good as, >> but not better than, your criterion.) >> >> That said: All correlations to date between total departmental author >> citation counts (not journal impact factors!) and RAE peer rankings >> have been positive, sizable, and statistically significant for the >> RAE, in all disciplines and all years tested. Variance there will be, >> always, but a good-sized component from citations alone seems to be >> well-established. Please see the studies of Professor Oppenheim and >> others, for example as cited in: >> >> Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) >> Mandated online >> RAE CVs Linked to University Eprint Archives: Improving >> the UK Research >> Assessment Exercise whilst making it cheaper and easier. >> Ariadne 35. >> http://www.ariadne.ac.uk/issue35/harnad/ >> >>> Human experts are necessarily selected from a population of >> experts, and it >>> is often difficult to delineate between fields of expertise. >> >> Correct. And the RAE rankings are done separately, discipline by >> discipline; the validation of the metrics should be done that way too. >> >> Perhaps there is sometimes a case for separate rankings even at >> sub-disciplinary level. I expect the departments will be able to sort >> that out. (And note that the RAE correlations do not constitute a >> validation of metrics for evaluating individuals: I am confident that >> that too will be possible, but it will require many more metrics and >> much more validation.) >> >>> Similarly, we >>> know from quite some research that citation and publication >> practices are >>> field-specific and that fields are not so easy to >> delineate. Results may be >>> very sensitive to choices made, for example, in terms of >> citation windows. >> >> As noted, some of the variance in peer judgments will depend on the >> sample of peers chosen; that is unavoidable. That is also why "light >> touch" peer re-validation, spot-checks, updates and >> optimizations on the >> initialized metric weights are also a good idea, across the years. >> >> As to the need to evaluate sub-disciplines independently: >> that question >> exceeds the scope of metrics and metric validation. >> >>> Thus, I am bit doubtful about your claims of an >> "empirically demonstrated >>> fact." >> >> Within the scope mentioned -- the RAE peer rankings, for disciplines >> such as they have been partitioned for the past two decades >> -- there is >> ample grounds for confidence in the empirical results to date. >> >> (And please note that this has nothing to do with journal >> impact factors, >> journal field classification, or journal rankings. It is about the RAE >> and the ranking of university departments by peer panels, as >> correlated >> with citation counts.) >> >> Stevan Harnad >> AMERICAN SCIENTIST OPEN ACCESS FORUM: >> http://amsci-forum.amsci.org/archives/American-Scientist-Open- >> Access-Forum.html >> http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ >> >> UNIVERSITIES and RESEARCH FUNDERS: >> If you have adopted or plan to adopt a policy of providing Open Access >> to your own research article output, please describe your policy at: >> http://www.eprints.org/signup/sign.php >> http://openaccess.eprints.org/index.php?/archives/71-guid.html >> http://openaccess.eprints.org/index.php?/archives/136-guid.html >> >> OPEN-ACCESS-PROVISION POLICY: >> BOAI-1 ("Green"): Publish your article in a suitable >> toll-access journal >> http://romeo.eprints.org/ >> OR >> BOAI-2 ("Gold"): Publish your article in an open-access >> journal if/when >> a suitable one exists. >> http://www.doaj.org/ >> AND >> in BOTH cases self-archive a supplementary version of >> your article >> in your own institutional repository. >> http://www.eprints.org/self-faq/ >> http://archives.eprints.org/ >> http://openaccess.eprints.org/ >> > From notsjb at LSU.EDU Mon Jun 16 15:22:13 2008 From: notsjb at LSU.EDU (Stephen J Bensman) Date: Mon, 16 Jun 2008 14:22:13 -0500 Subject: Citation statistics In-Reply-To: A<014001c8cfd8$080f11b0$6402a8c0@loet> Message-ID: It is generally recognized that size is an important variable in peer ratings of academic programs. For some reason the human mind is affected by size. You can test this empirically at the following Web site: http://www.nap.edu/readingroom/books/researchdoc/ This has the data tables for the 1993 NRC of US research-doctorate programs. When I converted the NRC measure of mean citation rate per program faculty member to total cites per program, I increased the correlation of the citation measure with peer ratings of scholarly quality from 0.82 to 0.91. This will happen with any discipline, and I challenge you to find a discipline in the NRC data where this does not happen. There is a new NRC evaluation under way, and the same will happen again. Size is an important component of quality in human perception. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu -----Original Message----- From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Loet Leydesdorff Sent: Monday, June 16, 2008 12:40 PM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Citation statistics Dear Stevan, If I correctly understand then your claim is that ranking results based on peer review at the departmental level correlate highly with MEAN departmental citation rates. This would be the case for psychology, wouldn't it? It is an amazing result because one does not expect citation rates to be normally distributed. (The means of the citation rates, of coures, are normally distributed.) In my own department, for example (in communication studies), we have various communities (social-psychologists, information scientists, political science) with very different citation patterns. But perhaps, British psychology departments are exceptionally homongeneous both internally and comparatively. Then, you wish to strengthen this correlation by adding more indicators. The other indicators may correlate better or worse with the ratings. The former ones can add to the correlations, while the latter would worsen them. Or do you wish only to add indicators which improve the correlations with the ratings? I remember from a previous conversation on this subject that you have a kind of multi-variate regression model in mind in which the RAE ratings would be the dependent variable. One can make the model fit to the rankings by estimating the parameters. One can also refine this per discipline. Would one expecat any predictive power in such a model in a new situation (after 4 years)? Why? With best wishes, Loet ________________________________ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR), Kloveniersburgwal 48, 1012 CX Amsterdam. Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 loet at leydesdorff.net ; http://www.leydesdorff.net/ > -----Original Message----- > From: ASIS&T Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad > Sent: Monday, June 16, 2008 3:20 PM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: Re: [SIGMETRICS] Citation statistics > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > On Sun, 15 Jun 2008, Loet Leydesdorff wrote: > > >> SH: But what all this valuable, valid cautionary > discussion overlooks is not > >> only the possibility but the *empirically demonstrated > fact* that there > >> exist metrics that are highly correlated with human expert > rankings. > > > > It seems to me that it is difficult to generalize from one > setting in which > > human experts and certain ranks coincided to the *existence *of such > > correlations across the board. Much may depend on how the > experts are > > selected. I did some research in which referee reports did > not correlate > > with citation and publication measures. > > Much may depend on how the experts are selected, but that was just as > true during the 20 years in which rankings by experts were the sole > criterion for the rankings in the UR Research Assessment Exercise > (RAE). (In validating predictive metrics one must not endeavor to be > Holier than the Pope: Your predictor can at best hope to be > as good as, > but not better than, your criterion.) > > That said: All correlations to date between total departmental author > citation counts (not journal impact factors!) and RAE peer rankings > have been positive, sizable, and statistically significant for the > RAE, in all disciplines and all years tested. Variance there will be, > always, but a good-sized component from citations alone seems to be > well-established. Please see the studies of Professor Oppenheim and > others, for example as cited in: > > Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) > Mandated online > RAE CVs Linked to University Eprint Archives: Improving > the UK Research > Assessment Exercise whilst making it cheaper and easier. > Ariadne 35. > http://www.ariadne.ac.uk/issue35/harnad/ > > > Human experts are necessarily selected from a population of > experts, and it > > is often difficult to delineate between fields of expertise. > > Correct. And the RAE rankings are done separately, discipline by > discipline; the validation of the metrics should be done that way too. > > Perhaps there is sometimes a case for separate rankings even at > sub-disciplinary level. I expect the departments will be able to sort > that out. (And note that the RAE correlations do not constitute a > validation of metrics for evaluating individuals: I am confident that > that too will be possible, but it will require many more metrics and > much more validation.) > > > Similarly, we > > know from quite some research that citation and publication > practices are > > field-specific and that fields are not so easy to > delineate. Results may be > > very sensitive to choices made, for example, in terms of > citation windows. > > As noted, some of the variance in peer judgments will depend on the > sample of peers chosen; that is unavoidable. That is also why "light > touch" peer re-validation, spot-checks, updates and > optimizations on the > initialized metric weights are also a good idea, across the years. > > As to the need to evaluate sub-disciplines independently: > that question > exceeds the scope of metrics and metric validation. > > > Thus, I am bit doubtful about your claims of an > "empirically demonstrated > > fact." > > Within the scope mentioned -- the RAE peer rankings, for disciplines > such as they have been partitioned for the past two decades > -- there is > ample grounds for confidence in the empirical results to date. > > (And please note that this has nothing to do with journal > impact factors, > journal field classification, or journal rankings. It is about the RAE > and the ranking of university departments by peer panels, as > correlated > with citation counts.) > > Stevan Harnad > AMERICAN SCIENTIST OPEN ACCESS FORUM: > http://amsci-forum.amsci.org/archives/American-Scientist-Open- > Access-Forum.html > http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ > > UNIVERSITIES and RESEARCH FUNDERS: > If you have adopted or plan to adopt a policy of providing Open Access > to your own research article output, please describe your policy at: > http://www.eprints.org/signup/sign.php > http://openaccess.eprints.org/index.php?/archives/71-guid.html > http://openaccess.eprints.org/index.php?/archives/136-guid.html > > OPEN-ACCESS-PROVISION POLICY: > BOAI-1 ("Green"): Publish your article in a suitable > toll-access journal > http://romeo.eprints.org/ > OR > BOAI-2 ("Gold"): Publish your article in an open-access > journal if/when > a suitable one exists. > http://www.doaj.org/ > AND > in BOTH cases self-archive a supplementary version of > your article > in your own institutional repository. > http://www.eprints.org/self-faq/ > http://archives.eprints.org/ > http://openaccess.eprints.org/ > From garfield at CODEX.CIS.UPENN.EDU Mon Jun 16 15:30:15 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 16 Jun 2008 15:30:15 -0400 Subject: Wren, JD (Wren, Jonathan D.) URL decay in MEDLINE - a 4-year follow-up study BIOINFORMATICS, 24 (11): 1381-1385 JUN 1 2008 Message-ID: Email Address: Jonathan.Wren at OU.edu Author(s): Wren, JD (Wren, Jonathan D.) Title: URL decay in MEDLINE - a 4-year follow-up study Source: BIOINFORMATICS, 24 (11): 1381-1385 JUN 1 2008 Language: English Document Type: Article Keywords Plus: INTERNET REFERENCES; WEB REFERENCES; ACCESSIBILITY; PERSISTENCE; INFORMATION; CITATIONS; JOURNALS; AVAILABILITY; PERMANENCE; STABILITY Abstract: Motivation: Internet-based electronic resources, as given by Uniform Resource Locators (URLs), are being increasingly used in scientific publications but are also becoming inaccessible in a time- dependant manner, a phenomenon documented across disciplines. Initial reports brought attention to the problem, spawning methods of effectively preserving URL content while some journals adopted policies regarding URL publication and begun storing supplementary information on journal websites. Thus, a reexamination of URL growth and decay in the literature is merited to see if the problem has grown or been mitigated by any of these changes. Results: After the 2003 study, three follow-up studies were conducted in 2004, 2005 and 2007. Unfortunately, no significant change was found in the rate of URL decay among any of the studies. However, only 5 of URLs cited more than twice have decayed versus 20 of URLs cited once or twice. The most common types of lost content were computer programs (43), followed by scholarly content (38) and databases (19). Compared to URLs still available, no lost content type was significantly over- or underrepresented. Searching for 30 of these websites using Google, 11 (37) were found relocated to different URLs. Conclusions: URL decay continues unabated, but URLs published by organizations tend to be more stable. Repeated citation of URLs suggests calculation of an electronic impact factor (eIF) would be an objective, quantitative way to measure the impact of Internet-based resources on scientific research. Addresses: Oklahoma Med Res Fdn, Arthritis & Immunol Res Program, Oklahoma City, OK 73104 USA Reprint Address: Wren, JD, Oklahoma Med Res Fdn, Arthritis & Immunol Res Program, 825 NE 13th St, Oklahoma City, OK 73104 USA. Cited Reference Count: 30 Times Cited: 0 Publisher: OXFORD UNIV PRESS Publisher Address: GREAT CLARENDON ST, OXFORD OX2 6DP, ENGLAND ISSN: 1367-4803 29-char Source Abbrev.: BIOINFORMATICS ISO Source Abbrev.: Bioinformatics Source Item Page Count: 5 Subject Category: Biochemical Research Methods; Biotechnology & Applied Microbiology; Computer Science, Interdisciplinary Applications; Mathematical & Computational Biology; Statistics & Probability ISI Document Delivery No.: 305HQ NATURE 446 : 347 2007 *SCIENCEWATCH SCI WATCH 10 : 1999 CAPLAN P PACS REV 9 : 1998 CARNEVALE RJ The life and death of URLs in five biomedical informatics journals INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS 76 : 269 DOI 10.1016/j.ijmedinf.2005.12.001 2007 CASSERLY MF Web citation availability: Analysis and implications for scholarship COLLEGE & RESEARCH LIBRARIES 64 : 300 2003 CHEUNG J Vanishing websites are the weakest link NATURE 414 : 15 2001 DELLAVALLE RP Information science - Going, going, gone: Lost Internet references SCIENCE 302 : 787 2003 ERRAMI M Deja vu - A study of duplicate citations in Medline BIOINFORMATICS 24 : 243 DOI 10.1093/bioinformatics/btm574 2008 EYSENBACH G AMIA ANN S P 919 : 2006 EYSENBACH G J MED INTERNET RES 7 : E60 2005 HESTER EJ Internet citations in oncology journals: A vanishing resource? JOURNAL OF THE NATIONAL CANCER INSTITUTE 96 : 969 DOI 10.1093/jnci/djh181 2004 JOHNSON KR Addressing internet reference loss LANCET 363 : 660 2004 KAHLE B Preserving the Internet SCIENTIFIC AMERICAN 276 : 82 1997 KOEHLER W Web page change and persistence - A four-year longitudinal study JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 53 : 162 2002 KOEHLER W An analysis of Web page and Web site constancy and permanence JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 50 : 162 1999 LAWRENCE S Persistence of Web references in scientific research COMPUTER 34 : 26 2001 LAWRENCE S Accessibility of information on the web NATURE 400 : 107 1999 MADANI S AMIA ANN S P 1019 : 2006 REICH V Preserving today's scientific record for tomorrow - LOCKSS marries age old concepts of librarianship with modern technology BRITISH MEDICAL JOURNAL 328 : 61 2004 RUMSEY M Runaway train: Problems of permanence, accessibility, and stability in the use of Web sources in law review citations LAW LIBRARY JOURNAL 94 : 27 2002 SCHAFER K J LIBR ADM 34 : 123 2001 SCHILLING LM Untitled BIOINFORMATICS 20 : 2903 DOI 10.1093/bioinformatics/bth385 2004 SCHILLING LM Digital information archiving policies in high-impact medical and scientific periodicals JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 292 : 2724 2004 SPINELLIS D The decay and failures of Web references COMMUNICATIONS OF THE ACM 46 : 71 2003 THIREOU T GENOM PROTEOM BIOINF 5 : 70 2007 THORP AW Accessibility of internet references in Annals of Emergency Medicine: Is it time to require archiving? ANNALS OF EMERGENCY MEDICINE 50 : 188 DOI 10.1016/j.annemergmed.2006.11.019 2007 VERONIN MA J MED INTERNET RES 4 : E10 2002 WREN JD Uniform resource locator decay in dermatology journals - Author attitudes and preservation practices ARCHIVES OF DERMATOLOGY 142 : 1147 2006 WREN JD 404 not found: the stability and persistence of URLs published in MEDLINE BIOINFORMATICS 20 : 668 DOI 10.1093/bioinformatics/btg465 2004 WREN JD E-mail decay rates among corresponding authors in MEDLINE - The ability to communicate with and request materials from authors is being eroded by the expiration of e-mail addresses EMBO REPORTS 7 : 122 DOI 10.1038/sj.embor.7400631 2006 From garfield at CODEX.CIS.UPENN.EDU Mon Jun 16 16:20:54 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 16 Jun 2008 16:20:54 -0400 Subject: Egghe, L; Rao, IKR Study of different h-indices for groups of authors JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 59 (8): 1276-1281 JUN 2008 Message-ID: Email Address: leo.egghe at uhasselt.be Author(s): Egghe, L (Egghe, L.); Rao, IKR (Rao, I. K. Ravichandra) Title: Study of different h-indices for groups of authors Source: JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 59 (8): 1276-1281 JUN 2008 Language: English Document Type: Article Keywords Plus: SCIENTIFIC-RESEARCH OUTPUT; HIRSCH-TYPE INDEXES; BIBLIOMETRIC INDICATORS; JOURNALS; RANKING Abstract: In this article, for any group of authors, we define three different h-indices. First, there is the successive h-index h(2) based on the ranked list of authors and their h-indices h, as defined by Schubert (2007). Next, there is the h-index hp based on the ranked list of authors and their number of publications. Finally, there is the h-index h(c) based on the ranked list of authors and their number of citations. We present formulae for these three indices in Lotkaian informetrics from which it also follows that h(2) < h(p) < h(c). We give a concrete example of a group of 167 authors on the topic "optical flow estimation." Besides these three h-indices, we also calculate the two-by-two Spearman rank correlation coefficient and prove that these rankings are significantly related. Addresses: Univ Hasselt, B-3590 Diepenbeek, Belgium; Univ Instelling Antwerp, B-2610 Antwerp, Belgium; ISI, Bangalore 560059, Karnataka, India Reprint Address: Egghe, L, Univ Hasselt, Campus Diepenbeek, B-3590 Diepenbeek, Belgium. Cited Reference Count: 39 Times Cited: 0 Publisher: JOHN WILEY & SONS INC Publisher Address: 111 RIVER ST, HOBOKEN, NJ 07030 USA ISSN: 1532-2882 29-char Source Abbrev.: J AM SOC INF SCI TECHNOL ISO Source Abbrev.: J. Am. Soc. Inf. Sci. Technol. Source Item Page Count: 6 Subject Category: Computer Science, Information Systems; Information Science & Library Science ISI Document Delivery No.: 305LF 12 1 MONDAY 2007 BALL P Achievement index climbs the ranks NATURE 448 : 737 DOI 10.1038/448737a 2007 BALL P Index aims for fair ranking of scientists NATURE 436 : 900 DOI 10.1038/436900a 2005 BANKS MG An extension of the Hirsch index: Indexing scientific topics and compounds SCIENTOMETRICS 69 : 161 DOI 10.1007/s11192-006-0146-5 2006 BARENDSE W BIOMEDICAL DIGITAL L 4 : 2007 BARILAN J ISSI NEWSLETTER 2 : 3 2006 BEIRLANT J Scoring research output using statistical quantile plotting JOURNAL OF INFORMETRICS 1 : 185 DOI 10.1016/j.joi.2007.04.002 2007 BORNMANN L What do we know about the h index? JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 1381 DOI 10.1002/asi.20609 2007 BORNMANN L J INFORM 1 : 204 2007 BORNMANN L Does the h-index for ranking of scientists really work? SCIENTOMETRICS 65 : 391 DOI 10.1007/s11192-005-0281-4 2005 BRAUN T A Hirsch-type index for journals SCIENTIST 19 : 8 2005 BRAUN T A Hirsch-type index for journals SCIENTOMETRICS 69 : 169 DOI 10.1007/s11192-006-0147-4 2006 BURRELL QL J INFORM 1 : 16 2007 BURRELL QL On the h-index, the size of the Hirsch core and Jin's A-index JOURNAL OF INFORMETRICS 1 : 170 DOI 10.1016/j.joi.2007.01.003 2007 COSTAS R The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level JOURNAL OF INFORMETRICS 1 : 193 DOI 10.1016/j.joi.2007.02.001 2007 EGGHE L Dynamic h-index: The Hirsch index in function of time JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 452 DOI 10.1002/asi.20473 2007 EGGHE L J AM SOC INFORM SCI : 2007 EGGHE L POWER LAWS INFORM PR : 2005 EGGHE L SCIENTOMETR IN PRESS : 2007 EGGHE L An informetric model for the Hirsch-index SCIENTOMETRICS 69 : 121 DOI 10.1007/s11192-006-0143-8 2006 GLANZEL W ISSI NEWSLETTER 1 : 15 2005 GLANZEL W SCI FOCUS 1 : 10 2006 GLANZEL W On the h-index - A mathematical approach to a new measure of publication activity and citation impact SCIENTOMETRICS 67 : 315 DOI 10.1556/Scient.67.2006.2.12 2006 HIRSCH JE ARXIV07080646V1PHYSI : 2007 HIRSCH JE An index to quantify an individual's scientific research output PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 102 : 16569 DOI 10.1073/pnas.0507655102 2005 LIU Y P ISSI CSIC MADR SPA : 514 2007 MILLER CW ARXIVPHYSICS0608183V : 2006 OPPENHEIM C Using the h-index to rank influential British researchers in information science and librarianship JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 297 DOI 10.1002/asi.20460 2007 POPOV SB ARXIVPHYSICS0508113 : 2005 PRATHAP G Hirsch-type indices for ranking institutions' scientific research output CURRENT SCIENCE 91 : 1439 2006 RAO IKR EMPIRICAL SERI UNPUB : 2007 ROUSSEAU R J INFORMETR 1 : 2 2007 SAAD G Exploring the h-index at the author and journal levels using bibliometric data of productive consumer scholars and business-related journals respectively SCIENTOMETRICS 69 : 117 DOI 10.1007/s11192-006-0142-9 2006 SCHUBERT A A systematic analysis of Hirsch-type indices for journals JOURNAL OF INFORMETRICS 1 : 179 DOI 10.1016/j.joi.2006.12.002 2007 SCHUBERT A Successive h-indices SCIENTOMETRICS 70 : 201 DOI 10.1007/s11192-007-0112-x 2007 VANCLAY JK On the robustness of the h-index JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 1547 2007 VANRAAN AFJ Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups SCIENTOMETRICS 67 : 491 DOI 10.1556/Scient.67.2006.3.10 2006 VINKLER P Eminence of scientists in the light of the h-index and other scientometric indicators JOURNAL OF INFORMATION SCIENCE 33 : 481 DOI 10.1177/0165551506072165 2007 WAN J PURE HINDEX CALCULAT : 2007 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 17 10:07:49 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 17 Jun 2008 10:07:49 -0400 Subject: Luor, T; Johanson, RE; Lu, HP; Wu, LL Trends and lacunae for future computer assisted learning (CAL) research: An assessment of the literature in SSCI journals from 1998-2006 JASIST, 59 (8): 1313-1320 JUN 2008 Message-ID: E-mail Address: a384 at ibfc.com.tw; rejohanson at mail.ntust.edu.tw; hsipeng at cs.ntust.edu.tw; llwu at management.ntu.edu.tw Author(s): Luor, T (Luor, Ted (Tainyi)); Johanson, RE (Johanson, Robert E.); Lu, HP (Lu, Hsi-Peng); Wu, LL (Wu, Ling-ling) Title: Trends and lacunae for future computer assisted learning (CAL) research: An assessment of the literature in SSCI journals from 1998-2006 Source: JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 59 (8): 1313-1320 JUN 2008 Language: English Document Type: Article Keywords Plus: INTERNATIONAL-BUSINESS; NUTRITION EDUCATION; TECHNOLOGY; LAW Abstract: This study surveyed 536 CAL publications in 71 SSCI (Social Science Citation Index) journals from 1998 to February 2006 to identify trends and lacunae for future research. The parameters and keywords employed by the authors are first presented, followed by a description of the study's general findings. A comparison is then drawn between CAL and recent depictions of the "biogosphere," for the majority of the contributors to the field produced only a few articles and authors of individual publications demonstrated a far greater collective influence on the field than the more frequently-cited authors. Results also revealed that the amount of articles pertaining to the aged, disabled children, and home schooling were significantly lower than those relating to school student's learning. This study offers an interesting snapshot of a field that is apparently on the rise; moreover, it raises some issues to be addressed in further research on CAL-related topics. Addresses: Natl Taiwan Univ Sci & Technol, Grad Sch Management, Taipei 106, Taiwan; Natl Taiwan Univ Sci & Technol, Dept Appl Foreign Languages, Taipei 106, Taiwan; Natl Taiwan Univ Sci & Technol, Dept Informat Management, Taipei 106, Taiwan; Natl Taiwan Univ, Dept Informat Management, Taipei 10617, Taiwan Reprint Address: Luor, T, Natl Taiwan Univ Sci & Technol, Grad Sch Management, 43 Sec 4,Keelung Rd, Taipei 106, Taiwan. E-mail Address: a384 at ibfc.com.tw; rejohanson at mail.ntust.edu.tw; hsipeng at cs.ntust.edu.tw; llwu at management.ntu.edu.tw Cited Reference Count: 23 Times Cited: 0 Publisher: JOHN WILEY & SONS INC Publisher Address: 111 RIVER ST, HOBOKEN, NJ 07030 USA ISSN: 1532-2882 29-char Source Abbrev.: J AM SOC INF SCI TECHNOL ISO Source Abbrev.: J. Am. Soc. Inf. Sci. Technol. Source Item Page Count: 8 Subject Category: Computer Science, Information Systems; Information Science & Library Science ISI Document Delivery No.: 305LF BRADFORD SC ENGINEERING-LONDON 137 : 85 1934 CAMPBELL MK A tailored multimedia nutrition education pilot program for low-income women receiving food assistance HEALTH EDUCATION RESEARCH 14 : 257 1999 CHANDY PR THE IMPACT OF JOURNALS AND AUTHORS ON INTERNATIONAL-BUSINESS RESEARCH - A CITATIONAL ANALYSIS OF JIBS ARTICLES JOURNAL OF INTERNATIONAL BUSINESS STUDIES 25 : 715 1994 CHANG A WEB J THREATEN PEER : 2006 CHEN YS A RELATIONSHIP BETWEEN LOTKA LAW, BRADFORD LAW, AND ZIPF LAW JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 37 : 307 1986 COTE JA ASSESSING THE INFLUENCE OF JOURNAL OF CONSUMER RESEARCH - A CITATION ANALYSIS JOURNAL OF CONSUMER RESEARCH 18 : 402 1991 HECK JL MOST FREQUENT CONTRIBUTORS TO THE FINANCE LITERATURE FINANCIAL MANAGEMENT 17 : 100 1988 HENTHOME T J ADVERTISING 11 : 53 1998 INKPEN AC AN ANALYSIS OF 25 YEARS OF RESEARCH IN THE JOURNAL OF INTERNATIONAL- BUSINESS STUDIES JOURNAL OF INTERNATIONAL BUSINESS STUDIES 25 : 703 1994 LATCHEM C Editorial: A content analysis of the British Journal of Educational Technology BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY 37 : 503 2006 LOTKA AJ J WASHINGTON ACADEMY 16 : 317 1926 MACARTHUR CA Technology applications for students with literacy problems: A critical review ELEMENTARY SCHOOL JOURNAL 101 : 273 2001 OENEMA A Web-based tailored nutrition education: results of a randomized controlled trial HEALTH EDUCATION RESEARCH 16 : 647 2001 OKOLO CM CONT SPECIAL ED RES : 179 2000 PARR R AM C INF SYST LONG B : 2000 RADHAKRISHNAN T LOTKAS LAW AND COMPUTER SCIENCE LITERATURE JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 30 : 51 1979 REYNOLDS G ARMY DAVIDS : 2006 SCHIPPMANN JS PERS PSYCHOL 53 : 703 2000 SIEGEL E Distance learning in social work education: Results and implications of a national survey JOURNAL OF SOCIAL WORK EDUCATION 34 : 71 1998 SMITH HJ Interactive whiteboards: boon or bandwagon? A critical review of the literature JOURNAL OF COMPUTER ASSISTED LEARNING 21 : 91 2005 WELSH ET INT J TRAINING DEV 7 : 1360 2003 ZHANG DS Virtual mentor and the lab system - Toward building an interactive, personalized, and intelligent E-learning environment JOURNAL OF COMPUTER INFORMATION SYSTEMS 44 : 35 2004 ZOU SM Contributions to international advertising research - An assessment of the literature between 1990 and 2002 JOURNAL OF ADVERTISING 34 : 99 2005 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 17 10:11:47 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 17 Jun 2008 10:11:47 -0400 Subject: Kriebel, L; Lapham, L Transition to electronic resources in undergraduate social science research: A study of honors theses bibliographies, 1999-2005 COLLEGE & RESEARCH LIBRARIES, 69 (3): 268-283 MAY 2008 Message-ID: E-mail Address: kriebel_leslie at wheatonma.edu; llapham at gmail.com Author(s): Kriebel, L (Kriebel, Leslie); Lapham, L (Lapham, Leslie) Title: Transition to electronic resources in undergraduate social science research: A study of honors theses bibliographies, 1999-2005 Source: COLLEGE & RESEARCH LIBRARIES, 69 (3): 268-283 MAY 2008 Language: English Document Type: Article Keywords Plus: CITATION BEHAVIOR; DISCIPLINES; WEB Abstract: This citation analysis assesses use of print and electronic resources in advanced undergraduate research at Wellesley College. Using four years of social science honors theses bibliographies, the proportionate use of electronic versus print sources is determined. Consistent discipline-based patterns in resource use are identified to inform future instruction and digital collections policies. Findings reveal: (1) an explosion in use of nonperiodical, nonbook Web sources; (2) a rapid decline in the use of print journals; and (3) a persistent lack of use of e-books. The authors argue that greater emphasis on starting research with scholarly indexes and bibliographies is a fruitful corrective to recent overdependence on random Web searching and will also better ground students in solid research practices as transitions in the scholarly publishing world continue. Reprint Address: Kriebel, L, Wheaton Coll, Norton, MA 02766 USA. E-mail Address: kriebel_leslie at wheatonma.edu; llapham at gmail.com Cited Reference Count: 16 Times Cited: 0 Publisher: ASSOC COLL RESEARCH LIBRARIES Publisher Address: 50 E HURON ST, CHICAGO, IL 60611 USA ISSN: 0010-0870 29-char Source Abbrev.: COLL RES LIBR ISO Source Abbrev.: Coll. Res. Libr. Source Item Page Count: 16 Subject Category: Information Science & Library Science ISI Document Delivery No.: 305MR ACKERMANN EG DEV COMP BIBLIOMETRI : 2000 DAVIS ED INFORM 19 : 299 2001 DAVIS PM The effect of the web on undergraduate citation behavior: A 2000 update COLLEGE & RESEARCH LIBRARIES 63 : 53 2002 DAVIS PM The effect of the Web on undergraduate citation behavior 1996-1999 JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 52 : 309 2001 HELLERROSS H REFERENCE LIB 77 : 121 2002 HOVDE K RES STRATEGIES 17 : 3 1999 LEIDING R Using citation checking of undergraduate honors thesis bibliographies to evaluate library collections COLLEGE & RESEARCH LIBRARIES 66 : 417 2005 MALONE D RES STRATEGIES 15 : 151 1997 NEDERHOF AJ ASSESSING THE USEFULNESS OF BIBLIOMETRIC INDICATORS FOR THE HUMANITIES AND THE SOCIAL AND BEHAVIORAL-SCIENCES - A COMPARATIVE-STUDY SCIENTOMETRICS 15 : 423 1989 PERITZ BC ON THE OBJECTIVES OF CITATION ANALYSIS - PROBLEMS OF THEORY AND METHOD JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 43 : 448 1992 SIEBENBERG TR Print versus electronic journal use in three Sci/Tech disciplines: What's going on here? COLLEGE & RESEARCH LIBRARIES 65 : 427 2004 SMALL HG SPECIALTIES AND DISCIPLINES IN SCIENCE AND SOCIAL-SCIENCE - EXAMINATION OF THEIR STRUCTURE USING CITATION INDEXES SCIENTOMETRICS 1 : 445 1979 SYLVIA J DOCUMENTATION 56 : 563 2000 SYLVIA MJ COLLECT BUILD 17 : 20 1998 YOUNG VE RES STRATEGIES 13 : 80 1995 ZUNDE P STRUCTURAL MODELS OF COMPLEX INFORMATION SOURCES INFORMATION STORAGE AND RETRIEVAL 7 : 1 1971 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 17 10:57:14 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 17 Jun 2008 10:57:14 -0400 Subject: Lopez-Munoz, F; Garcia-Garcia, P; Saiz-Ruiz, J; Mezzich, JE; Rubio, G; Vieta, E; Alamo, C A bibliometric study of the use of the classification and diagnostic systems in psychiatry over the last 25 years PSYCHOPATHOLOGY, 41 (4): 214-225 2008 Message-ID: E-mail Address: frlopez at juste.net Author(s): Lopez-Munoz, F (Lopez-Munoz, F.); Garcia-Garcia, P (Garcia- Garcia, P.); Saiz-Ruiz, J (Saiz-Ruiz, J.); Mezzich, JE (Mezzich, J. E.); Rubio, G (Rubio, G.); Vieta, E (Vieta, E.); Alamo, C (Alamo, C.) Title: A bibliometric study of the use of the classification and diagnostic systems in psychiatry over the last 25 years Source: PSYCHOPATHOLOGY, 41 (4): 214-225 2008 Language: English Document Type: Review Author Keywords: bibliometry; Diagnostic and Statistical Manual of Mental Disorders; International Classification of Diseases; psychiatric nosology; mental disorders; drug therapy Keywords Plus: DISORDER Abstract: Background: Our purpose was to examine the use of classification and diagnostic systems in the field of psychiatry ( CDSP) from a bibliometric perspective, over the period 1980-2005. Methods: We selected ( in EMBASE and MEDLINE databases) documents that contained, in any of their sections, the descriptors 'psychiatr*', 'DSM*', 'ICD*', or 'diagnostic criteria', as well as other more specific descriptors. As a bibliometric indicator of production we applied Price's law. We also calculated the national participation index ( PI) and correlated it with overall PI in biomedical and health sciences, and with PI in the discipline of psychiatry. Results: We obtained 20,564 original documents; 15,743 referred to the Diagnostic and Statistical Manual of Mental Disorders ( DSM) and 3,106 to the International Classification of Diseases ( ICD). Our results indicate non-fulfilment of Price's law, since scientific production on CDSP does not undergo exponential growth ( correlation coefficient r = 0.9651, vs. r = 0.9927 after linear adjustment). Of the 10 journals with the highest impact factor in the field of psychiatry, the Journal of Clinical Psychiatry has the highest PI in the DSM subgroup ( PI = 14.77), and the British Journal of Psychiatry in the ICD subgroup ( PI = 1.54). The principal producer country is the United States ( PI = 37.9), though in proportion to its production in the psychiatric field the ranking is headed by Finland. Only 10 countries, of the 20 major producers in health sciences, surpass their own PI in the field of psychiatry ( Brazil, Italy, Japan, Austria, Spain, Germany, France, India, Switzerland, and China). Conclusions: Over recent years, the use of CDSP ( basically the DSM or ICD) in the scientific literature has increased. Nevertheless, the abstracts to these studies, included in the principal databases, should always specify the diagnostic criteria employed, with a view to increasing information levels and reliability for the reader. Copyright (C) 2008 S. Karger AG, Basel. Addresses: Univ Alcala De Henares, Dept Pharmacol, Fac Med, Neuropsychopharmacol Unit, ES-28027 Madrid, Spain; Univ Alcala De Henares, Ramon & Cajal Univ Hosp, Dept Psychiat, Madrid, Spain; Univ Complutense, Dept Psychiat, Retiro Mental Hlth Serv, E-28040 Madrid, Spain; Univ Barcelona, Hosp Clin, Bipolar Disorders Program, Agusti Pi & Sunyer Biomed Res Inst,IDIBAPS, Barcelona, Spain; NYU, Mt Sinai Sch Med, Div Psychiat Epidemiol, New York, NY USA; NYU, Mt Sinai Sch Med, Int Ctr Mental Hlth, New York, NY USA Reprint Address: Lopez-Munoz, F, Univ Alcala De Henares, Dept Pharmacol, Fac Med, Neuropsychopharmacol Unit, C Juan Ignacio Luca de Tena 8, ES- 28027 Madrid, Spain. E-mail Address: frlopez at juste.net Cited Reference Count: 32 Times Cited: 0 Publisher: KARGER Publisher Address: ALLSCHWILERSTRASSE 10, CH-4009 BASEL, SWITZERLAND ISSN: 0254-4962 29-char Source Abbrev.: PSYCHOPATHOLOGY ISO Source Abbrev.: Psychopathology Source Item Page Count: 12 Subject Category: Psychiatry ISI Document Delivery No.: 303ZB *AM PSYCH ASS DIAGN STAT MAN MENT : 2000 *AS PSIQ AM LAT GUIA LAT DIAGN PSIQ : *CHIN SOC PSYCH CHIN CLASS MENT DIS : 2001 *WHO INT CLASS DIS : 1992 BERGANZA CE The Latin American guide for psychiatric diagnosis - A cultural overview PSYCHIATRIC CLINICS OF NORTH AMERICA 24 : 433 2001 BERGANZA CE Concepts of disease: Their relevance for psychiatric diagnosis and classification PSYCHOPATHOLOGY 38 : 166 DOI 10.1159/000086084 2005 BORDONS M Evaluation of scientific activity through bibliometric indicators REVISTA ESPANOLA DE CARDIOLOGIA 52 : 790 1999 CAMI J Bibliometric map of Spain 1994-2002: biomedicine and health sciences MEDICINA CLINICA 124 : 93 2005 GARFIELD E CITATION INDEXING IT : 1979 GOMEZ I POLITICA CIENTIFICA 46 : 21 1996 KLEIN DF DELINEATION OF 2 DRUG-RESPONSIVE ANXIETY SYNDROMES PSYCHOPHARMACOLOGIA 5 : 397 1964 LEE S >From diversity to unity - The classification of mental disorders in 21st- century China PSYCHIATRIC CLINICS OF NORTH AMERICA 24 : 421 2001 LEHRL S Evaluating scientific performances by impact factors - the right for equal chances STRAHLENTHERAPIE UND ONKOLOGIE 175 : 141 1999 LOPEZ JM MED CLIN-BARCELONA 98 : 142 1992 LOPEZMUNOZ F Bibliometric analysis of biomedical publications on SSRIs during 1980-2000 DEPRESSION AND ANXIETY 18 : 95 DOI 10.1002/da.10121 2003 LOPEZMUNOZ F FOCUS SEROTONIN UPTA : 191 2006 LOPEZMUNOZ F Bipolar disorder as an emerging pathology in the scientific literature: A bibliometric approach JOURNAL OF AFFECTIVE DISORDERS 92 : 161 DOI 10.1016/j.jad.2006.02.006 2006 LOPEZMUNOZ F PSIQUIATRIA 4 : 2000 LOPEZMUNOZ F REV NEUROL 24 : 417 1996 LOPEZPINERO JM MED CLIN-BARCELONA 98 : 384 1992 MEZZICH JE Culture in DSM-IV, ICD-10, and evolving diagnostic systems PSYCHIATRIC CLINICS OF NORTH AMERICA 24 : 407 2001 MEZZICH JE Purposes and models of diagnostic systems PSYCHOPATHOLOGY 38 : 162 DOI 10.1159/000086083 2005 MEZZICH JE Philosophical and Methodological Foundations of Psychiatric Diagnosis - Epilogue PSYCHOPATHOLOGY 38 : 228 DOI 10.1159/000086098 2005 MEZZICH JE Comprehensive diagnosis: A conceptual basis for future diagnostic systems PSYCHOPATHOLOGY 35 : 162 2002 OJEDA AAO DIAGNOSTICO CLASIFIC : 2001 OTEROOJEDA AA Third Cuban Glossary of psychiatry (GC-3): Key features and contributions PSYCHOPATHOLOGY 35 : 181 2002 PRICE DJS LITTLE SCI BIG SCI : 1963 ROJO E MEDICINE 8 : 5590 2003 SAIZ J HIST PSICOFARMACOLOG 3 : 1483 2006 SARTORIUS N EUROPEAN HDB PSYCHIA : 621 1991 WAKEFIELD JC The myth of DSM's invention of new categories of disorder: Houts's diagnostic discontinuity thesis disconfirmed BEHAVIOUR RESEARCH AND THERAPY 39 : 575 2001 WEST ED EFFECTS OF IPRONIAZID IN DEPRESSIVE SYNDROMES BRITISH MEDICAL JOURNAL 1 : 1491 1959 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 17 11:47:41 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 17 Jun 2008 11:47:41 -0400 Subject: Gonzalez-Sagrado, M; et al Evaluation of two methods for correcting the impact factor using the investigation done at the "Del Rio Hortega" University Hospital (1999-2004) as the data source NUTRICION HOSPITALARIA, 23 (2): 111-118 MAR-APR 2008 Message-ID: E-mail Address: gonzalez-sagrado at arrakis.es Author(s): Gonzalez-Sagrado, M (Gonzalez-Sagrado, M.); Roman, DADL (Roman, D. A. de Luis); Conde-Vicente, R (Conde-Vicente, R.); Izaola, O (Izaola, O.); Aller, R (Aller, R.); Perez-Castrillon, JL (Perez-Castrillon, J. L.) Title: Evaluation of two methods for correcting the impact factor using the investigation done at the "Del Rio Hortega" University Hospital (1999- 2004) as the data source Source: NUTRICION HOSPITALARIA, 23 (2): 111-118 MAR-APR 2008 Language: Spanish Document Type: Article Author Keywords: bibliometrics Keywords Plus: SCIENCE-CITATION-INDEX; SPANISH SCIENTIFIC PRODUCTION; HEALTH-SCIENCES; BIOMEDICINE; ASSOCIATION; INDICATORS; QUALITY; SPAIN Abstract: Background and objective: To adjust the Impact Factor (IF) provided by the Institute for Scientific Information (ISI) is necessary for improving bibliometric analysis among the various areas of knowledge. Our objective was to evaluate two parameters (the maximum and the median value of each subject area) for IF adjustment using the original (not corrected) IF as the reference method in a tertiary hospital biomedical investigation model. Material and method: We retrieved articles from Hospital Universitario "Del Rio Hortega" from Valladolid (Spain) for the period 1999-2004 as data source. We have describe the characteristics of the followed IF distributions: IF Corrected by the Maximum value (IFCORMAX), IF Corrected by the Median value (IFCORMED) and IF without adjustments (IF). Besides, we have analyzed both the inter-annual and the inter-subject differences obtained by the three methods. Results: The three analyzed IF series shown not normal distributions that are positively skewed. The IF adjusted by the median showed the highest coefficient of variation (CV = 357.3%). The IF adjusted by the Maximum value increased the "weight" of journals with the highest not corrected IF for each subject category. Inter-annual differences were similarly estimated by the three methods. The IF adjusted by the median increased the inter-subject difference from 7.3% to 12.4%. Conclusions: Our results suggests that IF adjusted by the maximum value of each discipline is the best method to correct the ISI-IF values, because journals with the high IF are always rewarded, while IF adjusted by the median infra-estimated most of them. Addresses: Hosp Univ Del Rio Hortega, Unidad Apoyo Invest, Valladolid 47010, Spain; Univ Valladolid, Inst Endocrinol & Nutr, Fac Med, E-47002 Valladolid, Spain; Hosp Univ Del Rio Hortega, Med Interna Serv, Valladolid, Spain Reprint Address: Gonzalez-Sagrado, M, Hosp Univ Del Rio Hortega, Unidad Apoyo Invest, C Rondilla Santa Teresa 9, Valladolid 47010, Spain. E-mail Address: gonzalez-sagrado at arrakis.es Cited Reference Count: 18 Times Cited: 0 Publisher: AULA MEDICA EDICIONES Publisher Address: PAEO DEL PINTOR ROSALES, 26, MADRID, 28008, SPAIN ISSN: 0212-1611 29-char Source Abbrev.: NUTR HOSP ISO Source Abbrev.: Nutr. Hosp. Source Item Page Count: 8 Subject Category: Nutrition & Dietetics ISI Document Delivery No.: 303PC ALEIXANDRE R TRAST ADICT 1 : 264 2000 BORDONS M Scientific activity of the most productive Spanish research teams in pharmacology and pharmacy during the period 1986-1993 as covered by the Science Citation Index (SCI) MEDICINA CLINICA 111 : 489 1998 BORDONS M Evaluation of scientific activity through bibliometric indicators REVISTA ESPANOLA DE CARDIOLOGIA 52 : 790 1999 CAMI J Bibliometric map of Spain 1994-2002: biomedicine and health sciences MEDICINA CLINICA 124 : 93 2005 CAMI J Evaluation of biomedical research MEDICINA CLINICA 117 : 510 2001 CAMI J Spanish scientific production in biomedicine and health sciences during the period 1990-1993 (Science Citation Index and Social Science Citation Index) and comparison to period 1986-1989 MEDICINA CLINICA 109 : 481 1997 CARIDAD IG REV CLIN ESP 204 : 75 2004 CHAVARINO AP INV CLIN FARM 1 : 23 2004 COELHO PMZ The use and misuse if the "impact factor" as a parameter for evaluation of scientific publication quality: a proposal to rationalize its application BRAZILIAN JOURNAL OF MEDICAL AND BIOLOGICAL RESEARCH 36 : 1605 2003 FIGUEREDOGASPARI E Curricular evaluation of scientific publications MEDICINA CLINICA 125 : 661 2005 GARCIAMAYOR RV Theoretical considerations in estimating the growth hormone axis in adults GROWTH HORMONE & IGF RESEARCH 8 : 93 1998 GARFIELD E CITATION INDEXES FOR SCIENCE - NEW DIMENSION IN DOCUMENTATION THROUGH ASSOCIATION OF IDEAS SCIENCE 122 : 108 1955 LEE KP Association of journal quality indicators with methodological quality of clinical research articles JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 287 : 2805 2002 ORIVE JJD ARCH BRONCONEUMOL 39 : 409 2003 PESTANA A Suitability of MedLine for the study of the Spanish scientific production in biomedicine and medical sciences. A comparative appraisal with the Science Citation Index MEDICINA CLINICA 109 : 506 1997 ROZMAN C Thoughts on biomedical research in Spain MEDICINA CLINICA 120 : 19 2003 SOLAR MA ATEN PRIM 18 : 230 1996 ZULUETA MA Spanish scientific production in cardiovascular research through the Science Citation Index (1990-1996) REVISTA ESPANOLA DE CARDIOLOGIA 52 : 751 1999 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 17 14:59:06 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 17 Jun 2008 14:59:06 -0400 Subject: Jacso, P (Jacso, Peter) The plausibility of computing the h-index of scholarly productivity and impact using reference-enhanced databases ONLINE INFORMATION REVIEW, 32 (2): 266-283 2008 Message-ID: E-mail Address: jacso at hawaii.edu URL: http://www.jacso.info/PDFs/jacso-h-index-plausibility-OIR-2008-32- 2.pdf Author(s): Jacso, P (Jacso, Peter) Title: The plausibility of computing the h-index of scholarly productivity and impact using reference-enhanced databases Source: ONLINE INFORMATION REVIEW, 32 (2): 266-283 2008 Language: English Document Type: Article Author Keywords: databases; indexing Keywords Plus: CITATION COUNTS; HIRSCH INDEX; SCIENTISTS; JOURNALS; SCIENCE; GAME Abstract: Purpose - This paper aims to provide a general overview, to be followed by a series of papers focusing on the analysis of pros and cons of the three largest, cited-reference-enhanced, multidisciplinary databases (Google Scholar, Scopus, and Web of Science) for determining the h-index. Design/methodology/approach - The paper focuses on the analysis of pros and cons of the three largest, cited-reference-enhanced, multidisciplinary databases (Google Scholar, Scopus and Web of Science). Findings - The h-index, developed by Jorge E. Hirsch to quantify the scientific output of researchers, has immediately received well-deserved attention in academia. The theoretical part of his idea was widely embraced, and even enhanced, by several researchers. Many of them also recommended derivative metrics based on Hirsch's idea to compensate for potential distortion factors, such as high self-citation rates. The practical aspects of determining the h-index also need scrutiny, because some content and software characteristics of reference-enhanced databases can strongly influence the h-index values. Originality/value - The paper focuses on the analysis of pros and cons of the three largest, cited-reference-enhanced, multidisciplinary databases. Addresses: Univ Hawaii, Honolulu, HI 96822 USA Reprint Address: Jacso, P, Univ Hawaii, Honolulu, HI 96822 USA. E-mail Address: jacso at hawaii.edu Cited Reference Count: 24 Times Cited: 0 Publisher: EMERALD GROUP PUBLISHING LIMITED Publisher Address: HOWARD HOUSE, WAGON LANE, BINGLEY BD16 1WA, W YORKSHIRE, ENGLAND ISSN: 1468-4527 29-char Source Abbrev.: ONLINE INF REV ISO Source Abbrev.: Online Inf. Rev. Source Item Page Count: 18 Subject Category: Computer Science, Information Systems; Information Science & Library Science ISI Document Delivery No.: 305GY ASHKANASY NM Playing the citations game JOURNAL OF ORGANIZATIONAL BEHAVIOR 28 : 643 DOI 10.1002/job.476 2007 BANKS MG An extension of the Hirsch index: Indexing scientific topics and compounds SCIENTOMETRICS 69 : 161 DOI 10.1007/s11192-006-0146-5 2006 BARILAN J SCIENTOMETRICS 74 : 257 2007 BRAUN T A Hirsch-type index for journals SCIENTOMETRICS 69 : 169 DOI 10.1007/s11192-006-0147-4 2006 CRONIN B Using the h-index to rank influential information scientists JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 57 : 1275 DOI 10.1002/asi.20354 2006 EGGHE L Theory and practise of the g-index SCIENTOMETRICS 69 : 131 DOI 10.1007/s11192-006-0144-7 2006 HARZING A 2008 AC MAN ANN M 8 2008 HIRSCH JE An index to quantify an individual's scientific research output PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 102 : 16569 DOI 10.1073/pnas.0507655102 2005 JACSO P Content evaluation of databases ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY 32 : 231 1997 JACSO P LIB TREND S IN PRESS : 2008 JACSO P The dimensions of cited reference enhanced database subsets ONLINE INFORMATION REVIEW 31 : 694 DOI 10.1108/14684520710832360 2007 JACSO P Deflated, inflated and phantom citation counts ONLINE INFORMATION REVIEW 30 : 297 DOI 10.1108/14684520610675816 2006 JIN BH The R- and AR-indices: Complementing the h-index CHINESE SCIENCE BULLETIN 52 : 855 DOI 10.1007/s11434-007-0145-9 2007 MEHO LI Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 2105 DOI 10.1002/asi.20677 2007 OPPENHEIM C Using the h-index to rank influential British researchers in information science and librarianship JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 297 DOI 10.1002/asi.20460 2007 PRATHALINGAM NS Dilution of spermatozoa results in improved viability following a 24 h storage period but decreased acrosome integrity following cryopreservation ANIMAL REPRODUCTION SCIENCE 91 : 11 DOI 10.1016/j.anireprosci.2005.03.016 2006 PURVIS A The h index: playing the numbers game TRENDS IN ECOLOGY & EVOLUTION 21 : 422 DOI 10.1016/j.tree.2006.05.014 2006 SAAD G Exploring the h-index at the author and journal levels using bibliometric data of productive consumer scholars and business-related journals respectively SCIENTOMETRICS 69 : 117 DOI 10.1007/s11192-006-0142-9 2006 SCHREIBER M A case study of the Hirsch index for 26 non-prominent physicists ANNALEN DER PHYSIK 16 : 640 DOI 10.1002/andp.20071025 2007 SCHREIBER M EUROPHYSICS LETT 78 : 2007 SPROUSE GD Which Wei Wang? REVIEWS OF MODERN PHYSICS 80 : 1 DOI 10.1103/RevModPhys.80.1 2008 VANCLAY JK On the robustness of the h-index JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 1547 2007 VANCLAY JK Refining the h-index SCIENTIST 20 : 14 2006 VINKLER P Eminence of scientists in the light of the h-index and other scientometric indicators JOURNAL OF INFORMATION SCIENCE 33 : 481 DOI 10.1177/0165551506072165 2007 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 17 15:33:15 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 17 Jun 2008 15:33:15 -0400 Subject: Noe, LF (Noe, Leslie F.); Batten, DJ (Batten, David J.) 'Publish or perish': The pitfalls of duplicate publication PALAEONTOLOGY, 49: 1365-1367 Part 6 NOV 2006 Message-ID: E-mail Address: lnoe01 at esc.cam.ac.uk; david.batten at manchester.ac.uk Author(s): Noe, LF (Noe, Leslie F.); Batten, DJ (Batten, David J.) Title: 'Publish or perish': The pitfalls of duplicate publication Source: PALAEONTOLOGY, 49: 1365-1367 Part 6 NOV 2006 Language: English Document Type: Article Author Keywords: plagiarism; self-plagiarism; publication ethics; palaeontology Keywords Plus: DECCAN INTERTRAPPEAN BEDS; COLD-WATER ASSEMBLAGE; FERN ACROSTICHUM L.; REDUNDANT PUBLICATIONS; SCIENTIFIC MISCONDUCT; MARINE REPTILES; HIGH-LATITUDE; PLAGIARISM; JOURNALS; AUSTRALIA Abstract: Duplication of previously published text or figures in the scientific literature without adequate citation is plagiarism or, in the case of an author's own work, self-plagiarism. It breaches the ethical standards that are expected in science and threatens the integrity of scientific journals. Three examples of duplication are noted, one of which involves Palaeontology. Redundant publication lowers the quality of scientific literature, damages the good standing of journals, and reduces the intellectual impact of a study. Multiple papers on a particular theme are only acceptable if each builds significantly upon previous work and contains only as much background information as necessary to put the new data and observations into perspective. Addresses: Univ Cambridge, Dept Earth Sci, Sedgwick Museum, Cambridge CB2 3EQ, England; Univ Manchester, Sch Earth Atmospher & Environm Sci, Manchester M13 9PL, Lancs, England Reprint Address: Noe, LF, Univ Cambridge, Dept Earth Sci, Sedgwick Museum, Downing St, Cambridge CB2 3EQ, England. E-mail Address: lnoe01 at esc.cam.ac.uk; david.batten at manchester.ac.uk Cited Reference Count: 26 Times Cited: 0 Publisher: BLACKWELL PUBLISHING Publisher Address: 9600 GARSINGTON RD, OXFORD OX4 2DQ, OXON, ENGLAND ISSN: 0031-0239 29-char Source Abbrev.: PALAEONTOLOGY ISO Source Abbrev.: Paleontology Source Item Page Count: 3 Subject Category: Paleontology ISI Document Delivery No.: 101GY NATURE 439 : 117 2006 NATURE 439 : 118 2006 ABELSON PH EXCESSIVE ZEAL TO PUBLISH SCIENCE 218 : 953 1982 ADAM D Journals under pressure: Publish, and be damned... NATURE 419 : 772 2002 AGUIRRE J REV ESP MICROPALEONT 36 : 349 2004 ARMSTRONG JD PLAGIARISM - WHAT IS IT, WHOM DOES IT OFFEND, AND HOW DOES ONE DEAL WITH IT AMERICAN JOURNAL OF ROENTGENOLOGY 161 : 479 1993 BATTEN DJ PUBLICATION POLICY P : 2006 BONDE SD The oldest macrofossil record of the mangrove fern Acrostichum L. from the Late Cretaceous Deccan Intertrappean beds of India CRETACEOUS RESEARCH 23 : 149 DOI 10.1006/cres.2001.0307 2002 BONDE SD A permineralized species of mangrove fern Acrostichum L. from Deccan Intertrappean beds of India REVIEW OF PALAEOBOTANY AND PALYNOLOGY 120 : 285 2002 BOSCH X SCIENTIST 5 : 1 2004 BROCHARD L Redundant publications, or piling up the medals. Getting published is not the Olympic Games INTENSIVE CARE MEDICINE 30 : 1857 DOI 10.1007/s00134-004-2459-2 2004 DAROFF RB Scientific misconduct and breach of publication ethics NEUROLOGY 62 : 352 2004 GILBERT FJ Research misconduct CLINICAL RADIOLOGY 58 : 499 DOI 10.1016/S0009-9260(03)00176-4 2003 GILES J Special report - Taking on the cheats NATURE 435 : 258 DOI 10.1038/435258a 2005 GILES J Plagiarism in Cambridge physics lab prompts calls for guidelines NATURE 427 : 3 DOI 10.1038/427003a 2004 GRIEGER MCA SAO PAULO MED J 123 : 242 2005 JEFFERSON T Journals: how to decide what's worth publishing NATURE 421 : 209 DOI 10.1038/421209b 2003 KEAR BP Marine reptiles from the Lower Cretaceous (Aptian) deposits of White Cliffs, southeastern Australia: implications of a high latitude, cold water assemblage CRETACEOUS RESEARCH 26 : 769 DOI 10.1016/j.cretres.2005.04.006 2005 KEAR BP Marine reptiles from the Lower Cretaceous of South Australia: elements of a high-latitude cold-water assemblage PALAEONTOLOGY 49 : 837 2006 KEAR BP PALUDICOLA 5 : 200 2006 LOWE NK J OBSTET GYNECOL NEO 32 : 145 2003 MARRIS E Should journals police scientific fraud? NATURE 439 : 520 DOI 10.1038/439520a 2006 MOJONAZZI SM Journals: redundant publications are bad news - Publishing the same work twice is unethical and casts doubt on the integrity of research. NATURE 421 : 209 DOI 10.1038/421209a 2003 MOJONAZZI SM Scientific misconduct: From salami slicing to data fabrication OPHTHALMOLOGICA 218 : 1 DOI 10.1159/000074559 2004 PEARSON H Image manipulation: CSI: cell biology NATURE 434 : 952 DOI 10.1038/434952a 2005 WITTMAACK K Penalties plus high-quality review to fight plagiarism NATURE 436 : 24 DOI 10.1038/436024d 2005 From loet at LEYDESDORFF.NET Wed Jun 18 02:34:56 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Wed, 18 Jun 2008 08:34:56 +0200 Subject: Citation statistics Message-ID: Dear Stevan, I now read the article on which you base your argument entitled "The correlation between RAE ratings and citation counts in psychology" (Andy Smith and Mike Eysenck, Department of Psychology, Royal Holloway, University of London, June 2002; at http://cogprints.org/2749/1/citations.pdf. "The above correlations are remarkably high, especially when account is taken of the fact that there is nothing like a perfect overlap between the individuals included in our analysis of citation counts and those included in the two RAEs." "Despite very high correlations between citations and RAE grades, there are a few individual departments that depart from the trend. These appear as 'outliers' in Fig. 2. Herein lies a danger." "The difference between the correlations for the two RAE years is small and statistically nonsignificant. However, the fact that citation counts are historical, in the sense of referring to research reported some time earlier, means that it is reasonable to expect them to predict previous RAE ratings better than future ratings." It made me remember that the chair person of the Nobel Price committee once told John Irvine that he always checked citation rates for the top candidates. Yes, there is a correlation between the indicators. However, in my opinion, the issue is eventually not to predict future RAE ratings --as you argue-- but to predict future performance. Best wishes, Loet ________________________________ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR), Kloveniersburgwal 48, 1012 CX Amsterdam. Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 loet at leydesdorff.net ; http://www.leydesdorff.net/ > -----Original Message----- > From: Loet Leydesdorff [mailto:loet at leydesdorff.net] > Sent: Monday, June 16, 2008 7:40 PM > To: 'ASIS&T Special Interest Group on Metrics' > Subject: RE: [SIGMETRICS] Citation statistics > > Dear Stevan, > > If I correctly understand then your claim is that ranking > results based on peer review at the departmental level > correlate highly with MEAN departmental citation rates. This > would be the case for psychology, wouldn't it? > > It is an amazing result because one does not expect citation > rates to be normally distributed. (The means of the citation > rates, of coures, are normally distributed.) In my own > department, for example (in communication studies), we have > various communities (social-psychologists, information > scientists, political science) with very different citation > patterns. But perhaps, British psychology departments are > exceptionally homongeneous both internally and comparatively. > > Then, you wish to strengthen this correlation by adding more > indicators. The other indicators may correlate better or > worse with the ratings. The former ones can add to the > correlations, while the latter would worsen them. Or do you > wish only to add indicators which improve the correlations > with the ratings? > > I remember from a previous conversation on this subject that > you have a kind of multi-variate regression model in mind in > which the RAE ratings would be the dependent variable. One > can make the model fit to the rankings by estimating the > parameters. One can also refine this per discipline. Would > one expecat any predictive power in such a model in a new > situation (after 4 years)? Why? > > With best wishes, > > > Loet > > ________________________________ > > Loet Leydesdorff > Amsterdam School of Communications Research (ASCoR), > Kloveniersburgwal 48, 1012 CX Amsterdam. > Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 > loet at leydesdorff.net ; http://www.leydesdorff.net/ > > > > > -----Original Message----- > > From: ASIS&T Special Interest Group on Metrics > > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad > > Sent: Monday, June 16, 2008 3:20 PM > > To: SIGMETRICS at LISTSERV.UTK.EDU > > Subject: Re: [SIGMETRICS] Citation statistics > > > > Adminstrative info for SIGMETRICS (for example unsubscribe): > > http://web.utk.edu/~gwhitney/sigmetrics.html > > > > On Sun, 15 Jun 2008, Loet Leydesdorff wrote: > > > > >> SH: But what all this valuable, valid cautionary > > discussion overlooks is not > > >> only the possibility but the *empirically demonstrated > > fact* that there > > >> exist metrics that are highly correlated with human expert > > rankings. > > > > > > It seems to me that it is difficult to generalize from one > > setting in which > > > human experts and certain ranks coincided to the > *existence *of such > > > correlations across the board. Much may depend on how the > > experts are > > > selected. I did some research in which referee reports did > > not correlate > > > with citation and publication measures. > > > > Much may depend on how the experts are selected, but that > was just as > > true during the 20 years in which rankings by experts were the sole > > criterion for the rankings in the UR Research Assessment Exercise > > (RAE). (In validating predictive metrics one must not endeavor to be > > Holier than the Pope: Your predictor can at best hope to be > > as good as, > > but not better than, your criterion.) > > > > That said: All correlations to date between total > departmental author > > citation counts (not journal impact factors!) and RAE peer rankings > > have been positive, sizable, and statistically significant for the > > RAE, in all disciplines and all years tested. Variance > there will be, > > always, but a good-sized component from citations alone seems to be > > well-established. Please see the studies of Professor Oppenheim and > > others, for example as cited in: > > > > Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) > > Mandated online > > RAE CVs Linked to University Eprint Archives: Improving > > the UK Research > > Assessment Exercise whilst making it cheaper and easier. > > Ariadne 35. > > http://www.ariadne.ac.uk/issue35/harnad/ > > > > > Human experts are necessarily selected from a population of > > experts, and it > > > is often difficult to delineate between fields of expertise. > > > > Correct. And the RAE rankings are done separately, discipline by > > discipline; the validation of the metrics should be done > that way too. > > > > Perhaps there is sometimes a case for separate rankings even at > > sub-disciplinary level. I expect the departments will be > able to sort > > that out. (And note that the RAE correlations do not constitute a > > validation of metrics for evaluating individuals: I am > confident that > > that too will be possible, but it will require many more metrics and > > much more validation.) > > > > > Similarly, we > > > know from quite some research that citation and publication > > practices are > > > field-specific and that fields are not so easy to > > delineate. Results may be > > > very sensitive to choices made, for example, in terms of > > citation windows. > > > > As noted, some of the variance in peer judgments will depend on the > > sample of peers chosen; that is unavoidable. That is also why "light > > touch" peer re-validation, spot-checks, updates and > > optimizations on the > > initialized metric weights are also a good idea, across the years. > > > > As to the need to evaluate sub-disciplines independently: > > that question > > exceeds the scope of metrics and metric validation. > > > > > Thus, I am bit doubtful about your claims of an > > "empirically demonstrated > > > fact." > > > > Within the scope mentioned -- the RAE peer rankings, for disciplines > > such as they have been partitioned for the past two decades > > -- there is > > ample grounds for confidence in the empirical results to date. > > > > (And please note that this has nothing to do with journal > > impact factors, > > journal field classification, or journal rankings. It is > about the RAE > > and the ranking of university departments by peer panels, as > > correlated > > with citation counts.) > > > > Stevan Harnad > > AMERICAN SCIENTIST OPEN ACCESS FORUM: > > http://amsci-forum.amsci.org/archives/American-Scientist-Open- > > Access-Forum.html > > http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ > > > > UNIVERSITIES and RESEARCH FUNDERS: > > If you have adopted or plan to adopt a policy of providing > Open Access > > to your own research article output, please describe your policy at: > > http://www.eprints.org/signup/sign.php > > http://openaccess.eprints.org/index.php?/archives/71-guid.html > > http://openaccess.eprints.org/index.php?/archives/136-guid.html > > > > OPEN-ACCESS-PROVISION POLICY: > > BOAI-1 ("Green"): Publish your article in a suitable > > toll-access journal > > http://romeo.eprints.org/ > > OR > > BOAI-2 ("Gold"): Publish your article in an open-access > > journal if/when > > a suitable one exists. > > http://www.doaj.org/ > > AND > > in BOTH cases self-archive a supplementary version of > > your article > > in your own institutional repository. > > http://www.eprints.org/self-faq/ > > http://archives.eprints.org/ > > http://openaccess.eprints.org/ > > > From Jonathan.adams at EVIDENCE.CO.UK Wed Jun 18 05:22:54 2008 From: Jonathan.adams at EVIDENCE.CO.UK (Jonathan Adams) Date: Wed, 18 Jun 2008 10:22:54 +0100 Subject: Citation statistics Message-ID: There is also an analysis of the UK Psychology data in our recent paper in Scientometrics [J Adams, K Gurney and L Jackson. Calibrating the zoom - a test of Zitt's hypothesis. Scientometrics, Vol. 75, No. 1 (2008) 81-95, DOI: 10.1007/s11192-007-1832-7] The paper is about the extent to which correlation (between average citation impact and peer-reviewed RAE grade) is affected by the granularity of normalisation. For Psychology, Figure 1 shows the spread of impact for individual institutions awarded grade 4, 5 or 5* at RAE2001. Spearman gives a more significant correlation for the Psychology data than for Biology or Physics (Table 4), which may suggest some particular characteristics (perhaps, greater homogeneity) for the Thomson Reuters recorded publication and citation data for Psychology. However, although the correlation is 'significant' the residual variance evident in Figure 1 would raise an interesting challenge to using the impact data as a sole determinant of funding. Jonathan Adams Director, Evidence Ltd + 44 113 384 5680 -----Original Message----- From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Loet Leydesdorff Sent: 18 June 2008 07:35 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Citation statistics Dear Stevan, I now read the article on which you base your argument entitled "The correlation between RAE ratings and citation counts in psychology" (Andy Smith and Mike Eysenck, Department of Psychology, Royal Holloway, University of London, June 2002; at http://cogprints.org/2749/1/citations.pdf. "The above correlations are remarkably high, especially when account is taken of the fact that there is nothing like a perfect overlap between the individuals included in our analysis of citation counts and those included in the two RAEs." "Despite very high correlations between citations and RAE grades, there are a few individual departments that depart from the trend. These appear as 'outliers' in Fig. 2. Herein lies a danger." "The difference between the correlations for the two RAE years is small and statistically nonsignificant. However, the fact that citation counts are historical, in the sense of referring to research reported some time earlier, means that it is reasonable to expect them to predict previous RAE ratings better than future ratings." It made me remember that the chair person of the Nobel Price committee once told John Irvine that he always checked citation rates for the top candidates. Yes, there is a correlation between the indicators. However, in my opinion, the issue is eventually not to predict future RAE ratings --as you argue-- but to predict future performance. Best wishes, Loet ________________________________ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR), Kloveniersburgwal 48, 1012 CX Amsterdam. Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 loet at leydesdorff.net ; http://www.leydesdorff.net/ > -----Original Message----- > From: Loet Leydesdorff [mailto:loet at leydesdorff.net] > Sent: Monday, June 16, 2008 7:40 PM > To: 'ASIS&T Special Interest Group on Metrics' > Subject: RE: [SIGMETRICS] Citation statistics > > Dear Stevan, > > If I correctly understand then your claim is that ranking > results based on peer review at the departmental level > correlate highly with MEAN departmental citation rates. This > would be the case for psychology, wouldn't it? > > It is an amazing result because one does not expect citation > rates to be normally distributed. (The means of the citation > rates, of coures, are normally distributed.) In my own > department, for example (in communication studies), we have > various communities (social-psychologists, information > scientists, political science) with very different citation > patterns. But perhaps, British psychology departments are > exceptionally homongeneous both internally and comparatively. > > Then, you wish to strengthen this correlation by adding more > indicators. The other indicators may correlate better or > worse with the ratings. The former ones can add to the > correlations, while the latter would worsen them. Or do you > wish only to add indicators which improve the correlations > with the ratings? > > I remember from a previous conversation on this subject that > you have a kind of multi-variate regression model in mind in > which the RAE ratings would be the dependent variable. One > can make the model fit to the rankings by estimating the > parameters. One can also refine this per discipline. Would > one expecat any predictive power in such a model in a new > situation (after 4 years)? Why? > > With best wishes, > > > Loet > > ________________________________ > > Loet Leydesdorff > Amsterdam School of Communications Research (ASCoR), > Kloveniersburgwal 48, 1012 CX Amsterdam. > Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 > loet at leydesdorff.net ; http://www.leydesdorff.net/ > > > > > -----Original Message----- > > From: ASIS&T Special Interest Group on Metrics > > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad > > Sent: Monday, June 16, 2008 3:20 PM > > To: SIGMETRICS at LISTSERV.UTK.EDU > > Subject: Re: [SIGMETRICS] Citation statistics > > > > Adminstrative info for SIGMETRICS (for example unsubscribe): > > http://web.utk.edu/~gwhitney/sigmetrics.html > > > > On Sun, 15 Jun 2008, Loet Leydesdorff wrote: > > > > >> SH: But what all this valuable, valid cautionary > > discussion overlooks is not > > >> only the possibility but the *empirically demonstrated > > fact* that there > > >> exist metrics that are highly correlated with human expert > > rankings. > > > > > > It seems to me that it is difficult to generalize from one > > setting in which > > > human experts and certain ranks coincided to the > *existence *of such > > > correlations across the board. Much may depend on how the > > experts are > > > selected. I did some research in which referee reports did > > not correlate > > > with citation and publication measures. > > > > Much may depend on how the experts are selected, but that > was just as > > true during the 20 years in which rankings by experts were the sole > > criterion for the rankings in the UR Research Assessment Exercise > > (RAE). (In validating predictive metrics one must not endeavor to be > > Holier than the Pope: Your predictor can at best hope to be > > as good as, > > but not better than, your criterion.) > > > > That said: All correlations to date between total > departmental author > > citation counts (not journal impact factors!) and RAE peer rankings > > have been positive, sizable, and statistically significant for the > > RAE, in all disciplines and all years tested. Variance > there will be, > > always, but a good-sized component from citations alone seems to be > > well-established. Please see the studies of Professor Oppenheim and > > others, for example as cited in: > > > > Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) > > Mandated online > > RAE CVs Linked to University Eprint Archives: Improving > > the UK Research > > Assessment Exercise whilst making it cheaper and easier. > > Ariadne 35. > > http://www.ariadne.ac.uk/issue35/harnad/ > > > > > Human experts are necessarily selected from a population of > > experts, and it > > > is often difficult to delineate between fields of expertise. > > > > Correct. And the RAE rankings are done separately, discipline by > > discipline; the validation of the metrics should be done > that way too. > > > > Perhaps there is sometimes a case for separate rankings even at > > sub-disciplinary level. I expect the departments will be > able to sort > > that out. (And note that the RAE correlations do not constitute a > > validation of metrics for evaluating individuals: I am > confident that > > that too will be possible, but it will require many more metrics and > > much more validation.) > > > > > Similarly, we > > > know from quite some research that citation and publication > > practices are > > > field-specific and that fields are not so easy to > > delineate. Results may be > > > very sensitive to choices made, for example, in terms of > > citation windows. > > > > As noted, some of the variance in peer judgments will depend on the > > sample of peers chosen; that is unavoidable. That is also why "light > > touch" peer re-validation, spot-checks, updates and > > optimizations on the > > initialized metric weights are also a good idea, across the years. > > > > As to the need to evaluate sub-disciplines independently: > > that question > > exceeds the scope of metrics and metric validation. > > > > > Thus, I am bit doubtful about your claims of an > > "empirically demonstrated > > > fact." > > > > Within the scope mentioned -- the RAE peer rankings, for disciplines > > such as they have been partitioned for the past two decades > > -- there is > > ample grounds for confidence in the empirical results to date. > > > > (And please note that this has nothing to do with journal > > impact factors, > > journal field classification, or journal rankings. It is > about the RAE > > and the ranking of university departments by peer panels, as > > correlated > > with citation counts.) > > > > Stevan Harnad > > AMERICAN SCIENTIST OPEN ACCESS FORUM: > > http://amsci-forum.amsci.org/archives/American-Scientist-Open- > > Access-Forum.html > > http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ > > > > UNIVERSITIES and RESEARCH FUNDERS: > > If you have adopted or plan to adopt a policy of providing > Open Access > > to your own research article output, please describe your policy at: > > http://www.eprints.org/signup/sign.php > > http://openaccess.eprints.org/index.php?/archives/71-guid.html > > http://openaccess.eprints.org/index.php?/archives/136-guid.html > > > > OPEN-ACCESS-PROVISION POLICY: > > BOAI-1 ("Green"): Publish your article in a suitable > > toll-access journal > > http://romeo.eprints.org/ > > OR > > BOAI-2 ("Gold"): Publish your article in an open-access > > journal if/when > > a suitable one exists. > > http://www.doaj.org/ > > AND > > in BOTH cases self-archive a supplementary version of > > your article > > in your own institutional repository. > > http://www.eprints.org/self-faq/ > > http://archives.eprints.org/ > > http://openaccess.eprints.org/ > > > From loet at LEYDESDORFF.NET Wed Jun 18 05:45:21 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Wed, 18 Jun 2008 11:45:21 +0200 Subject: Citation statistics In-Reply-To: <81A4EE9059B88C4CBCB7F80231E06546731C96@evidence1.Evidence.local> Message-ID: Yes, "granularity of the normalization" is the right concept. What are the units of analysis? Department can be a mixed bag. If one wishes to predict the RAE ratings, one has to use them as units of analysis. However, if one wishes to predict research performance, one better defines research groups that are driven by developments at (cognitive) research fronts. The use of departments as units of analysis is an administrative artifact. With best wishes, Loet ________________________________ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR), Kloveniersburgwal 48, 1012 CX Amsterdam. Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 loet at leydesdorff.net ; http://www.leydesdorff.net/ > -----Original Message----- > From: ASIS&T Special Interest Group on Metrics > [mailto:SIGMETRICS at listserv.utk.edu] On Behalf Of Jonathan Adams > Sent: Wednesday, June 18, 2008 11:23 AM > To: SIGMETRICS at listserv.utk.edu > Subject: Re: [SIGMETRICS] Citation statistics > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > There is also an analysis of the UK Psychology data in our > recent paper > in Scientometrics [J Adams, K Gurney and L Jackson. Calibrating the > zoom - a test of Zitt's hypothesis. Scientometrics, Vol. 75, No. 1 > (2008) 81-95, DOI: 10.1007/s11192-007-1832-7] > The paper is about the extent to which correlation (between average > citation impact and peer-reviewed RAE grade) is affected by the > granularity of normalisation. For Psychology, Figure 1 shows > the spread > of impact for individual institutions awarded grade 4, 5 or 5* at > RAE2001. Spearman gives a more significant correlation for the > Psychology data than for Biology or Physics (Table 4), which > may suggest > some particular characteristics (perhaps, greater homogeneity) for the > Thomson Reuters recorded publication and citation data for Psychology. > However, although the correlation is 'significant' the > residual variance > evident in Figure 1 would raise an interesting challenge to using the > impact data as a sole determinant of funding. > > > Jonathan Adams > > Director, Evidence Ltd > + 44 113 384 5680 > > -----Original Message----- > From: ASIS&T Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Loet Leydesdorff > Sent: 18 June 2008 07:35 > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: Re: [SIGMETRICS] Citation statistics > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > Dear Stevan, > > I now read the article on which you base your argument entitled "The > correlation between RAE ratings and citation counts in > psychology" (Andy > Smith and Mike Eysenck, Department of Psychology, Royal Holloway, > University > of London, June 2002; at http://cogprints.org/2749/1/citations.pdf. > > "The above correlations are remarkably high, especially when > account is > taken of the fact that > there is nothing like a perfect overlap between the > individuals included > in > our analysis of > citation counts and those included in the two RAEs." > > "Despite very high correlations between citations and RAE > grades, there > are > a few individual > departments that depart from the trend. These appear as 'outliers' in > Fig. > 2. Herein lies a > danger." > > "The difference between the correlations for the two RAE > years is small > and > statistically nonsignificant. However, the fact that citation > counts are > historical, in the sense of referring to research reported some time > earlier, means that it is reasonable to expect them to > predict previous > RAE > ratings better than future ratings." > > It made me remember that the chair person of the Nobel Price committee > once > told John Irvine that he always checked citation rates for the top > candidates. Yes, there is a correlation between the > indicators. However, > in > my opinion, the issue is eventually not to predict future RAE ratings > --as > you argue-- but to predict future performance. > > Best wishes, > > > Loet > > ________________________________ > > Loet Leydesdorff > Amsterdam School of Communications Research (ASCoR), > Kloveniersburgwal 48, 1012 CX Amsterdam. > Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 > loet at leydesdorff.net ; http://www.leydesdorff.net/ > > > > > -----Original Message----- > > From: Loet Leydesdorff [mailto:loet at leydesdorff.net] > > Sent: Monday, June 16, 2008 7:40 PM > > To: 'ASIS&T Special Interest Group on Metrics' > > Subject: RE: [SIGMETRICS] Citation statistics > > > > Dear Stevan, > > > > If I correctly understand then your claim is that ranking > > results based on peer review at the departmental level > > correlate highly with MEAN departmental citation rates. This > > would be the case for psychology, wouldn't it? > > > > It is an amazing result because one does not expect citation > > rates to be normally distributed. (The means of the citation > > rates, of coures, are normally distributed.) In my own > > department, for example (in communication studies), we have > > various communities (social-psychologists, information > > scientists, political science) with very different citation > > patterns. But perhaps, British psychology departments are > > exceptionally homongeneous both internally and comparatively. > > > > Then, you wish to strengthen this correlation by adding more > > indicators. The other indicators may correlate better or > > worse with the ratings. The former ones can add to the > > correlations, while the latter would worsen them. Or do you > > wish only to add indicators which improve the correlations > > with the ratings? > > > > I remember from a previous conversation on this subject that > > you have a kind of multi-variate regression model in mind in > > which the RAE ratings would be the dependent variable. One > > can make the model fit to the rankings by estimating the > > parameters. One can also refine this per discipline. Would > > one expecat any predictive power in such a model in a new > > situation (after 4 years)? Why? > > > > With best wishes, > > > > > > Loet > > > > ________________________________ > > > > Loet Leydesdorff > > Amsterdam School of Communications Research (ASCoR), > > Kloveniersburgwal 48, 1012 CX Amsterdam. > > Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 > > loet at leydesdorff.net ; http://www.leydesdorff.net/ > > > > > > > > > -----Original Message----- > > > From: ASIS&T Special Interest Group on Metrics > > > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad > > > Sent: Monday, June 16, 2008 3:20 PM > > > To: SIGMETRICS at LISTSERV.UTK.EDU > > > Subject: Re: [SIGMETRICS] Citation statistics > > > > > > Adminstrative info for SIGMETRICS (for example unsubscribe): > > > http://web.utk.edu/~gwhitney/sigmetrics.html > > > > > > On Sun, 15 Jun 2008, Loet Leydesdorff wrote: > > > > > > >> SH: But what all this valuable, valid cautionary > > > discussion overlooks is not > > > >> only the possibility but the *empirically demonstrated > > > fact* that there > > > >> exist metrics that are highly correlated with human expert > > > rankings. > > > > > > > > It seems to me that it is difficult to generalize from one > > > setting in which > > > > human experts and certain ranks coincided to the > > *existence *of such > > > > correlations across the board. Much may depend on how the > > > experts are > > > > selected. I did some research in which referee reports did > > > not correlate > > > > with citation and publication measures. > > > > > > Much may depend on how the experts are selected, but that > > was just as > > > true during the 20 years in which rankings by experts > were the sole > > > criterion for the rankings in the UR Research Assessment Exercise > > > (RAE). (In validating predictive metrics one must not > endeavor to be > > > Holier than the Pope: Your predictor can at best hope to be > > > as good as, > > > but not better than, your criterion.) > > > > > > That said: All correlations to date between total > > departmental author > > > citation counts (not journal impact factors!) and RAE > peer rankings > > > have been positive, sizable, and statistically significant for the > > > RAE, in all disciplines and all years tested. Variance > > there will be, > > > always, but a good-sized component from citations alone > seems to be > > > well-established. Please see the studies of Professor > Oppenheim and > > > others, for example as cited in: > > > > > > Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) > > > Mandated online > > > RAE CVs Linked to University Eprint Archives: Improving > > > the UK Research > > > Assessment Exercise whilst making it cheaper and easier. > > > Ariadne 35. > > > http://www.ariadne.ac.uk/issue35/harnad/ > > > > > > > Human experts are necessarily selected from a population of > > > experts, and it > > > > is often difficult to delineate between fields of expertise. > > > > > > Correct. And the RAE rankings are done separately, discipline by > > > discipline; the validation of the metrics should be done > > that way too. > > > > > > Perhaps there is sometimes a case for separate rankings even at > > > sub-disciplinary level. I expect the departments will be > > able to sort > > > that out. (And note that the RAE correlations do not constitute a > > > validation of metrics for evaluating individuals: I am > > confident that > > > that too will be possible, but it will require many more > metrics and > > > much more validation.) > > > > > > > Similarly, we > > > > know from quite some research that citation and publication > > > practices are > > > > field-specific and that fields are not so easy to > > > delineate. Results may be > > > > very sensitive to choices made, for example, in terms of > > > citation windows. > > > > > > As noted, some of the variance in peer judgments will > depend on the > > > sample of peers chosen; that is unavoidable. That is also > why "light > > > touch" peer re-validation, spot-checks, updates and > > > optimizations on the > > > initialized metric weights are also a good idea, across the years. > > > > > > As to the need to evaluate sub-disciplines independently: > > > that question > > > exceeds the scope of metrics and metric validation. > > > > > > > Thus, I am bit doubtful about your claims of an > > > "empirically demonstrated > > > > fact." > > > > > > Within the scope mentioned -- the RAE peer rankings, for > disciplines > > > such as they have been partitioned for the past two decades > > > -- there is > > > ample grounds for confidence in the empirical results to date. > > > > > > (And please note that this has nothing to do with journal > > > impact factors, > > > journal field classification, or journal rankings. It is > > about the RAE > > > and the ranking of university departments by peer panels, as > > > correlated > > > with citation counts.) > > > > > > Stevan Harnad > > > AMERICAN SCIENTIST OPEN ACCESS FORUM: > > > http://amsci-forum.amsci.org/archives/American-Scientist-Open- > > > Access-Forum.html > > > http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ > > > > > > UNIVERSITIES and RESEARCH FUNDERS: > > > If you have adopted or plan to adopt a policy of providing > > Open Access > > > to your own research article output, please describe your > policy at: > > > http://www.eprints.org/signup/sign.php > > > > http://openaccess.eprints.org/index.php?/archives/71-guid.html > > > > http://openaccess.eprints.org/index.php?/archives/136-guid.html > > > > > > OPEN-ACCESS-PROVISION POLICY: > > > BOAI-1 ("Green"): Publish your article in a suitable > > > toll-access journal > > > http://romeo.eprints.org/ > > > OR > > > BOAI-2 ("Gold"): Publish your article in an open-access > > > journal if/when > > > a suitable one exists. > > > http://www.doaj.org/ > > > AND > > > in BOTH cases self-archive a supplementary version of > > > your article > > > in your own institutional repository. > > > http://www.eprints.org/self-faq/ > > > http://archives.eprints.org/ > > > http://openaccess.eprints.org/ > > > > > > From harnad at ECS.SOTON.AC.UK Wed Jun 18 10:33:08 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Wed, 18 Jun 2008 10:33:08 -0400 Subject: Citation statistics In-Reply-To: Message-ID: Dear Loet: (1) The correlation between RAE ranks and citation counts was not just found in the Eysenck/Smith study, but in many others (mainly conducted by Prof. Charles Oppenheim and his co-workers). (2) Future performance is predicted on the basis of past performance. The objective is not to predict future RAE rankings but to substitute a faster, cheaper and potentially richer set of metrics for the slow, labour-intensive peer-re-evaluations of already peer-reviewed, published research, once the metrics have been validated against peer rankings. If the correlation is high, the cheap rankings can substitute for the costly ones. (3) These metrics concerning the comparative rankings of populations (departments) not individual researchers (though metrics will no doubt be useful supplements for individual evaluation too, along side peer assessment). (4) The aspect of metric validation that I stress the most is that although citations are highly correlated with peer rankings, there are many other potential metrics too, to be first co-validated and initialized, and then to be calibrated and updated continuously in time. Chrs, Sevan On 18-Jun-08, at 2:34 AM, Loet Leydesdorff wrote: > I now read the article on which you base your argument entitled "The > correlation between RAE ratings and citation counts in > psychology" (Andy > Smith and Mike Eysenck, Department of Psychology, Royal Holloway, > University > of London, June 2002; at http://cogprints.org/2749/1/citations.pdf. > > "The above correlations are remarkably high, especially when account > is > taken of the fact that > there is nothing like a perfect overlap between the individuals > included in > our analysis of > citation counts and those included in the two RAEs." > > "Despite very high correlations between citations and RAE grades, > there are > a few individual > departments that depart from the trend. These appear as 'outliers' > in Fig. > 2. Herein lies a > danger." > > "The difference between the correlations for the two RAE years is > small and > statistically nonsignificant. However, the fact that citation counts > are > historical, in the sense of referring to research reported some time > earlier, means that it is reasonable to expect them to predict > previous RAE > ratings better than future ratings." > > It made me remember that the chair person of the Nobel Price > committee once > told John Irvine that he always checked citation rates for the top > candidates. Yes, there is a correlation between the indicators. > However, in > my opinion, the issue is eventually not to predict future RAE > ratings --as > you argue-- but to predict future performance. > > Best wishes, > > > Loet > > ________________________________ > > Loet Leydesdorff > Amsterdam School of Communications Research (ASCoR), > Kloveniersburgwal 48, 1012 CX Amsterdam. > Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 > loet at leydesdorff.net ; http://www.leydesdorff.net/ > > > >> -----Original Message----- >> From: Loet Leydesdorff [mailto:loet at leydesdorff.net] >> Sent: Monday, June 16, 2008 7:40 PM >> To: 'ASIS&T Special Interest Group on Metrics' >> Subject: RE: [SIGMETRICS] Citation statistics >> >> Dear Stevan, >> >> If I correctly understand then your claim is that ranking >> results based on peer review at the departmental level >> correlate highly with MEAN departmental citation rates. This >> would be the case for psychology, wouldn't it? >> >> It is an amazing result because one does not expect citation >> rates to be normally distributed. (The means of the citation >> rates, of coures, are normally distributed.) In my own >> department, for example (in communication studies), we have >> various communities (social-psychologists, information >> scientists, political science) with very different citation >> patterns. But perhaps, British psychology departments are >> exceptionally homongeneous both internally and comparatively. >> >> Then, you wish to strengthen this correlation by adding more >> indicators. The other indicators may correlate better or >> worse with the ratings. The former ones can add to the >> correlations, while the latter would worsen them. Or do you >> wish only to add indicators which improve the correlations >> with the ratings? >> >> I remember from a previous conversation on this subject that >> you have a kind of multi-variate regression model in mind in >> which the RAE ratings would be the dependent variable. One >> can make the model fit to the rankings by estimating the >> parameters. One can also refine this per discipline. Would >> one expecat any predictive power in such a model in a new >> situation (after 4 years)? Why? >> >> With best wishes, >> >> >> Loet >> >> ________________________________ >> >> Loet Leydesdorff >> Amsterdam School of Communications Research (ASCoR), >> Kloveniersburgwal 48, 1012 CX Amsterdam. >> Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 >> loet at leydesdorff.net ; http://www.leydesdorff.net/ >> >> >> >>> -----Original Message----- >>> From: ASIS&T Special Interest Group on Metrics >>> [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad >>> Sent: Monday, June 16, 2008 3:20 PM >>> To: SIGMETRICS at LISTSERV.UTK.EDU >>> Subject: Re: [SIGMETRICS] Citation statistics >>> >>> Adminstrative info for SIGMETRICS (for example unsubscribe): >>> http://web.utk.edu/~gwhitney/sigmetrics.html >>> >>> On Sun, 15 Jun 2008, Loet Leydesdorff wrote: >>> >>>>> SH: But what all this valuable, valid cautionary >>> discussion overlooks is not >>>>> only the possibility but the *empirically demonstrated >>> fact* that there >>>>> exist metrics that are highly correlated with human expert >>> rankings. >>>> >>>> It seems to me that it is difficult to generalize from one >>> setting in which >>>> human experts and certain ranks coincided to the >> *existence *of such >>>> correlations across the board. Much may depend on how the >>> experts are >>>> selected. I did some research in which referee reports did >>> not correlate >>>> with citation and publication measures. >>> >>> Much may depend on how the experts are selected, but that >> was just as >>> true during the 20 years in which rankings by experts were the sole >>> criterion for the rankings in the UR Research Assessment Exercise >>> (RAE). (In validating predictive metrics one must not endeavor to be >>> Holier than the Pope: Your predictor can at best hope to be >>> as good as, >>> but not better than, your criterion.) >>> >>> That said: All correlations to date between total >> departmental author >>> citation counts (not journal impact factors!) and RAE peer rankings >>> have been positive, sizable, and statistically significant for the >>> RAE, in all disciplines and all years tested. Variance >> there will be, >>> always, but a good-sized component from citations alone seems to be >>> well-established. Please see the studies of Professor Oppenheim and >>> others, for example as cited in: >>> >>> Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) >>> Mandated online >>> RAE CVs Linked to University Eprint Archives: Improving >>> the UK Research >>> Assessment Exercise whilst making it cheaper and easier. >>> Ariadne 35. >>> http://www.ariadne.ac.uk/issue35/harnad/ >>> >>>> Human experts are necessarily selected from a population of >>> experts, and it >>>> is often difficult to delineate between fields of expertise. >>> >>> Correct. And the RAE rankings are done separately, discipline by >>> discipline; the validation of the metrics should be done >> that way too. >>> >>> Perhaps there is sometimes a case for separate rankings even at >>> sub-disciplinary level. I expect the departments will be >> able to sort >>> that out. (And note that the RAE correlations do not constitute a >>> validation of metrics for evaluating individuals: I am >> confident that >>> that too will be possible, but it will require many more metrics and >>> much more validation.) >>> >>>> Similarly, we >>>> know from quite some research that citation and publication >>> practices are >>>> field-specific and that fields are not so easy to >>> delineate. Results may be >>>> very sensitive to choices made, for example, in terms of >>> citation windows. >>> >>> As noted, some of the variance in peer judgments will depend on the >>> sample of peers chosen; that is unavoidable. That is also why "light >>> touch" peer re-validation, spot-checks, updates and >>> optimizations on the >>> initialized metric weights are also a good idea, across the years. >>> >>> As to the need to evaluate sub-disciplines independently: >>> that question >>> exceeds the scope of metrics and metric validation. >>> >>>> Thus, I am bit doubtful about your claims of an >>> "empirically demonstrated >>>> fact." >>> >>> Within the scope mentioned -- the RAE peer rankings, for disciplines >>> such as they have been partitioned for the past two decades >>> -- there is >>> ample grounds for confidence in the empirical results to date. >>> >>> (And please note that this has nothing to do with journal >>> impact factors, >>> journal field classification, or journal rankings. It is >> about the RAE >>> and the ranking of university departments by peer panels, as >>> correlated >>> with citation counts.) >>> >>> Stevan Harnad >>> AMERICAN SCIENTIST OPEN ACCESS FORUM: >>> http://amsci-forum.amsci.org/archives/American-Scientist-Open- >>> Access-Forum.html >>> http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ >>> >>> UNIVERSITIES and RESEARCH FUNDERS: >>> If you have adopted or plan to adopt a policy of providing >> Open Access >>> to your own research article output, please describe your policy at: >>> http://www.eprints.org/signup/sign.php >>> http://openaccess.eprints.org/index.php?/archives/71-guid.html >>> http://openaccess.eprints.org/index.php?/archives/136-guid.html >>> >>> OPEN-ACCESS-PROVISION POLICY: >>> BOAI-1 ("Green"): Publish your article in a suitable >>> toll-access journal >>> http://romeo.eprints.org/ >>> OR >>> BOAI-2 ("Gold"): Publish your article in an open-access >>> journal if/when >>> a suitable one exists. >>> http://www.doaj.org/ >>> AND >>> in BOTH cases self-archive a supplementary version of >>> your article >>> in your own institutional repository. >>> http://www.eprints.org/self-faq/ >>> http://archives.eprints.org/ >>> http://openaccess.eprints.org/ >>> >> From harnad at ECS.SOTON.AC.UK Wed Jun 18 10:54:12 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Wed, 18 Jun 2008 10:54:12 -0400 Subject: Citation statistics In-Reply-To: Message-ID: On 18-Jun-08, at 5:22 AM, Jonathan Adams wrote: > There is also an analysis of the UK Psychology data in our recent > paper > in Scientometrics [J Adams, K Gurney and L Jackson. Calibrating the > zoom - a test of Zitt's hypothesis. Scientometrics, Vol. 75, No. 1 > (2008) 81-95, DOI: 10.1007/s11192-007-1832-7] > The paper is about the extent to which correlation (between average > citation impact and peer-reviewed RAE grade) is affected by the > granularity of normalisation. For Psychology, Figure 1 shows the > spread > of impact for individual institutions awarded grade 4, 5 or 5* at > RAE2001. Spearman gives a more significant correlation for the > Psychology data than for Biology or Physics (Table 4), which may > suggest > some particular characteristics (perhaps, greater homogeneity) for the > Thomson Reuters recorded publication and citation data for Psychology. > However, although the correlation is 'significant' the residual > variance > evident in Figure 1 would raise an interesting challenge to using the > impact data as a sole determinant of funding. The sensible strategy is not to replace RAE rankings with a single metric, like citation counts, even though they are highly correlated. The sensible strategy is to test a rich spectrum of multiple metrics, jointly, against the RAE panel rankings in the parallel metric/panel RAE 2008, discipline by discipline. And if you think peer rankings are more reliable than the metrics with which they are correlated, do a split-half reliability test on the peer rankings and see whether they are better correlated with one another than the metrics are with the rankings... Harnad, S. (2007) Open Access Scientometrics and the UK Research Assessment Exercise.Scientometrics, 73 (in press). http://eprints.ecs.soton.ac.uk/14778/ > > > > Jonathan Adams > > Director, Evidence Ltd > + 44 113 384 5680 > > -----Original Message----- > From: ASIS&T Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Loet Leydesdorff > Sent: 18 June 2008 07:35 > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: Re: [SIGMETRICS] Citation statistics > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > Dear Stevan, > > I now read the article on which you base your argument entitled "The > correlation between RAE ratings and citation counts in > psychology" (Andy > Smith and Mike Eysenck, Department of Psychology, Royal Holloway, > University > of London, June 2002; at http://cogprints.org/2749/1/citations.pdf. > > "The above correlations are remarkably high, especially when account > is > taken of the fact that > there is nothing like a perfect overlap between the individuals > included > in > our analysis of > citation counts and those included in the two RAEs." > > "Despite very high correlations between citations and RAE grades, > there > are > a few individual > departments that depart from the trend. These appear as 'outliers' in > Fig. > 2. Herein lies a > danger." > > "The difference between the correlations for the two RAE years is > small > and > statistically nonsignificant. However, the fact that citation counts > are > historical, in the sense of referring to research reported some time > earlier, means that it is reasonable to expect them to predict > previous > RAE > ratings better than future ratings." > > It made me remember that the chair person of the Nobel Price committee > once > told John Irvine that he always checked citation rates for the top > candidates. Yes, there is a correlation between the indicators. > However, > in > my opinion, the issue is eventually not to predict future RAE ratings > --as > you argue-- but to predict future performance. > > Best wishes, > > > Loet > > ________________________________ > > Loet Leydesdorff > Amsterdam School of Communications Research (ASCoR), > Kloveniersburgwal 48, 1012 CX Amsterdam. > Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 > loet at leydesdorff.net ; http://www.leydesdorff.net/ > > > >> -----Original Message----- >> From: Loet Leydesdorff [mailto:loet at leydesdorff.net] >> Sent: Monday, June 16, 2008 7:40 PM >> To: 'ASIS&T Special Interest Group on Metrics' >> Subject: RE: [SIGMETRICS] Citation statistics >> >> Dear Stevan, >> >> If I correctly understand then your claim is that ranking >> results based on peer review at the departmental level >> correlate highly with MEAN departmental citation rates. This >> would be the case for psychology, wouldn't it? >> >> It is an amazing result because one does not expect citation >> rates to be normally distributed. (The means of the citation >> rates, of coures, are normally distributed.) In my own >> department, for example (in communication studies), we have >> various communities (social-psychologists, information >> scientists, political science) with very different citation >> patterns. But perhaps, British psychology departments are >> exceptionally homongeneous both internally and comparatively. >> >> Then, you wish to strengthen this correlation by adding more >> indicators. The other indicators may correlate better or >> worse with the ratings. The former ones can add to the >> correlations, while the latter would worsen them. Or do you >> wish only to add indicators which improve the correlations >> with the ratings? >> >> I remember from a previous conversation on this subject that >> you have a kind of multi-variate regression model in mind in >> which the RAE ratings would be the dependent variable. One >> can make the model fit to the rankings by estimating the >> parameters. One can also refine this per discipline. Would >> one expecat any predictive power in such a model in a new >> situation (after 4 years)? Why? >> >> With best wishes, >> >> >> Loet >> >> ________________________________ >> >> Loet Leydesdorff >> Amsterdam School of Communications Research (ASCoR), >> Kloveniersburgwal 48, 1012 CX Amsterdam. >> Tel.: +31-20- 525 6598; fax: +31-20- 525 3681 >> loet at leydesdorff.net ; http://www.leydesdorff.net/ >> >> >> >>> -----Original Message----- >>> From: ASIS&T Special Interest Group on Metrics >>> [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stevan Harnad >>> Sent: Monday, June 16, 2008 3:20 PM >>> To: SIGMETRICS at LISTSERV.UTK.EDU >>> Subject: Re: [SIGMETRICS] Citation statistics >>> >>> Adminstrative info for SIGMETRICS (for example unsubscribe): >>> http://web.utk.edu/~gwhitney/sigmetrics.html >>> >>> On Sun, 15 Jun 2008, Loet Leydesdorff wrote: >>> >>>>> SH: But what all this valuable, valid cautionary >>> discussion overlooks is not >>>>> only the possibility but the *empirically demonstrated >>> fact* that there >>>>> exist metrics that are highly correlated with human expert >>> rankings. >>>> >>>> It seems to me that it is difficult to generalize from one >>> setting in which >>>> human experts and certain ranks coincided to the >> *existence *of such >>>> correlations across the board. Much may depend on how the >>> experts are >>>> selected. I did some research in which referee reports did >>> not correlate >>>> with citation and publication measures. >>> >>> Much may depend on how the experts are selected, but that >> was just as >>> true during the 20 years in which rankings by experts were the sole >>> criterion for the rankings in the UR Research Assessment Exercise >>> (RAE). (In validating predictive metrics one must not endeavor to be >>> Holier than the Pope: Your predictor can at best hope to be >>> as good as, >>> but not better than, your criterion.) >>> >>> That said: All correlations to date between total >> departmental author >>> citation counts (not journal impact factors!) and RAE peer rankings >>> have been positive, sizable, and statistically significant for the >>> RAE, in all disciplines and all years tested. Variance >> there will be, >>> always, but a good-sized component from citations alone seems to be >>> well-established. Please see the studies of Professor Oppenheim and >>> others, for example as cited in: >>> >>> Harnad, S., Carr, L., Brody, T. & Oppenheim, C. (2003) >>> Mandated online >>> RAE CVs Linked to University Eprint Archives: Improving >>> the UK Research >>> Assessment Exercise whilst making it cheaper and easier. >>> Ariadne 35. >>> http://www.ariadne.ac.uk/issue35/harnad/ >>> >>>> Human experts are necessarily selected from a population of >>> experts, and it >>>> is often difficult to delineate between fields of expertise. >>> >>> Correct. And the RAE rankings are done separately, discipline by >>> discipline; the validation of the metrics should be done >> that way too. >>> >>> Perhaps there is sometimes a case for separate rankings even at >>> sub-disciplinary level. I expect the departments will be >> able to sort >>> that out. (And note that the RAE correlations do not constitute a >>> validation of metrics for evaluating individuals: I am >> confident that >>> that too will be possible, but it will require many more metrics and >>> much more validation.) >>> >>>> Similarly, we >>>> know from quite some research that citation and publication >>> practices are >>>> field-specific and that fields are not so easy to >>> delineate. Results may be >>>> very sensitive to choices made, for example, in terms of >>> citation windows. >>> >>> As noted, some of the variance in peer judgments will depend on the >>> sample of peers chosen; that is unavoidable. That is also why "light >>> touch" peer re-validation, spot-checks, updates and >>> optimizations on the >>> initialized metric weights are also a good idea, across the years. >>> >>> As to the need to evaluate sub-disciplines independently: >>> that question >>> exceeds the scope of metrics and metric validation. >>> >>>> Thus, I am bit doubtful about your claims of an >>> "empirically demonstrated >>>> fact." >>> >>> Within the scope mentioned -- the RAE peer rankings, for disciplines >>> such as they have been partitioned for the past two decades >>> -- there is >>> ample grounds for confidence in the empirical results to date. >>> >>> (And please note that this has nothing to do with journal >>> impact factors, >>> journal field classification, or journal rankings. It is >> about the RAE >>> and the ranking of university departments by peer panels, as >>> correlated >>> with citation counts.) >>> >>> Stevan Harnad >>> AMERICAN SCIENTIST OPEN ACCESS FORUM: >>> http://amsci-forum.amsci.org/archives/American-Scientist-Open- >>> Access-Forum.html >>> http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/ >>> >>> UNIVERSITIES and RESEARCH FUNDERS: >>> If you have adopted or plan to adopt a policy of providing >> Open Access >>> to your own research article output, please describe your policy at: >>> http://www.eprints.org/signup/sign.php >>> http://openaccess.eprints.org/index.php?/archives/71-guid.html >>> http://openaccess.eprints.org/index.php?/archives/136-guid.html >>> >>> OPEN-ACCESS-PROVISION POLICY: >>> BOAI-1 ("Green"): Publish your article in a suitable >>> toll-access journal >>> http://romeo.eprints.org/ >>> OR >>> BOAI-2 ("Gold"): Publish your article in an open-access >>> journal if/when >>> a suitable one exists. >>> http://www.doaj.org/ >>> AND >>> in BOTH cases self-archive a supplementary version of >>> your article >>> in your own institutional repository. >>> http://www.eprints.org/self-faq/ >>> http://archives.eprints.org/ >>> http://openaccess.eprints.org/ >>> >> -------------- next part -------------- An HTML attachment was scrubbed... URL: From katy at INDIANA.EDU Thu Jun 19 21:50:01 2008 From: katy at INDIANA.EDU (Katy Borner) Date: Thu, 19 Jun 2008 21:50:01 -0400 Subject: CfP: Visualization and Data Analysis 2009 (EI108) Message-ID: Visualization and Data Analysis 2009 (EI108) Part of the IS&T/SPIE 21st Annual Symposium on Electronic Imaging 2009 http://vw.indiana.edu/vda2009 18-22 January 2009 . San Jose Convention Center . San Jose, CA USA Conference Chairs: Katy B?rner, Indiana Univ.; Jinah Park, Information and Communications Univ. (South Korea) Conference Cochairs: Matti T. Gr?hn, Ctr. for Scientific Computing (Finland); Ming C. Hao, Hewlett-Packard Labs.; Jonathan C. Roberts, Bangor Univ. (United Kingdom); Pak C. Wong, Pacific Northwest National Lab. Program Committee: Uwe Brinkschulte, Univ. Karlsruhe (Germany); Paul Craig, Napier Univ. (United Kingdom); Steve Eick, Visual Insights; Robert F. Erbacher, Utah State Univ.; Zhanping Liu, Mississippi State Univ.; Joerg Meyer, Univ. of California/Irvine; Hans-Georg Pagendarm, Deutsches Zentrum f?r Luft- und Raumfahrt e.V. (Germany); Alex T. Pang, Univ. of California/Santa Cruz; Aaron J. Quigley, National Univ. of Ireland/Dublin (Ireland); Deborah E. Silver, Rutgers Univ.; Kalpathi R. Subramanian, The Univ. of North Carolina at Charlotte; Yinlong Sun, Purdue Univ.; J. Edward Swan II, Naval Research Lab.; Yingcai Xiao, Univ. of Akron; William J. Yurcik, Univ. of Illinois at Urbana-Champaign Onsite Proceedings Due Dates: Full Paper for Review Due: 1 August 2008 Final Manuscript Due: 27 October 2008 Final Summary (200 words) Due: 17 November 2008 This conference covers all aspects of visualization and issues affecting successful visualizations. The conference has grown rapidly over the years and has attracted participants from throughout the world. Submissions are peer reviewed with an acceptance rate of ~50% making the quality of the conference and its publications extremely high. We invite you to contribute quality papers covering research results as well as works-in-progress. The papers from this conference will be published in a bound Proceedings available from SPIE. Authors of the best papers in the conference will have the option of having extended versions of their papers reviewed for publication in the Journal of Electronic Imaging or a future special issue of the Journal of Electronic Imaging focusing on visualization. Additional information can be found at: http://vw.indiana.edu/vda2009 and http://vw.indiana.edu/vda2009/VDA09.pdf -- Katy Borner, Victor H. Yngve Associate Professor of Information Science Director of the Cyberinfrastructure for Network Science Center School of Library and Information Science, Indiana University 10th Street & Jordan Avenue Phone: (812) 855-3256 Fax: -6166 Wells Library 021 E-mail: katy at indiana.edu Bloomington, IN 47405, USA WWW: ella.slis.indiana.edu/~katy Mapping Science exhibit will be on display at the National Research Council in Ottawa, Canada, April 3-June 27, 2008, http://scimaps.org/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From katy at INDIANA.EDU Thu Jun 19 21:37:35 2008 From: katy at INDIANA.EDU (Katy Borner) Date: Thu, 19 Jun 2008 21:37:35 -0400 Subject: July 8, 2008: IV08 Course on "Network Analysis and Visualization Using Network Workbench" In-Reply-To: <48057204.5050400@indiana.edu> Message-ID: There will be a half day course on Network Analysis and Visualization Using Network Workbench at the 12th International Conference on Information Visualisation,see http://www.graphicslink.co.uk/IV08. More information is below. A half-day Course: Tuesday 8th July 2008, Time: 10:30 -13:30 Network Analysis and Visualization Using Network Workbench Russell Duhon, Bruce W. Herr, Katy B?rner, and Weixia Huang Cyberinfrastructure for Network Science Center School of Library and Information Science, Indiana University Bloomington, USA Abstract Networks are all around us! This includes social networks, internet networks, biological networks, paper citation networks, and more. As these networks become more important in our daily lives the ability to understand their behavior will be more and more necessary. The Network Workbench (http://nwb.slis.indiana.edu ) was designed to aid in exploring and understanding these networks. In this tutorial we will introduce the Network Workbench and demonstrate how to use it to analyze and visualize your own networks. Organisation 1. A brief introduction to networks and network science 2. An introduction to the Network Workbench (NWB) project. 3. Hands on demonstrations of NWB 4. Extending NWB 5. Large-scale network visualization Agenda This tutorial will be a four hour, mostly hands-on, introduction to using and extending the Network Workbench for analysis and visualization of network data. Level of Tutorial: Introductory level Biography Russell Duhon designs, programs, parses, researches, and visualizes at Dr. Katy Borner's Cyberinfrastructure for Network Science Center at Indiana University. He likes making the little algorithms that fit between the big ones. Among his areas of interest are economics-inspired modelling of scientific activity, statistical methods for understanding data, and unusual data sets. He attended the School of Informatics of Indiana University in Bloomington, Indiana, which is also his home town. Bruce W. Herr II is a software developer at the Cyberinfrastructure for Network Science Center at Indiana University, directed by Katy B?rner. He enjoys making beautiful, extensible, usable, and maintainable software. Research interests are information visualization, human-computer interaction, cognitive processing, software design, aesthetics in visualization, and extensible software. Major software projects include the InfoVis Cyberinfrastructure , Cyberinfrastructure Shell , and Network Workbench . He has worked on many large-scale visualizations including Movies&Actors , Wikivis , Neurovis , and the US Patent Hierarchy Vis . Bruce received his BS in Computer Science in 2004 from Indiana University. His personal website is at http://about.bh2.net . Katy B?rner is the Victor H. Yngve Associate Professor of Information Science at the School of Library and Information Science, Adjunct Associate Professor in the School of Informatics, Core Faculty of Cognitive Science, Research Affiliate of the Biocomplexity Institute, Fellow of the Center for Research on Learning and Technology, Member of the Advanced Visualization Laboratory, and Founding Director of the Cyberinfrastructure for Network Science Center at Indiana University. She is a curator of the Places & Spaces: Mapping Science exhibit, http://scimaps.org/. Her research focuses on the development of data analysis and visualization techniques for information access, understanding, and management. She is particularly interested in the study of the structure and evolution of scientific disciplines; the analysis and visualization of online activity; and the development of cyberinfrastructures for large scale scientific collaboration and computation. <> Weixia Huang is a System Architect at the Cyberinfrastructure for Network Science Center at Indiana University. She has ten years industry experience on software developments and project managements. She currently leads the software development of the NSF funded Network Workbench (NWB) and Cyberinfrastructure Shell (CIShell) projects. She is particularly interested in designing and developing software with sound extensibility, usability, and scalability. Before joining the Cyberinfrastructure for Network Science Center, she has worked as Research Staff Member at Xerox Wilson Research Center and software engineer at Sprint. She was the architect and programmer at Xerox to develop a Device-Centric Enterprise Service Platform for automated data transmission and remote diagnosis systems. Cyberinfrastructure for Network Science Center School of Library and Information Science, Indiana University Bloomington, USA {rduhon, bherr, huangb, katy}@indiana.edu -- Katy Borner, Victor H. Yngve Associate Professor of Information Science Director of the Cyberinfrastructure for Network Science Center School of Library and Information Science, Indiana University 10th Street & Jordan Avenue Phone: (812) 855-3256 Fax: -6166 Wells Library 021 E-mail: katy at indiana.edu Bloomington, IN 47405, USA WWW: ella.slis.indiana.edu/~katy Mapping Science exhibit will be on display at the National Research Council in Ottawa, Canada, April 3-June 27, 2008, http://scimaps.org/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From Jessica.Shepherd at GUARDIAN.CO.UK Fri Jun 20 01:00:36 2008 From: Jessica.Shepherd at GUARDIAN.CO.UK (Jessica Shepherd) Date: Fri, 20 Jun 2008 06:00:36 +0100 Subject: Jessica Shepherd/Guardian/GNL is out of the office. Message-ID: I will be out of the office starting 19/06/2008 and will not return until 23/06/2008. I am out of the office on Friday June 20. For any urgent messages,call my mobile on 07957147308 or please contact Sharon Bainbridge on 020 72399943 or Stephanie Kerstein on 020 7239 9559. Many thanks. Jessica ------------------------------------------------------------------ Visit guardian.co.uk - the UK's most popular newspaper website http://guardian.co.uk http://observer.co.uk ------------------------------------------------------------------ The Newspaper Marketing Agency Opening Up Newspapers ------------------------------------------------------------------ The Guardian Public Services Awards 2008, in partnership with Hays Specialist Recruitment, recognise and reward outstanding performance from public, private and voluntary sector teams. To find out more and nominate a deserving team or individual, visit http://society.guardian.co.uk/publicservicesawards ------------------------------------------------------------------ Please consider the environment before printing this email This e-mail and all attachments are confidential and may also be privileged. If you are not the named recipient, please notify the sender and delete the e-mail and all attachments immediately. Do not disclose the contents to another person. You may not use the information for any purpose, or store, or copy, it in any way. Guardian News & Media Limited is not liable for any computer viruses or other material transmitted with or as part of this e-mail. You should employ virus checking software. Guardian News & Media Limited A member of Guardian Media Group PLC Registered Office Number 1 Scott Place, Manchester M3 3GG Registered in England Number 908396 From loet at LEYDESDORFF.NET Fri Jun 20 03:10:41 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Fri, 20 Jun 2008 09:10:41 +0200 Subject: A dynamic extension of multidimensional scaling: animating the development of _Social Networks_ Message-ID: Animating the development of _Social Networks_ over time using a dynamic extension of multidimensional scaling Loet Leydesdorff, Thomas Schank, Andrea Scharnhorst, & Wouter De Nooy The animation of network visualizations poses technical and theoretical challenges. Rather stable patterns are required before the mental map enables a user to make inferences over time. In order to enhance stability, we developed an extension of stress-minimization with developments over time. This dynamic layouter is no longer based on linear interpolation between independent static visualizations, but change over time is used as a parameter in the optimization. Because of our focus on structural change versus stability the attention is shifted from the relational graph to the latent eigenvectors of matrices. The approach is illustrated with animations for the journal citation environments of Social Networks, the (co-)author networks in the carrying community of this journal, and the topical development using relations among its title words. Our results are also compared with animations based on PajekToSVGAnim and SoNIA. pdf-version: ________________________________ Loet Leydesdorff, Amsterdam School of Communications Research (ASCoR), Kloveniersburgwal 48, 1012 CX Amsterdam From loet at LEYDESDORFF.NET Sat Jun 21 03:22:00 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Sat, 21 Jun 2008 09:22:00 +0200 Subject: The Triple Helix Model and the Knowledge-Based Economy; preprint version available Message-ID: The Triple Helix Model and the Knowledge-Based Economy Loet Leydesdorff & Martin Meyer Abstract. The Triple Helix model of university-industry-government relations can be generalized from a neo-institutional model of networks of relations to a neo-evolutionary model of how three selection environments operate upon one another. Two selection mechanisms operating upon each other can mutually shape a trajectory, while three selection environments can be expected to generate a regime. The neo-evolutionary model enables us to appreciate both organizational integration in university-industry-government relations and differentiation among functions like wealth creation, knowledge production, and legislation. The specification of systems of innovations in terms of nations, sectors, and regions can then be formulated as empirical questions: is synergy generated among functions in a network of relations? Thus, this Triple Helix model enables us to study the knowledge base of an economy in terms of a trade-off between locally stabilized and (potentially locked-in) trajectories versus techno-economic regimes at the global level. _____ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From krichel at OPENLIB.ORG Mon Jun 23 08:38:26 2008 From: krichel at OPENLIB.ORG (Thomas Krichel) Date: Mon, 23 Jun 2008 19:38:26 +0700 Subject: Quick question... In-Reply-To: <478B0BDF.9070401@cindoc.csic.es> Message-ID: Isidro F. Aguillo writes, on 14 January 2008 > Unfortunately there is no more printed Proceedings available. But we are > working now on the electronic version that will be available online in > the Conference website soon: > > http://issi2007.cindoc.csic.es Is it there now? I had a look but I did not see it. Cheers, Thomas Krichel http://openlib.org/home/krichel RePEc:per:1965-06-05:thomas_krichel phone: +7 383 330 6813 skype: thomaskrichel From garfield at CODEX.CIS.UPENN.EDU Mon Jun 23 14:11:49 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 23 Jun 2008 14:11:49 -0400 Subject: Aylward, BS; Roberts, MC; Colombo, J; Steele, RG Identifying the classics: An examination of articles published in the Journal of Pediatric Psychology from 1976-2006 JOURNAL OF PEDIATRIC PSYCHOLOGY, 33 (6): 576-589 JUL 2008 Message-ID: E-mail Address: mroberts at ku.edu Author(s): Aylward, BS (Aylward, Brandon S.); Roberts, MC (Roberts, Michael C.); Colombo, J (Colombo, John); Steele, RG (Steele, Ric G.) Title: Identifying the classics: An examination of articles published in the Journal of Pediatric Psychology from 1976-2006 Source: JOURNAL OF PEDIATRIC PSYCHOLOGY, 33 (6): 576-589 JUL 2008 Language: English Document Type: Review Author Keywords: citation analysis; classics; Journal of Pediatric Psychology Keywords Plus: SICKLE-CELL DISEASE; DEPENDENT DIABETES-MELLITUS; EMPIRICALLY SUPPORTED TREATMENTS; PHYSICALLY-HANDICAPPED CHILDREN; SURVIVING CHILDHOOD-CANCER; ATTENTION-DEFICIT DISORDER; RECURRENT ABDOMINAL-PAIN; LONGITUDINAL FOLLOW-UP; 100 CITATION-CLASSICS; CLOSED HEAD- INJURY Abstract: Objectives The purpose of the present investigation was to identify the top 100 most highly cited classic articles in the Journal of Pediatric Psychology, from 1976 to 2006. Methods The Cited Reference search option of the Web of Science was used, which allows for identification of variations in citations. Results One-hundred and four classic articles ranging in citations from 46 to 192 (M = 71.66, SD = 31.15) were identified. These articles were found to be mostly applied research that focused predominantly on children across several age groups with chronic illness. Citation trends among the classics revealed an inverted-u shape relationship between year since publication and citations per year, which peaked around seven years after publication. Conclusions The current findings highlight some of the influential works in the field, which have contributed to important advances not only the field of pediatric psychology but other fields as well. Addresses: Univ Kansas, Clin Child Psychol Program, Lawrence, KS 66045 USA; Univ Kansas, Dept Psychol, Lawrence, KS 66045 USA Reprint Address: Roberts, MC, Univ Kansas, Clin Child Psychol Program, 1000 Sunnyside Ave,Room 2010, Lawrence, KS 66045 USA. E-mail Address: mroberts at ku.edu Cited Reference Count: 136 Times Cited: 0 Publisher: OXFORD UNIV PRESS INC Publisher Address: JOURNALS DEPT, 2001 EVANS RD, CARY, NC 27513 USA ISSN: 0146-8693 29-char Source Abbrev.: J PEDIAT PSYCHOL ISO Source Abbrev.: J. Pediatr. Psychol. Source Item Page Count: 14 Subject Category: Psychology, Developmental ISI Document Delivery No.: 306XT AMBUEL B ASSESSING DISTRESS IN PEDIATRIC INTENSIVE-CARE ENVIRONMENTS - THE COMFORT SCALE JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 95 1992 ANDERSON BJ ASSESSING FAMILY SHARING OF DIABETES RESPONSIBILITIES JOURNAL OF PEDIATRIC PSYCHOLOGY 15 : 477 1990 ASARNOW RF BEHAVIOR PROBLEMS AND ADAPTIVE FUNCTIONING IN CHILDREN WITH MILD AND SEVERE CLOSED HEAD-INJURY JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 543 1991 BALTAXE CAM J PEDIATR PSYCHOL 2 : 176 1977 BALTUSSEN A Citation classics in critical care medicine INTENSIVE CARE MEDICINE 30 : 902 DOI 10.1007/s00134-004-2195-7 2004 BARAKAT LP Families surviving childhood cancer: A comparison of posttraumatic stress symptoms with families of healthy children JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 843 1997 BENNETT DS DEPRESSION AMONG CHILDREN WITH CHRONIC MEDICAL PROBLEMS - A METAANALYSIS JOURNAL OF PEDIATRIC PSYCHOLOGY 19 : 149 1994 BLACK M PRENATAL DRUG EXPOSURE - NEURODEVELOPMENTAL OUTCOME AND PARENTING ENVIRONMENT JOURNAL OF PEDIATRIC PSYCHOLOGY 18 : 605 1993 BLOUIN AG J PEDIATR PSYCHOL 3 : 188 1978 BRAET C Psychological aspects of childhood obesity: A controlled study in a clinical and nonclinical sample JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 59 1997 BREEN MJ CHILD PSYCHOPATHOLOGY AND PARENTING STRESS IN GIRLS AND BOYS HAVING ATTENTION DEFICIT DISORDER WITH HYPERACTIVITY JOURNAL OF PEDIATRIC PSYCHOLOGY 13 : 265 1988 BROWN JM DEVELOPMENTAL-CHANGES IN CHILDRENS COGNITION TO STRESSFUL AND PAINFUL SITUATIONS JOURNAL OF PEDIATRIC PSYCHOLOGY 11 : 343 1986 BROWN KJ Future issues in pediatric psychology: Delphic survey JOURNAL OF CLINICAL PSYCHOLOGY IN MEDICAL SETTINGS 7 : 5 2000 CANTWELL DP J PEDIATR PSYCHOL 3 : 168 1978 COHEN LL Nurse coaching and cartoon distraction: An effective and practical intervention to reduce child, parent, and nurse distress during immunizations JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 355 1997 COUSENS P COGNITIVE EFFECTS OF CHILDHOOD LEUKEMIA THERAPY - A CASE FOR 4 SPECIFIC DEFICITS JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 475 1991 DAHL RE THE ROLE OF SLEEP DISTURBANCES IN ATTENTION-DEFICIT DISORDER SYMPTOMS - A CASE-STUDY JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 229 1991 DELAMATER AM PROGR NOTES 31 : 1 2007 DEMASO DR THE IMPACT OF MATERNAL PERCEPTIONS AND MEDICAL SEVERITY ON THE ADJUSTMENT OF CHILDREN WITH CONGENITAL HEART-DISEASE JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 137 1991 DROTAR D Relating parent and family functioning to the psychological adjustment of children with chronic health conditions: What have we learned? What do we need to know? JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 149 1997 DROTAR D Intervention research: Pushing back the frontiers of pediatric psychology JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 593 1997 DROTAR D PREDICTION OF INTELLECTUAL-DEVELOPMENT IN YOUNG-CHILDREN WITH EARLY HISTORIES OF NONORGANIC FAILURE-TO-THRIVE JOURNAL OF PEDIATRIC PSYCHOLOGY 13 : 281 1988 DROTAR D J PEDIATR PSYCHOL 6 : 211 1981 DUBIN D CITATION-CLASSICS IN CLINICAL DERMATOLOGICAL JOURNALS - CITATION ANALYSIS, BIOMEDICAL JOURNALS, AND LANDMARK ARTICLES, 1945-1990 ARCHIVES OF DERMATOLOGY 129 : 1121 1993 ELKINS PD J PEDIATR PSYCHOL 13 : 575 1988 ELLIOTT CH AN OBSERVATION SCALE FOR MEASURING CHILDRENS DISTRESS DURING MEDICAL PROCEDURES JOURNAL OF PEDIATRIC PSYCHOLOGY 12 : 543 1987 EPSTEIN LH J PEDIATR PSYCHOL 5 : 25 1980 EVERETT JE CITATION ANALYSIS MAPPING OF JOURNALS IN APPLIED AND CLINICAL-PSYCHOLOGY JOURNAL OF APPLIED SOCIAL PSYCHOLOGY 23 : 750 1993 EWINGCOBBS L INTELLECTUAL, MOTOR, AND LANGUAGE SEQUELAE FOLLOWING CLOSED HEAD-INJURY IN INFANTS AND PRESCHOOLERS JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 531 1989 FEAGANS L RELATIONSHIP OF MIDDLE-EAR DISEASE IN EARLY-CHILDHOOD TO LATER NARRATIVE AND ATTENTION SKILLS JOURNAL OF PEDIATRIC PSYCHOLOGY 12 : 581 1987 FINNEY JW PSYCHOLOGY IN PRIMARY HEALTH-CARE - EFFECTS OF BRIEF TARGETED THERAPY ON CHILDRENS MEDICAL-CARE UTILIZATION JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 447 1991 FIRESTONE P J PEDIATR PSYCHOL 7 : 209 1982 FLORES LY Trend analyses of major contributions in The Counseling Psychologist cited from 1986 to 1996: Impact and implications COUNSELING PSYCHOLOGIST 27 : 73 1999 FREIER MC Miniseries: Broadening the scope of practice and research in pediatric psychology JOURNAL OF PEDIATRIC PSYCHOLOGY 32 : 875 DOI 10.1093/jpepsy/jsm035 2007 FRIEDRICH WN BEHAVIOR PROBLEMS IN SEXUALLY ABUSED YOUNG-CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 11 : 47 1986 FULLARD W ASSESSING TEMPERAMENT IN ONE-YEAR-OLD TO 3-YEAR-OLD CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 9 : 205 1984 GARFIELD E 100 CITATION-CLASSICS FROM THE JOURNAL-OF-THE-AMERICAN-MEDICAL-ASSOCIATION JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 257 : 52 1987 GIL KM SICKLE-CELL DISEASE PAIN IN CHILDREN AND ADOLESCENTS - CHANGE IN PAIN FREQUENCY AND COPING STRATEGIES OVER TIME JOURNAL OF PEDIATRIC PSYCHOLOGY 18 : 621 1993 GIL KM SICKLE-CELL DISEASE IN CHILDREN AND ADOLESCENTS - THE RELATION OF CHILD AND PARENT PAIN COPING STRATEGIES TO ADJUSTMENT JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 643 1991 GOLDBERG S CHRONIC ILLNESS IN INFANCY AND PARENTING STRESS - A COMPARISON OF 3 GROUPS OF PARENTS JOURNAL OF PEDIATRIC PSYCHOLOGY 15 : 347 1990 HAMLETT KW CHILDHOOD CHRONIC ILLNESS AS A FAMILY STRESSOR JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 33 1992 HAUSER ST ADHERENCE AMONG CHILDREN AND ADOLESCENTS WITH INSULIN-DEPENDENT DIABETES- MELLITUS OVER A 4-YEAR LONGITUDINAL FOLLOW-UP .2. IMMEDIATE AND LONG-TERM LINKAGES WITH THE FAMILY MILIEU JOURNAL OF PEDIATRIC PSYCHOLOGY 15 : 527 1990 HEESACKER M CLASSICS AND EMERGING CLASSICS IN COUNSELING PSYCHOLOGY JOURNAL OF COUNSELING PSYCHOLOGY 29 : 400 1982 HOFFMAN DL THE INTELLECTUAL STRUCTURE OF CONSUMER RESEARCH - A BIBLIOMETRIC STUDY OF AUTHOR COCITATIONS IN THE 1ST 15 YEARS OF THE JOURNAL OF CONSUMER RESEARCH JOURNAL OF CONSUMER RESEARCH 19 : 505 1993 HOLMBECK GN Post-hoc probing of significant moderational and mediational effects in studies of pediatric populations JOURNAL OF PEDIATRIC PSYCHOLOGY 27 : 87 2002 HURTIG AL RELATION BETWEEN SEVERITY OF CHRONIC ILLNESS AND ADJUSTMENT IN CHILDREN AND ADOLESCENTS WITH SICKLE-CELL DISEASE JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 117 1989 HURTIG AL PSYCHOSOCIAL ADJUSTMENT IN CHILDREN AND ADOLESCENTS WITH SICKLE-CELL DISEASE JOURNAL OF PEDIATRIC PSYCHOLOGY 11 : 411 1986 JACOBSON AM ADHERENCE AMONG CHILDREN AND ADOLESCENTS WITH INSULIN-DEPENDENT DIABETES- MELLITUS OVER A 4-YEAR LONGITUDINAL FOLLOW-UP .1. THE INFLUENCE OF PATIENT COPING AND ADJUSTMENT JOURNAL OF PEDIATRIC PSYCHOLOGY 15 : 511 1990 JELALIAN E Empirically supported treatments in pediatric psychology: Pediatric obesity JOURNAL OF PEDIATRIC PSYCHOLOGY 24 : 223 1999 KASHANI JH PSYCHOPATHOLOGY AND SELF-CONCEPT IN ASTHMATIC-CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 13 : 509 1988 KAZAK A J PEDIATR PSYCHOL 27 : 653 2002 KAZAK AE Journal of pediatric psychology: A brief history (1969-1999) JOURNAL OF PEDIATRIC PSYCHOLOGY 25 : 463 2000 KAZAK AE FAMILIES OF YOUNG ADOLESCENTS WHO HAVE SURVIVED CANCER - SOCIAL-EMOTIONAL ADJUSTMENT, ADAPTABILITY, AND SOCIAL SUPPORT JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 175 1989 KOVACS M PSYCHOLOGICAL FUNCTIONING OF CHILDREN WITH INSULIN-DEPENDENT DIABETES- MELLITUS - A LONGITUDINAL-STUDY JOURNAL OF PEDIATRIC PSYCHOLOGY 15 : 619 1990 KUPST MJ FAMILY COPING WITH PEDIATRIC LEUKEMIA - 10 YEARS AFTER TREATMENT JOURNAL OF PEDIATRIC PSYCHOLOGY 20 : 601 1995 KUPST MJ LONG-TERM COPING WITH PEDIATRIC LEUKEMIA - A 6-YEAR FOLLOW-UP-STUDY JOURNAL OF PEDIATRIC PSYCHOLOGY 13 : 7 1988 KUPST MJ J PEDIATR PSYCHOL 7 : 157 1982 LAGRECA AM Reflections and perspectives on pediatric psychology: Editor's vale dictum JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 759 1997 LAGRECA AM Reflections and perspectives on pediatric psychology: Editor's vale dictum JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 759 1997 LAGRECA AM I GET BY WITH A LITTLE HELP FROM MY FAMILY AND FRIENDS - ADOLESCENTS SUPPORT FOR DIABETES CARE JOURNAL OF PEDIATRIC PSYCHOLOGY 20 : 449 1995 LAGRECA AM SOCIAL-CONSEQUENCES OF PEDIATRIC CONDITIONS - FERTILE AREA FOR FUTURE INVESTIGATION AND INTERVENTION JOURNAL OF PEDIATRIC PSYCHOLOGY 15 : 285 1990 LANDRY SH DIFFERENTIAL OUTCOMES ASSOCIATED WITH EARLY MEDICAL COMPLICATIONS IN PREMATURE-INFANTS JOURNAL OF PEDIATRIC PSYCHOLOGY 9 : 385 1984 LANGLEY J J PEDIATR PSYCHOL 8 : 181 1983 LAVIGNE JV PSYCHOLOGICAL ADJUSTMENT TO PEDIATRIC PHYSICAL DISORDERS - A META-ANALYTIC REVIEW JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 133 1992 LEUNES A CONTRIBUTIONS TO HISTORY OF PSYCHOLOGY .29. REVIEW OF SELECTED ASPECTS OF TEXTS IN CHILD PSYCHOLOGY PSYCHOLOGICAL REPORTS 35 : 1291 1974 LEUNES AD CLASSICS IN ABNORMAL-PSYCHOLOGY - STUDENT EVALUATION TEACHING OF PSYCHOLOGY 5 : 99 1978 LEVIN HS J PEDIATR PSYCHOL 4 : 389 1979 LEVYSHIFF R BIOLOGICAL AND ENVIRONMENTAL CORRELATES OF DEVELOPMENTAL OUTCOME OF PREMATURELY BORN INFANTS IN EARLY ADOLESCENCE JOURNAL OF PEDIATRIC PSYCHOLOGY 19 : 63 1994 LOBOVITS DA CHILDHOOD DEPRESSION - PREVALENCE USING DSM-III CRITERIA AND VALIDITY OF PARENT AND CHILD DEPRESSION SCALES JOURNAL OF PEDIATRIC PSYCHOLOGY 10 : 45 1985 LOYD BH REVISION OF THE PARENTING STRESS INDEX JOURNAL OF PEDIATRIC PSYCHOLOGY 10 : 169 1985 MACLEAN WE PSYCHOLOGICAL ADJUSTMENT OF CHILDREN WITH ASTHMA - EFFECTS OF ILLNESS SEVERITY AND RECENT STRESSFUL LIFE EVENTS JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 159 1992 MANNE SL Posttraumatic stress disorder among mothers of pediatric cancer survivors: Diagnosis, comorbidity, and utility of the PTSD checklist as a screening instrument JOURNAL OF PEDIATRIC PSYCHOLOGY 23 : 357 1998 MCKINNEY B PREDICTORS OF STRESS IN PARENTS OF DEVELOPMENTALLY DISABLED-CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 12 : 133 1987 MILICH R J PEDIATR PSYCHOL 4 : 93 1979 MILLER AC STRESS, APPRAISAL, AND COPING IN MOTHERS OF DISABLED AND NONDISABLED CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 587 1992 MONEY J J PEDIATR PSYCHOL 4 : 29 1979 MORGAN SA PSYCHOLOGICAL AND SOCIAL CONCOMITANTS OF SICKLE-CELL-ANEMIA IN ADOLESCENTS JOURNAL OF PEDIATRIC PSYCHOLOGY 11 : 429 1986 MULHERN RK MATERNAL DEPRESSION, ASSESSMENT METHODS, AND PHYSICAL SYMPTOMS AFFECT ESTIMATES OF DEPRESSIVE SYMPTOMATOLOGY AMONG CHILDREN WITH CANCER JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 313 1992 NOLL RB PEER RELATIONSHIPS AND ADJUSTMENT IN CHILDREN WITH CANCER JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 307 1991 OSBORNE RB THE ROLE OF SOCIAL MODELING IN UNEXPLAINED PEDIATRIC PAIN JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 43 1989 PALADUGU R One hundred citation classics in general surgical journals WORLD JOURNAL OF SURGERY 26 : 1099 DOI 10.1007/s00268-002-6376-7 2002 PERRIN EC CAUTIONS IN USING THE CHILD-BEHAVIOR CHECKLIST - OBSERVATIONS BASED ON RESEARCH ABOUT CHILDREN WITH A CHRONIC ILLNESS JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 411 1991 PICKNETT T J MOL BIOL 293 : 171 1999 POWERS SW Empirically supported treatments in pediatric psychology: Procedure- related pain JOURNAL OF PEDIATRIC PSYCHOLOGY 24 : 131 1999 POWERS SW HELPING PRESCHOOL LEUKEMIA PATIENTS AND PARENTS COPE DURING INJECTIONS JOURNAL OF PEDIATRIC PSYCHOLOGY 18 : 681 1993 QUITTNER AL PARENTAL RESPONSE TO CYSTIC-FIBROSIS - A CONTEXTUAL ANALYSIS OF THE DIAGNOSIS PHASE JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 683 1992 RANDO T J PEDIATR PSYCHOL 8 : 3 1983 ROBERTS MC HDB CLIN HLTH PSYCHO : 191 1982 ROBERTS MC HDB PEDIAT PSYCHOL : 3 2003 ROBERTS MC A necessary reemphasis on integrating explicative research with the pragmatics of pediatric psychology JOURNAL OF PEDIATRIC PSYCHOLOGY 21 : 107 1996 ROBERTS MC VALE DICTUM - AN EDITORS VIEW OF THE FIELD OF PEDIATRIC PSYCHOLOGY AND ITS JOURNAL JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 785 1992 ROBERTS MC READINGS PEDIAT PSYC : 1 1993 ROURKE BP J PEDIATR PSYCHOL 3 : 62 1978 ROUTH DK J PEDIATR PSYCHOL 5 : 287 1980 ROUTH DK J PEDIATR PSYCHOL 4 : 13 1979 ROVET JF NEURODEVELOPMENT IN INFANTS AND PRESCHOOL-CHILDREN WITH CONGENITAL HYPOTHYROIDISM - ETIOLOGIC AND TREATMENT FACTORS AFFECTING OUTCOME JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 187 1992 SATIN W DIABETES IN ADOLESCENCE - EFFECTS OF MULTIFAMILY GROUP INTERVENTION AND PARENT SIMULATION OF DIABETES JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 259 1989 SHAFFER J COGNITIVE AND ACHIEVEMENT STATUS OF CHILDREN WITH MYELOMENINGOCELE JOURNAL OF PEDIATRIC PSYCHOLOGY 10 : 325 1985 SHAW EG J PEDIATR PSYCHOL 7 : 33 1982 SIEGEL LS J PEDIATR PSYCHOL 7 : 135 1982 SNYDER CR The development and validation of the Children's Hope Scale JOURNAL OF PEDIATRIC PSYCHOLOGY 22 : 399 1997 SPEECHLEY KN SURVIVING CHILDHOOD-CANCER, SOCIAL SUPPORT, AND PARENTS PSYCHOLOGICAL ADJUSTMENT JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 15 1992 SPIETH LE Assessment of health-related quality of life in children and adolescents: An integrative review JOURNAL OF PEDIATRIC PSYCHOLOGY 21 : 175 1996 SPINETTA JJ J PEDIATR PSYCHOL 6 : 251 1981 SPIRITO A DEVELOPMENT OF A BRIEF COPING CHECKLIST FOR USE WITH PEDIATRIC POPULATIONS JOURNAL OF PEDIATRIC PSYCHOLOGY 13 : 555 1988 STEELE MM Examining the influence of the Journal of Pediatric Psychology: An empirical approach JOURNAL OF PEDIATRIC PSYCHOLOGY 32 : 150 DOI 10.1093/jpepsy/jsj111 2007 STRAUSS CC PERSONAL AND INTERPERSONAL CHARACTERISTICS ASSOCIATED WITH CHILDHOOD OBESITY JOURNAL OF PEDIATRIC PSYCHOLOGY 10 : 337 1985 TAYLOR HG POSTIRRADIATION TREATMENT OUTCOMES FOR CHILDREN WITH ACUTE LYMPHOCYTIC- LEUKEMIA - CLARIFICATION OF RISKS JOURNAL OF PEDIATRIC PSYCHOLOGY 12 : 395 1987 TERAJIMA K Citation classics in anaesthesia and pain journals: a literature review in the era of the internet ACTA ANAESTHESIOLOGICA SCANDINAVICA 47 : 655 2003 THOMPSON KL COMPREHENSIVE ASSESSMENT OF PAIN IN JUVENILE RHEUMATOID-ARTHRITIS - AN EMPIRICAL-MODEL JOURNAL OF PEDIATRIC PSYCHOLOGY 12 : 241 1987 THOMPSON RJ STABILITY AND CHANGE IN THE PSYCHOLOGICAL ADJUSTMENT OF MOTHERS OF CHILDREN AND ADOLESCENTS WITH CYSTIC-FIBROSIS AND SICKLE-CELL DISEASE JOURNAL OF PEDIATRIC PSYCHOLOGY 19 : 171 1994 THOMPSON RJ PSYCHOLOGICAL ADJUSTMENT OF MOTHERS OF CHILDREN AND ADOLESCENTS WITH SICKLE-CELL DISEASE - THE ROLE OF STRESS, COPING METHODS, AND FAMILY FUNCTIONING JOURNAL OF PEDIATRIC PSYCHOLOGY 18 : 549 1993 THOMPSON RJ STRESS, COPING, AND FAMILY FUNCTIONING IN THE PSYCHOLOGICAL ADJUSTMENT OF MOTHERS OF CHILDREN AND ADOLESCENTS WITH CYSTIC-FIBROSIS JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 573 1992 THOMPSON RJ PSYCHOLOGICAL ADJUSTMENT OF CHILDREN WITH CYSTIC-FIBROSIS - THE ROLE OF CHILD COGNITIVE-PROCESSES AND MATERNAL ADJUSTMENT JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 741 1992 TIMKO C FUNCTIONING AMONG MOTHERS AND FATHERS OF CHILDREN WITH JUVENILE RHEUMATIC DISEASE - A LONGITUDINAL-STUDY JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 705 1992 TRITES RL J PEDIATR PSYCHOL 4 : 179 1979 VANDONGENMELMAN JE LATE PSYCHOSOCIAL CONSEQUENCES FOR PARENTS OF CHILDREN WHO SURVIVED CANCER JOURNAL OF PEDIATRIC PSYCHOLOGY 20 : 567 1995 VARNI JW THE IMPACT OF SOCIAL SKILLS TRAINING ON THE ADJUSTMENT OF CHILDREN WITH NEWLY-DIAGNOSED CANCER JOURNAL OF PEDIATRIC PSYCHOLOGY 18 : 751 1993 VASTA R STUDYING CHILDREN IN : 1979 WALKER LS LONG-TERM HEALTH OUTCOMES IN PATIENTS WITH RECURRENT ABDOMINAL-PAIN JOURNAL OF PEDIATRIC PSYCHOLOGY 20 : 233 1995 WALKER LS PARENTAL RESPONSE TO CHILD ILLNESS BEHAVIOR JOURNAL OF PEDIATRIC PSYCHOLOGY 17 : 49 1992 WALKER LS THE FUNCTIONAL DISABILITY INVENTORY - MEASURING A NEGLECTED DIMENSION OF CHILD HEALTH-STATUS JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 39 1991 WALKER LS CHILDREN WITH RECURRENT ABDOMINAL-PAIN AND THEIR PARENTS - MORE SOMATIC COMPLAINTS, ANXIETY, AND DEPRESSION THAN OTHER PATIENT FAMILIES JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 231 1989 WALKER LS THE ROLE OF MATERNAL EMPLOYMENT AND DEPRESSION IN THE PSYCHOLOGICAL ADJUSTMENT OF CHRONICALLY ILL, MENTALLY-RETARDED, AND WELL CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 357 1989 WALLANDER JL DISABILITY PARAMETERS, CHRONIC STRAIN, AND ADAPTATION OF PHYSICALLY- HANDICAPPED CHILDREN AND THEIR MOTHERS JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 23 1989 WALLANDER JL FAMILY RESOURCES AS RESISTANCE FACTORS FOR PSYCHOLOGICAL MALADJUSTMENT IN CHRONICALLY ILL AND HANDICAPPED-CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 157 1989 WALLANDER JL THE SOCIAL-ENVIRONMENT AND THE ADAPTATION OF MOTHERS OF PHYSICALLY- HANDICAPPED CHILDREN JOURNAL OF PEDIATRIC PSYCHOLOGY 14 : 371 1989 WALLANDER JL CHILDREN WITH CHRONIC PHYSICAL DISORDERS - MATERNAL REPORTS OF THEIR PSYCHOLOGICAL ADJUSTMENT JOURNAL OF PEDIATRIC PSYCHOLOGY 13 : 197 1988 WALSH ME CHILDRENS CONCEPTIONS OF AIDS - A DEVELOPMENTAL ANALYSIS JOURNAL OF PEDIATRIC PSYCHOLOGY 16 : 273 1991 WENTZ R CLASSIC PAPERS CRITI : 539 2003 WHALEN CK J PEDIATR PSYCHOL 3 : 177 1978 WHITE MJ CITATION ANALYSIS OF PSYCHOLOGY JOURNALS AMERICAN PSYCHOLOGIST 32 : 301 1977 WILLS KE INTELLIGENCE AND ACHIEVEMENT IN CHILDREN WITH MYELOMENINGOCELE JOURNAL OF PEDIATRIC PSYCHOLOGY 15 : 161 1990 WORCHEL FF ASSESSMENT OF DEPRESSION IN CHILDREN WITH CANCER JOURNAL OF PEDIATRIC PSYCHOLOGY 13 : 101 1988 WYSOCKI T Randomized, controlled trial of behavior therapy for families of adolescents with insulin-dependent diabetes mellitus JOURNAL OF PEDIATRIC PSYCHOLOGY 25 : 23 2000 WYSOCKI T ASSOCIATIONS AMONG TEEN PARENT RELATIONSHIPS, METABOLIC CONTROL, AND ADJUSTMENT TO DIABETES IN ADOLESCENTS JOURNAL OF PEDIATRIC PSYCHOLOGY 18 : 441 1993 From garfield at CODEX.CIS.UPENN.EDU Mon Jun 23 14:39:51 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 23 Jun 2008 14:39:51 -0400 Subject: Theeramunkong, T; Sriphaew, K; Okumura, M Applying latent semantic indexing in frequent itemset mining for document relation discovery ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS 731-738, 2008 Message-ID: Author(s): Theeramunkong, T (Theeramunkong, Thanaruk); Sriphaew, K (Sriphaew, Kritsada); Okumura, M (Okumura, Manabu) Title: Applying latent semantic indexing in frequent itemset mining for document relation discovery Editor(s): Washio, T; Suzuki, E; Ting, KM; Inokuchi, A Source: ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS 731- 738, 2008 Email Address: thanaruk at siit.tu.ac.th Book Series: LECTURE NOTES IN ARTIFICIAL INTELLIGENCE, 5012 Language: English Document Type: Article Conference Title: 12th Pacific-Asia Conference on Knowledge Discovery and Data Mining Conference Date: MAY 20-23, 2008 Conference Location: Osaka, JAPAN Conference Sponsors: Japanese Soc Artificial Intelligence, Osaka Convent & Tourism Bur, Commemorat Org Japan World Exposit 70, Kayamori Fdn Informat Sci, Air Force Off Sci Res, Asian Off Aerosp Res & Dev, Future Syst Corp, Salford Syst, Math Syst Abstract: Word-based relations among technical documents are immensely useful information but often hidden in a large amount of scientific publications. This work presents a method to apply latent semantic indexing in frequent itemset mining to discover potential relations among scientific publications. In this work, two weighting schemes, tf and tfidf are investigated with the exploitation of latent semantic indexing. The proposed method is evaluated using a set of technical documents in a publication database by comparing the extracted document relations with their references (citations). To this end, the paper uses order accumulative citation matrices to evaluate the validity (quality) of discovered patterns. The results also show that the proposed method successfully discovers a set of document relations, comparing to the original method that uses no latent semantic indexing. Addresses: Thammasat Univ, Sirindhorn Int Inst Technol, Muang, Pathumthani 12000 Thailand. Reprint Address: Theeramunkong, T, Thammasat Univ, Sirindhorn Int Inst Technol, 131 Moo 5 Tiwanont Rd, Muang, Pathumthani 12000 Thailand. Cited Reference Count: 12 Publisher Name: SPRINGER-VERLAG BERLIN Publisher Address: HEIDELBERGER PLATZ 3, D-14197 BERLIN, GERMANY ISSN: 0302-9743 ISBN: 978-3-540-68124-3 29-char Source Abbrev.: LECT NOTE ARTIF INTELL Source Item Page Count: 8 ISI Document Delivery No.: BHT20 AN Y KNOWL INF SYST 6 : 664 2004 CHEN CM Title Not Available INFORM PROCESS MANAG 35 : 401 1999 DEERWESTER S Title Not Available J AM SOC INFORM SCI 41 : 391 1990 GARFIELD E Title Not Available SCIENCE 178 : 471 1972 HAN J 2000 ACM SIGMOD INT 2000 1 KESSLER MM Title Not Available AM DOC 14 : 10 1963 MCCALLUM AK BOW TOOLKIT STAT LAN : 1996 SMALL H J AM SOC INFORM SCI 42 : 676 1973 SRIPHAEW K ARTIF INTELL : 112 2005 SRIPHAEW K IEICE T INF SYST 90 : 1131 2007 THEERAMUNKONG T INT J INTELL SYST : 149 2004 YUN U P 2006 SIAM C DAT MI : 623 2006 From garfield at CODEX.CIS.UPENN.EDU Mon Jun 23 16:22:41 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 23 Jun 2008 16:22:41 -0400 Subject: Guedon, JC (Guedon, Jean-Claude) Mixing and matching the Green and Gold Roads to Open Access - Take 2 SERIALS REVIEW, 34 (1): 41-51 MAR 2008 Message-ID: E-mail Address: jean.claude.guedon at umontreal.ca Author(s): Guedon, JC (Guedon, Jean-Claude) Title: Mixing and matching the Green and Gold Roads to Open Access - Take 2 Source: SERIALS REVIEW, 34 (1): 41-51 MAR 2008 Language: English Document Type: Article Keywords Plus: SCIENCE; COUNTRIES Abstract: Three years ago, the Gold and Green Roads to Open Access were viewed as complementary strategies, with repositories having the potential of gradually behaving more like journals, and vice versa. Since then, repositories and journals have been progressing on parallel tracks. Re- examining the situation, the reasoning suggested in 2004 appears still valid. Simultaneously, a knowledge economy has made of science a strategic resource. The developing world is essentially invited to contribute to world science with little or no regard to the development of an autonomous scientific capacity. Open Access, in this context, takes a new meaning with one objective to help development of local and autonomous scientific capacity. However, to do so, mixing and matching repositories with journals is needed. Brazil exemplifies this type of development and shows how the Green and Gold roads can mix and match. Addresses: Univ Montreal, Dept Litterature Comparee, Montreal, PQ H3C 3J7, Canada Reprint Address: Guedon, JC, Univ Montreal, Dept Litterature Comparee, Montreal, PQ H3C 3J7, Canada. E-mail Address: jean.claude.guedon at umontreal.ca Cited Reference Count: 27 Times Cited: 0 Publisher: ELSEVIER INC Publisher Address: 525 B STREET, STE 1900, SAN DIEGO, CA 92101-4495 USA ISSN: 0098-7913 29-char Source Abbrev.: SER REV ISO Source Abbrev.: Ser. Rev. Source Item Page Count: 11 Subject Category: Information Science & Library Science ISI Document Delivery No.: 306LN SCI AM AUG : 1995 SCI AM OCT : 10 1995 SERIALS REV 30 : 2004 UNCERTAIN QUEST SCI : 1994 ARUNACHALAM S SCIENTOMETRICS 15 : 394 1989 BHANDARI M Factors associated with citation rates in the orthopedic literature CANADIAN JOURNAL OF SURGERY 50 : 119 2007 BONITZ M Ten years Matthew effect for countries SCIENTOMETRICS 64 : 375 DOI 10.1007/s11192-005-0256-5 2005 BOURDIEU P SPECIFICITY OF SCIENTIFIC FIELD AND SOCIAL CONDITIONS OF RATIONAL PROGRESS SOCIOLOGIE ET SOCIETES 7 : 91 1975 BRAUN T QUANTITATIVE SCI TEC : 95 2004 BRAUN T The counting of core journal gatekeepers as science indicators really counts. The scientific scope of action and strength of nations SCIENTOMETRICS 62 : 297 2005 CALLAHAM M JAMA-J AM MED ASSOC 287 : 2849 2002 DESOLLAPRICE DJ LITTLE SCI BIG SCI : 1963 FRAME D SCI TECHNOLOGY INDIC : 117 1985 GARFIELD E CITATION INDEXING : 20 1979 GARFIELD E SCI PUBL POL 10 : 112 1983 GUEDON JC OLDENBURGS LONG SHAD : IOANNIDIS JPA PLOS ONE : 2006 LEYDESDORFF L Mapping the Chinese Science Citation Database in terms of aggregated journal-journal citation relations JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 56 : 1469 DOI 10.1002/asi.20209 2005 MABE M SERIALS 16 : 191 2003 MEADOWS J COMMUNICATING RES : 15 1998 MERTON RK SOCIAL STRUCTURE SCI : 1996 PACKER AL Learning to communicate science in developing countries INTERCIENCIA 32 : 643 2007 PACKER AL SCIELO MODEL ELECT P : SHAPIN S SOCIAL HIST TRUTH CI : 1995 SORLIN S KNOWLEDGE SOC KNOWLE : 2 2007 SPAGNOLO F BRAZILIAN SCIENTISTS PUBLICATIONS AND MAINSTREAM SCIENCE - SOME POLICY IMPLICATIONS - THE CASE OF CHEMICAL AND ELECTRICAL-ENGINEERING SCIENTOMETRICS 18 : 205 1990 WILLINSKY J ACCESS PRINCIPLE CAS : 2005 From jean.claude.guedon at UMONTREAL.CA Mon Jun 23 17:58:33 2008 From: jean.claude.guedon at UMONTREAL.CA (Jean-Claude =?ISO-8859-1?Q?Gu=E9don?=) Date: Mon, 23 Jun 2008 17:58:33 -0400 Subject: Guedon, JC (Guedon, Jean-Claude) Mixing and matching the Green and Gold Roads to Open Access - Take 2 SERIALS REVIEW, 34 (1): 41-51 MAR 2008 In-Reply-To: Message-ID: Thank you, Eugene and thank you for the note about impact factors. Best regards, Jean-Claude Le lundi 23 juin 2008 ? 16:22 -0400, Eugene Garfield a ?crit : > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > E-mail Address: jean.claude.guedon at umontreal.ca > > Author(s): Guedon, JC (Guedon, Jean-Claude) > > Title: Mixing and matching the Green and Gold Roads to Open Access - Take > 2 > > Source: SERIALS REVIEW, 34 (1): 41-51 MAR 2008 > > Language: English > > Document Type: Article > > Keywords Plus: SCIENCE; COUNTRIES > > Abstract: Three years ago, the Gold and Green Roads to Open Access were > viewed as complementary strategies, with repositories having the potential > of gradually behaving more like journals, and vice versa. Since then, > repositories and journals have been progressing on parallel tracks. Re- > examining the situation, the reasoning suggested in 2004 appears still > valid. Simultaneously, a knowledge economy has made of science a strategic > resource. The developing world is essentially invited to contribute to > world science with little or no regard to the development of an autonomous > scientific capacity. Open Access, in this context, takes a new meaning > with one objective to help development of local and autonomous scientific > capacity. However, to do so, mixing and matching repositories with > journals is needed. Brazil exemplifies this type of development and shows > how the Green and Gold roads can mix and match. > > Addresses: Univ Montreal, Dept Litterature Comparee, Montreal, PQ H3C 3J7, > Canada > > Reprint Address: Guedon, JC, Univ Montreal, Dept Litterature Comparee, > Montreal, PQ H3C 3J7, Canada. > > E-mail Address: jean.claude.guedon at umontreal.ca > > Cited Reference Count: 27 > > Times Cited: 0 > > Publisher: ELSEVIER INC > > Publisher Address: 525 B STREET, STE 1900, SAN DIEGO, CA 92101-4495 USA > > ISSN: 0098-7913 > > 29-char Source Abbrev.: SER REV > > ISO Source Abbrev.: Ser. Rev. > > Source Item Page Count: 11 > > Subject Category: Information Science & Library Science > > ISI Document Delivery No.: 306LN > > SCI AM AUG : 1995 > > SCI AM OCT : 10 1995 > > SERIALS REV 30 : 2004 > > UNCERTAIN QUEST SCI : 1994 > > ARUNACHALAM S > SCIENTOMETRICS 15 : 394 1989 > > BHANDARI M > Factors associated with citation rates in the orthopedic literature > CANADIAN JOURNAL OF SURGERY 50 : 119 2007 > > BONITZ M > Ten years Matthew effect for countries > SCIENTOMETRICS 64 : 375 DOI 10.1007/s11192-005-0256-5 2005 > > BOURDIEU P > SPECIFICITY OF SCIENTIFIC FIELD AND SOCIAL CONDITIONS OF RATIONAL PROGRESS > SOCIOLOGIE ET SOCIETES 7 : 91 1975 > > BRAUN T > QUANTITATIVE SCI TEC : 95 2004 > > BRAUN T > The counting of core journal gatekeepers as science indicators really > counts. The scientific scope of action and strength of nations > SCIENTOMETRICS 62 : 297 2005 > > CALLAHAM M > JAMA-J AM MED ASSOC 287 : 2849 2002 > > DESOLLAPRICE DJ > LITTLE SCI BIG SCI : 1963 > > FRAME D > SCI TECHNOLOGY INDIC : 117 1985 > > GARFIELD E > CITATION INDEXING : 20 1979 > > GARFIELD E > SCI PUBL POL 10 : 112 1983 > > GUEDON JC > OLDENBURGS LONG SHAD : > > IOANNIDIS JPA > PLOS ONE : 2006 > > LEYDESDORFF L > Mapping the Chinese Science Citation Database in terms of aggregated > journal-journal citation relations > JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY > 56 : 1469 DOI 10.1002/asi.20209 2005 > > MABE M > SERIALS 16 : 191 2003 > > MEADOWS J > COMMUNICATING RES : 15 1998 > > MERTON RK > SOCIAL STRUCTURE SCI : 1996 > > PACKER AL > Learning to communicate science in developing countries > INTERCIENCIA 32 : 643 2007 > > PACKER AL > SCIELO MODEL ELECT P : > > SHAPIN S > SOCIAL HIST TRUTH CI : 1995 > > SORLIN S > KNOWLEDGE SOC KNOWLE : 2 2007 > > SPAGNOLO F > BRAZILIAN SCIENTISTS PUBLICATIONS AND MAINSTREAM SCIENCE - SOME POLICY > IMPLICATIONS - THE CASE OF CHEMICAL AND ELECTRICAL-ENGINEERING > SCIENTOMETRICS 18 : 205 1990 > > WILLINSKY J > ACCESS PRINCIPLE CAS : 2005 Jean-Claude Gu?don Universit? de Montr?al -------------- next part -------------- An HTML attachment was scrubbed... URL: From garfield at CODEX.CIS.UPENN.EDU Tue Jun 24 11:48:58 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 24 Jun 2008 11:48:58 -0400 Subject: Gehanno, JF; Takahashi, K; Darmoni, S; Weber, J Citation classics in occupational medicine journals SCANDINAVIAN JOURNAL OF WORK ENVIRONMENT & HEALTH, 33 (4): 245-251 AUG 2007 Message-ID: E-mail Address: jean-francois.gehanno at chu-rouen.fr Author(s): Gehanno, JF (Gehanno, Jean-Francois); Takahashi, K (Takahashi, Ken); Darmoni, S (Darmoni, Stephan); Weber, J (Weber, Jacques) Title: Citation classics in occupational medicine journals Source: SCANDINAVIAN JOURNAL OF WORK ENVIRONMENT & HEALTH, 33 (4): 245-251 AUG 2007 Language: English Document Type: Article Author Keywords: bibliometrics; numerical data; occupational health; periodical; statistics Keywords Plus: MOST-CITED ARTICLES; ARCHIVES; HEALTH Abstract: Objectives The number of citations an article receives after its publication not only reflects its impact on the scientific community, but also the impact of the institutions or countries in the field studied. In 1987, Garfield introduced the concept of "citation classics" for the best- cited articles. An analysis of top-cited articles coming from journals in the field of occupational medicine (eg, Occupational and Environmental Medicine, Scandinavian Journal of Work, Environment & Health) has not yet been reported. The purpose of this study was to assess whether or not such citation classics exist in this field and to analyze their characteristics. Methods The most frequently cited articles published in the five major journals in occupational medicine were identified using the database of Science Citation Index Expanded. The data were obtained by searching one year and one journal at a time. All of the articles cited more than 100 times were collected and analyzed. Results Among the 15 553 articles published by the five journals since 1949, only 85 articles had been cited more than 100 times. The oldest had been published in 1950 and the latest in 1997. The United Kingdom contributed 28% of the citation classics and the United States or Sweden produced 19%. The most cited article had been cited 979 times. The main topics of articles were metabolism, occupational neoplasms, and work- related musculoskeletal disorders. Conclusions Since the 1980s, Scandinavia and the United States have taken the leadership in the publication of citation classic papers. Nevertheless, according to the level of citations, the influence of literature published in occupational medicine journals remains limited. Addresses: Rouen Univ Hosp, Inst Occupat Med, Rouen, France; Univ Occupat & Environm Hlth, Kitakyushu, Fukuoka 807, Japan; Rouen Univ Hosp, Comp & Networks Dept, Rouen, France; Rouen Univ Hosp, Pedagog Board, Rouen, France Reprint Address: Gehanno, JF, Rouen Univ Hosp, Inst Occupat Med, Rouen, France. E-mail Address: jean-francois.gehanno at chu-rouen.fr Cited Reference Count: 19 Times Cited: 5 Publisher: SCAND J WORK ENV HEALTH Publisher Address: TOPELIUKSENKATU 41A, SF-00250 HELSINKI, FINLAND ISSN: 0355-3140 29-char Source Abbrev.: SCAND J WORK ENVIRON HEALTH ISO Source Abbrev.: Scand. J. Work Environ. Health Source Item Page Count: 7 Subject Category: Public, Environmental & Occupational Health ISI Document Delivery No.: 208HD ALBERT DM ANALYSIS OF THE ARCHIVES MOST FREQUENTLY CITED ARTICLES ARCHIVES OF OPHTHALMOLOGY 106 : 465 1988 ARONSON JK Citation classics in the British Journal of Clinical Pharmacology, 1974- 2003 BRITISH JOURNAL OF CLINICAL PHARMACOLOGY 58 : S699 2004 BALTUSSEN A Citation classics in critical care medicine INTENSIVE CARE MEDICINE 30 : 902 DOI 10.1007/s00134-004-2195-7 2004 DARMONI SJ BMC MED INFORM DECIS 6 : 7 2006 DUBIN D CITATION-CLASSICS IN CLINICAL DERMATOLOGICAL JOURNALS - CITATION ANALYSIS, BIOMEDICAL JOURNALS, AND LANDMARK ARTICLES, 1945-1990 ARCHIVES OF DERMATOLOGY 129 : 1121 1993 FENTON JE A century of citation classics in otolaryngology-head and neck surgery journals JOURNAL OF LARYNGOLOGY AND OTOLOGY 116 : 494 2002 GARFIELD E 100 CITATION-CLASSICS FROM THE JOURNAL-OF-THE-AMERICAN-MEDICAL-ASSOCIATION JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 257 : 52 1987 GEHANNO JF How to select publications on occupational health: the usefulness of Medline and the impact factor OCCUPATIONAL AND ENVIRONMENTAL MEDICINE 57 : 706 2000 HALL GM BJA citation classics 1945-1992 BRITISH JOURNAL OF ANAESTHESIA 80 : 4 1998 KEY JD CITATION CLASSICS - MOST-CITED ARTICLES FROM ARCHIVES OF PM-AND-R ARCHIVES OF PHYSICAL MEDICINE AND REHABILITATION 69 : 1058 1988 KEY JD CITATION-CLASSICS - MOST-CITED ARTICLES FROM FERTILITY-AND-STERILITY FERTILITY AND STERILITY 47 : 910 1987 MCCUNNEY RJ THE INFLUENCE OF OCCUPATIONAL-MEDICINE ON GENERAL MEDICINE - A LOOK AT THE JOURNALS JOURNAL OF OCCUPATIONAL AND ENVIRONMENTAL MEDICINE 34 : 279 1992 OLLERTON JE Citation classics in trauma JOURNAL OF TRAUMA-INJURY INFECTION AND CRITICAL CARE 58 : 364 DOI 10.1097/01.TA.0000141882.31281.66 2005 PALADUGU R One hundred citation classics in general surgical journals WORLD JOURNAL OF SURGERY 26 : 1099 DOI 10.1007/s00268-002-6376-7 2002 PICKNETT T J MOL BIOL 293 : 171 1999 RUOTSALAINEN JH Evidence on the effectiveness of occupational health interventions AMERICAN JOURNAL OF INDUSTRIAL MEDICINE 49 : 865 DOI 10.1002/aijm.20371 2006 SABIN AB LIVE, ORALLY GIVEN POLIOVIRUS VACCINE - EFFECTS OF RAPID MASS IMMUNIZATION ON POPULATION UNDER CONDITIONS OF MASSIVE ENTERIC INFECTION WITH OTHER VIRUSES JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 173 : 1521 1960 TERAJIMA K Citation classics in anaesthesia and pain journals: a literature review in the era of the internet ACTA ANAESTHESIOLOGICA SCANDINAVICA 47 : 655 2003 THOMAS K Classic papers in urology EUROPEAN UROLOGY 43 : 591 DOI 10.1016/S0302-2838(03)00143-X 2003 From garfield at CODEX.CIS.UPENN.EDU Tue Jun 24 16:52:01 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 24 Jun 2008 16:52:01 -0400 Subject: Loonen, MPJ; Hage, JJ; Kon, M Publications of plastic surgery research 1972 through 2004: a longitudinal trend analysis of three international journals JOURNAL OF PLASTIC RECONSTRUCTIVE AND AESTHETIC SURGERY, 60 (8): 934-945 2007 Message-ID: E-mail Address: j.jorishage at inter.nl.net Author(s): Loonen, MPJ (Loonen, Martijn P. J.); Hage, JJ (Hage, J. Joris); Kon, M (Kon, Moshe) Title: Publications of plastic surgery research 1972 through 2004: a longitudinal trend analysis of three international journals Source: JOURNAL OF PLASTIC RECONSTRUCTIVE AND AESTHETIC SURGERY, 60 (8): 934-945 2007 Language: English Document Type: Article Author Keywords: research; publications; trend analysis; bibliometry Keywords Plus: RECONSTRUCTIVE-SURGERY; ARTICLES; IMPACT; CARE; ONCOLOGY; NORTH; UK; US Abstract: Background and purpose of study: Assessment and benchmarking of research output is becoming a necessity in the quest for research funds and grants. However, reports on the trends in international research output by plastic surgeons over the years are lacking. We longitudinally analysed plastic surgery publications over the last three decades. Materials and methods: Data on the topic of surgical interest and the anatomical region of research, the country of origin, and the origin and number of collaborating clinics were noted for each original article published in Plastic and Reconstructive Surgery, the British Journal of Plastic Surgery, and the European Journal of Plastic Surgery in 1972, 1980, 1988, 1996, and 2004. Main findings and Conclusions: The number of articles in three international plastic surgery journals has more than doubled over the last three decades. Reconstruction of acquired defects remained the most important topic in all three journals, but an interest in rejuvenation or aesthetic surgery seems to replace that in basic research. The head and neck area remains the anatomical region of most interest to date, but this interest has decreased substantially. Most articles still originate from the USA, but the absolute and relative number of articles originating from Europe and Asia is rapidly increasing. Also, the published output of multi- national scientific collaboration is increasing. Even though authors from larger countries, in general, contribute more publications in absolute numbers, authors from small countries have a more efficient output relative to the number of inhabitants and GDP of their country. (c) 2006 British Association of Plastic, Reconstructive and Aesthetic Surgeons. Published by Elsevier Ltd. All rights reserved. Addresses: Antoni van Leeuwenhoek Hosp, Netherlands Canc Inst, Dept Plast & Reconstruct Surg, NL-1066 CX Amsterdam, Netherlands; Univ Utrecht, Med Ctr, Dept Plast & Reconstruct Surg, NL-3584 CX Utrecht, Netherlands Reprint Address: Hage, JJ, Antoni van Leeuwenhoek Hosp, Netherlands Canc Inst, Dept Plast & Reconstruct Surg, Plesmanlaan 121, NL-1066 CX Amsterdam, Netherlands. E-mail Address: j.jorishage at inter.nl.net Cited Reference Count: 33 Times Cited: 0 Publisher: ELSEVIER SCI LTD Publisher Address: THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, OXON, ENGLAND ISSN: 1748-6815 29-char Source Abbrev.: J PLAST RECONSTR AESTHET SURG ISO Source Abbrev.: J. Plast. Reconstr. Aesthet. Surg. Source Item Page Count: 12 Subject Category: Surgery ISI Document Delivery No.: 200MZ *EUR STAT EUR DEM STAT NAT ACC : *I SCI INF J CIT REP 2003 : 2004 *IFS INR MON FUND STAT DE : *UN STAT DIV NAT ACC AGGR DAT : 1970 ADAMS J P NATL ACAD SCI USA 93 : 12663 1996 ANDERSON A SCIENCE 256 : 472 1992 BENZER A GEOGRAPHICAL ANALYSIS OF MEDICAL PUBLICATIONS IN 1990 LANCET 341 : 247 1993 BLIZIOTIS IA Worldwide trends in quantity and quality of published articles in the field of infectious diseases BMC INFECTIOUS DISEASES 5 : ARTN 16 2005 BOLDT J Which countries publish in important anesthesia and critical care journals? ANESTHESIA AND ANALGESIA 88 : 1175 1999 CAMPBELL EG Relationship between market competition and the activities and attitudes of medical school faculty JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 278 : 222 1997 DELLON AL IMPACT OF THE JOURNAL-PLASTIC-AND-RECONSTRUCTIVE-SURGERY PLASTIC AND RECONSTRUCTIVE SURGERY 90 : 717 1992 DUNST KM Analysis of original contributions in three dermatology journals JOURNAL OF THE AMERICAN ACADEMY OF DERMATOLOGY 52 : 355 2005 HAUSEN A GEOGRAPHY OF MEDICAL PUBLICATION LANCET 341 : 634 1993 HECHT F The journal "impact factor": A misnamed, misleading, misused measure CANCER GENETICS AND CYTOGENETICS 104 : 77 1998 HORTON R North and South: bridging the information gap LANCET 355 : 2231 2000 HUEMER GM Analysis of publications in three plastic surgery journals for the year 2002 PLASTIC AND RECONSTRUCTIVE SURGERY 114 : 1147 DOI 10.1097/01.prs.0000135851.23100.7e 2004 ISMAIL Y Head and neck oncology: the UK experience. Who is publishing what? BRITISH JOURNAL OF PLASTIC SURGERY 55 : 570 DOI 10.1054/bjps.2002.3918 2002 JAMIESON PW NEUROLOGY RESEARCH - A JOURNAL SURVEY, 1980-1990 ANNALS OF NEUROLOGY 32 : 87 1992 KANG N Plastic surgery research in the UK BRITISH JOURNAL OF PLASTIC SURGERY 55 : 463 DOI 10.1054/bjps.2002.3892 2002 KAY SP BR J PLAST SURG 56 : 315 2003 KO CY Improving the surgeon's participation in research: Is it a problem of training or priority? JOURNAL OF SURGICAL RESEARCH 91 : 5 2000 LINEAWEAVER WC Standards for cosmetic surgery articles PLASTIC AND RECONSTRUCTIVE SURGERY 108 : 251 2001 LINK AM US and non-US submissions - An analysis of reviewer bias JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 280 : 246 1998 LOONEN MPJ Who benefits from peer review? An analysis of the outcome of 100 requests for review by Plastic and Reconstructive Surgery PLASTIC AND RECONSTRUCTIVE SURGERY 116 : 1461 DOI 10.1097/01.prs.000178796.82273.7c 2005 MELA GS Impact assessment of oncology research in the European Union EUROPEAN JOURNAL OF CANCER 35 : 1182 1999 MOY E Relationship between National Institutes of Health research awards to US medical schools and managed care market penetration JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 278 : 217 1997 RAHMAN M Publications in epidemiology journals: Japanese perspectives JOURNAL OF EPIDEMIOLOGY 13 : 96 2003 RAHMAN M J ORTHOP SCI 7 : 607 2002 ROHRICH RJ Journal enhancements: An evolution PLASTIC AND RECONSTRUCTIVE SURGERY 115 : 643 DOI 10.1097/01.PRS.0000153952.18198.1A 2005 SWALES JD Science and health care: an uneasy partnership LANCET 355 : 1637 2000 TOMPKINS RK Internationalization of general surgical journals - Origin and content of articles published in North America and Great Britain from 1983 to 1998 ARCHIVES OF SURGERY 136 : 1345 2001 TUTAREL O BMC MED RES METHODOL 4 : 3 2004 WILKINSON G How international are the editorial boards of leading psychiatry journals? LANCET 361 : 1229 2003 From garfield at CODEX.CIS.UPENN.EDU Wed Jun 25 10:51:03 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Wed, 25 Jun 2008 10:51:03 -0400 Subject: Sriphaew, K; Theeramunkong, T Quality evaluation for document relation discovery using citation information IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, E90D (8): 1225-1234 AUG 200 Message-ID: E-mail Address: thanaruk at siit.tu.ac.th Author(s): Sriphaew, K (Sriphaew, Kritsada); Theeramunkong, T (Theeramunkong, Thanaruk) Title: Quality evaluation for document relation discovery using citation information Source: IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, E90D (8): 1225-1234 AUG 2007 Language: English Document Type: Article Author Keywords: document relations; frequent itemset mining; citation matrix; quality evaluation; document relation evaluation Abstract: Assessment of discovered patterns is an important issue in the field of knowledge discovery. This paper presents an evaluation method that utilizes citation (reference) information to assess the quality of discovered document relations. With the concept of transitivity as direct/indirect citations, a series of evaluation criteria is introduced to define the validity of discovered relations. Two kinds of validity, called soft validity and hard validity, are proposed to express the quality of the discovered relations. For the purpose of impartial comparison, the expected validity is statistically estimated based on the generative probability of each relation pattern. The proposed evaluation is investigated using more than 10,000 documents obtained from a research publication database. With frequent itemset mining as a process to discover document relations, the proposed method was shown to be a powerful way to evaluate the relations in four aspects: soft/hard scoring, direct/indirect citation, relative quality over the expected value, and comparison to human judgment. Addresses: Thammasat Univ, Sirindhorn Int Inst Technol, Sch Informat & Comp Technol, Bangkok 10200, Thailand Reprint Address: Sriphaew, K, Thammasat Univ, Sirindhorn Int Inst Technol, Sch Informat & Comp Technol, 2 Prachan Rd, Bangkok 10200, Thailand. E-mail Address: thanaruk at siit.tu.ac.th Cited Reference Count: 19 Times Cited: 0 Publisher: IEICE-INST ELECTRONICS INFORMATION COMMUNICATIONS ENG Publisher Address: KIKAI-SHINKO-KAIKAN BLDG MINATO-KU SHIBAKOEN 3 CHOME, TOKYO, 105, JAPAN ISSN: 0916-8532 29-char Source Abbrev.: IEICE TRANS INFORM SYST ISO Source Abbrev.: IEICE Trans. Inf. Syst. Source Item Page Count: 10 Subject Category: Computer Science, Information Systems; Computer Science, Software Engineering ISI Document Delivery No.: 202WE GANIZ M LUCSE05027 : 2005 GORDON MD Using latent semantic indexing for literature based discovery JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 49 : 674 1998 HAN J 2000 ACM SIGMOD INT 2000 1 KESSLER MM BIBLIOGRAPHIC COUPLING BETWEEN SCIENTIFIC PAPERS AMERICAN DOCUMENTATION 14 : 10 1963 KLEINBERG J ACM 46 : 604 1999 LINDSAY RK Literature-based discovery by lexical statistics JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 50 : 574 1999 MCCALLUM AK BOW TOOLKIT STAT LAN : 1996 NANBA H 11 SIG CLASS RES WOR 2000 117 PAGE L PAGERANK CITATION RA : 1998 PRATT W P 16 NAT C ART INT : 80 1999 ROSCH E PRINCIPLES CATEGORIZ : 27 1978 ROUSSEAU R A classification of author co-citations: Definitions and search strategies JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 55 : 513 DOI 10.1002/asi.10401 2004 SALTON G INTRO MODERN INFORM : 1986 SALTON G INTRO MODERN INFORM : 1983 SMALL H J AM SOC INFORM SCI 42 : 676 1973 SRIPHAEW K P 23 INT C ART INT A : 112 2005 SWANSON DR MEDICAL LITERATURE AS A POTENTIAL SOURCE OF NEW KNOWLEDGE BULLETIN OF THE MEDICAL LIBRARY ASSOCIATION 78 : 29 1990 SWANSON DR PERSPECTIVES BIOL ME 30 : 1 1986 WHITE H BIBLIOMETRICS ANN RE : 119 1989 From garfield at CODEX.CIS.UPENN.EDU Wed Jun 25 14:37:47 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Wed, 25 Jun 2008 14:37:47 -0400 Subject: Trikahnos, NA; Evangelou, E; Loannidis, JPA Falsified papers in high-impact journals were slow to retract and indistinguishable from nonfraudulent papers JOURNAL OF CLINICAL EPIDEMIOLOGY, 61 (5): 464-470 MAY 2008 Message-ID: E-mail Address: jioannid at cc.uoi.gr Author(s): Trikahnos, NA (Trikahnos, Nikolaos A.); Evangelou, E (Evangelou, Evangelos); Loannidis, JPA (Loannidis, John P. A.) Title: Falsified papers in high-impact journals were slow to retract and indistinguishable from nonfraudulent papers Source: JOURNAL OF CLINICAL EPIDEMIOLOGY, 61 (5): 464-470 MAY 2008 Language: English Document Type: Article Author Keywords: fraud; falsification; retraction; impact; journals; senior investigators Keywords Plus: SCIENTIFIC MISCONDUCT; FRAUD; PUBLICATION Abstract: Objective: The aim was to evaluate papers retracted due to falsification in high-impact journals. Study Design and Setting: We selected articles retracted due to allegations of falsification in January 1, 1980 to March 1, 2006 from journals with impact factor > 10 and > 30,000 annual citations. We evaluated characteristics of these papers and misconduct-involved authors and assessed whether they correlated with time to retraction. We also compared retracted articles vs. matched nonretracted articles in the same journals. Results: Fourteen eligible journals had 63 eligible retracted articles. Median time from publication to retraction was 28 months; it was 79 months for articles where a senior researcher was implicated in the misconduct vs. 22 months when junior researchers were implicated (log-rank P < 0.001). For the 25 implicated authors, the median time from the first publication of a fraudulent paper to the first retraction was 34 months, again with a clear difference according to researcher rank (log-rank P = 0.001). Retracted articles didn't differ from matched nonretracted papers in citations received within 12 months, number of authors, country, funding, or field, but were twofold more likely to have multinational authorship (P = 0.049). Conclusions: Retractions due to falsification can take a long time, especially when senior researchers are implicated. Fraudulent articles are not obviously distinguishable from nonfraudulent ones. (c) 2008 Elsevier Inc. All rights reserved. Addresses: Univ Ioannina, Dept Hyg & Epidemiol, Sch Med, Ioannina 45110, Greece; Fdn Res & Technol Hellas, Biomed Res Inst, Ioannina, Greece; Tufts Univ New England Med Ctr, Dept Med, Inst Clin Res & Hlth Policy Studies, Boston, MA USA Reprint Address: Loannidis, JPA, Univ Ioannina, Dept Hyg & Epidemiol, Sch Med, Ioannina 45110, Greece. E-mail Address: jioannid at cc.uoi.gr Cited Reference Count: 19 Times Cited: 0 Publisher: PERGAMON-ELSEVIER SCIENCE LTD Publisher Address: THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, ENGLAND ISSN: 0895-4356 29-char Source Abbrev.: J CLIN EPIDEMIOL ISO Source Abbrev.: J. Clin. Epidemiol. Source Item Page Count: 7 Subject Category: Public, Environmental & Occupational Health ISI Document Delivery No.: 288HX ALDHOUS P SCIENTIFIC MISCONDUCT - TRAGEDY REVEALED IN ZURICH NATURE 355 : 577 1992 COOPERMAHKORN D BRIT MED J 1998 : 316 1850 CULLITON BJ NIH TO REVIEW EMORY IN DARSEE CASE SCIENCE 220 : 1029 1983 DAHLBERG JE The Poehlman case: running away from the truth SCIENCE AND ENGINEERING ETHICS 12 : 157 2006 DALTON R Collins' student sanctioned over 'most severe' case of fraud NATURE 388 : 313 1997 FARTHING MJG Retractions in Gut 10 years after publication GUT 48 : 285 2001 FARTHING MJG Fraud in medicine - Coping with fraud LANCET 352 : 11 1998 GERBER P What can we learn from the Hwang and Sudbo affairs? MEDICAL JOURNAL OF AUSTRALIA 184 : 632 2006 IOANNIDIS JPA Contradicted and initially stronger effects in highly cited clinical research JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 294 : 218 2005 PFEIFER MP THE CONTINUED USE OF RETRACTED, INVALID SCIENTIFIC LITERATURE JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 263 : 1420 1990 RENNIE D Dealing with research misconduct in the United Kingdom - An American perspective on research integrity BRITISH MEDICAL JOURNAL 316 : 1726 1998 RENNIE D BREAST-CANCER - HOW TO MISHANDLE MISCONDUCT JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 271 : 1205 1994 RENNIE D SCIENTIFIC MISCONDUCT - NEW DEFINITION, PROCEDURES, AND OFFICE - PERHAPS A NEW LEAF JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 269 : 915 1993 RENNIE D SCI FRAUD MISCONDUCT : 13 2001 SCHIERMEIER Q Authors slow to retract 'fraudulent' papers NATURE 393 : 402 1998 SCULLY C Fraud in scientific publishing ORAL DISEASES 12 : 357 DOI 10.1111/j.1601-0825.2006.01259.x 2006 SMITH R Investigating the previous studies of a fraudulent author BRITISH MEDICAL JOURNAL 331 : 288 2005 SOX HC Research misconduct, retraction, and cleansing the medical literature: Lessons from the Poehlman case ANNALS OF INTERNAL MEDICINE 144 : 609 PMID 16522625 2006 WHITELY WP THE SCIENTIFIC COMMUNITY RESPONSE TO EVIDENCE OF FRAUDULENT PUBLICATION - THE SLUTSKY,ROBERT CASE JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 272 : 170 1994 From garfield at CODEX.CIS.UPENN.EDU Wed Jun 25 14:56:04 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Wed, 25 Jun 2008 14:56:04 -0400 Subject: Badgett, R (Badgett, Robert) Why would physicians undervalue reviews by the Cochrane Collaboration? JOURNAL OF CLINICAL EPIDEMIOLOGY, 61 (5): 419-421 MAY 2008 Message-ID: Email Address: BADGETT at UTHSCSA.EDU Author(s): Badgett, R (Badgett, Robert) Title: Why would physicians undervalue reviews by the Cochrane Collaboration? Source: JOURNAL OF CLINICAL EPIDEMIOLOGY, 61 (5): 419-421 MAY 2008 Language: English Document Type: Editorial Material Keywords Plus: SYSTEMATIC REVIEWS; CLINICAL QUESTIONS; PRIMARY-CARE; METAANALYSES; QUALITY Excerpt: Clinicians at the bedside want quick, prescriptive advice [13]. Cochrane is less likely to provide either. Studies show the expectation of finding an answer is a predictor of a clinician?s searching for an answer [13,14], thus, I think the expectation of not finding a quick answer in a CSR deters the busy clinician at the bedside. It is tempting to recommend that The Cochrane Collaboration integrate clinical expertise with the results of Cochrane reviews to write more prescriptive reviews. The Cochrane Collaboration has been urged to create reviews on clinical topics such as dizziness and syncope [11]. I would not suggest this just as I would not suggest that Clinical Evidence, Pier, or UpToDate do their own meta-analyses. Medical publishing is too complicated for one group to excel at both the meta-analysis and clinical guidance without massive support. Blending clinical expertise with evidence is difficult, fallible, and not well understood. Fallibility forces subjectivity as demonstrated in the mammography controversy [15,16]. Clinical knowledge, such as disseminated by the Cochrane Collaboration, can also reach the patient without reliance on the doctor?s reading. Maybe the Cochrane is read by the local clinical expert who educates the doctor, the author of the doctor?s favorite knowledge resource, or the doctor?s institution that encodes a practice guideline into their electronic health record. The PLUS Project found that specialists valued Cochrane reviews more than did generalists. Otherwise measurement of this indirect route to the bedside is difficult. A key metric of how well does information travel between authors is Eugene Garfield?s Impact Factor [17]. Cochrane should study its Impact Factor, which will be available for the first time in summer of 2008. Cochrane should also work with Clinical Evidence, Pier, and UpToDate to study citations by these resources. For now, searching for the word ??Cochrane?? at web sites such as Clinical Evidence, the New England Journal of Medicine (pdfs only), and eMedicine whose full text is indexed by Google reveals numerous citations to the Cochrane. Personally, I think The Cochrane Collaboration is doing well and we will find it is a strong, though indirect, contributor to bedside knowledge. The results of the PLUS Project urge innovation in readability. However, I would not suggest more drastic changes such as using clinical expertise to avoid inconclusive reviews unless evidence is found that Cochrane struggles in the indirect path to the bedside. Addresses: Univ Texas Hlth Sci Ctr San Antonio, STVHCS, San Antonio, TX 78229 USA Reprint Address: Badgett, R, Univ Texas Hlth Sci Ctr San Antonio, STVHCS, 7400 Merton Minter, San Antonio, TX 78229 USA. Cited Reference Count: 17 Times Cited: 0 Publisher: PERGAMON-ELSEVIER SCIENCE LTD Publisher Address: THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, ENGLAND ISSN: 0895-4356 29-char Source Abbrev.: J CLIN EPIDEMIOL ISO Source Abbrev.: J. Clin. Epidemiol. Source Item Page Count: 3 Subject Category: Public, Environmental & Occupational Health ISI Document Delivery No.: 288HX DELANEY A The quality of reports of critical care meta-analyses in the Cochrane Database of Systematic Reviews: An independent appraisal CRITICAL CARE MEDICINE 35 : 589 2007 EGGER M Bias in meta-analysis detected by a simple, graphical test BRITISH MEDICAL JOURNAL 315 : 629 1997 ELY JW Answering physicians' clinical questions: Obstacles and potential solutions JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION 12 : 217 DOI 10.1197/jamia.M1608 2005 FENTON SH A comparison of primary care information content in UpToDate and the National Guideline Clearinghouse JOURNAL OF THE MEDICAL LIBRARY ASSOCIATION 95 : 255 DOI 10.3163/1536- 5050.95.3.255 2007 GARFIELD E The history and meaning of the journal impact factor JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 295 : 90 2006 GOODMAN SN The mammography dilemma: A crisis for evidence-based medicine? ANNALS OF INTERNAL MEDICINE 137 : 363 2002 GORMAN PN INFORMATION-SEEKING IN PRIMARY-CARE - HOW PHYSICIANS CHOOSE WHICH CLINICAL QUESTIONS TO PURSUE AND WHICH TO LEAVE UNANSWERED MEDICAL DECISION MAKING 15 : 113 1995 JADAD AR Methodology and reports of systematic reviews and meta-analyses - A comparison of COCHRANE reviews with articles published in paper-based journals JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 280 : 278 1998 JORGENSEN AW Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review BRITISH MEDICAL JOURNAL 333 : 782 DOI 10.1136/bmj.38973.444699.0B 2006 LAUPACIS A ANN INTERN MED 127 : 273 2007 Row over breast cancer screening shows that scientists bring "some subjectivity into their work" BRITISH MEDICAL JOURNAL 323 : 956 2001 MCKIBBON KA BMC MED 2 : 33 2004 MCKINLAY RJ Systematic reviews and original articles differ in relevance, novelty, and use in an evidence-based service for physicians: PLUS project JOURNAL OF CLINICAL EPIDEMIOLOGY 61 : 449 DOI 10.1016/j.jclinepi.2007.10.016 2008 MONTORI VM Optimal search strategies for retrieving systematic reviews from Medline: analytical survey BRITISH MEDICAL JOURNAL 330 : 68 DOI 10.1136/bmj.38336.804167.47 2005 OLSEN O Quality of Cochrane reviews: assessment of sample from 1998 BRITISH MEDICAL JOURNAL 323 : 829 2001 SACKETT DL Finding and applying evidence during clinical rounds - The "evidence cart" JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 280 : 1336 1998 STRAUS SE THERAPY EVIDENCE BAS : 148 2005 From garfield at CODEX.CIS.UPENN.EDU Wed Jun 25 15:36:20 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Wed, 25 Jun 2008 15:36:20 -0400 Subject: Kiralj, R (Kiralj, R.); Ferreira, MMC (Ferreira, Marcia M. C.) The past, present, and future of chemometrics worldwide: some etymological, linguistic, and bibliometric investigations JOURNAL OF CHEMOMETRICS, 20 (6-7): 247-272 JUN-JUL 2006 Message-ID: E-mail Address: marcia at iqm.unicamp.br Author(s): Kiralj, R (Kiralj, R.); Ferreira, MMC (Ferreira, Marcia M. C.) Title: The past, present, and future of chemometrics worldwide: some etymological, linguistic, and bibliometric investigations Source: JOURNAL OF CHEMOMETRICS, 20 (6-7): 247-272 JUN-JUL 2006 Language: English Document Type: Article Author Keywords: chemometric history and etymology; languages; bibliometrics; webometrics; chemometric activity Keywords Plus: INTERNATIONAL COLLABORATION; LANGUAGES; GENES; IRAN Abstract: Internet surfing for the word chemometrics in national languages and, in the Science Citation Index (SCI), searching for articles containing chemometr* were performed. The bibliometric, webometric, and country development descriptors from literature were then treated by Principal Component Analysis (PCA) and Hierarchical Cluster Analysis (HCA). In total, 82 written and 127 pronunciation forms of chemometrics were found in 48 languages worldwide. The forms ending in '-y' (chemometry) and '-ics' (chemometrics) can be grouped into at least three groups (I, J, K). Scientific collaboration, country development, geography, history, and language were shown to be important determinants in creation of form(s) of chemometrics in a particular country or language. PCA and HCA show that tradition in chemometrics, level of country development, and its scientific production are important for the existence of chemometric societies and laboratories worldwide. Today, the world tends toward becoming more homogeneous with respect to chemometric activity, and will reach a corresponding normal distribution in about 70 years from now. Copyright (c) 2007 John Wiley & Sons, Ltd. Addresses: Univ Estadual Campinas, UNICAMP, Inst Quim, Lab Quimiometria Teor & Aplicada, BR-13083970 Campinas, SP, Brazil Reprint Address: Ferreira, MMC, Univ Estadual Campinas, UNICAMP, Inst Quim, Lab Quimiometria Teor & Aplicada, BR-13083970 Campinas, SP, Brazil. E-mail Address: marcia at iqm.unicamp.br Cited Reference Count: 68 Times Cited: 1 Publisher: JOHN WILEY & SONS LTD Publisher Address: THE ATRIUM, SOUTHERN GATE, CHICHESTER PO19 8SQ, W SUSSEX, ENGLAND ISSN: 0886-9383 29-char Source Abbrev.: J CHEMOMETR ISO Source Abbrev.: J. Chemometr. Source Item Page Count: 26 Subject Category: Automation & Control Systems; Chemistry, Analytical; Computer Science, Artificial Intelligence; Instruments & Instrumentation; Mathematics, Interdisciplinary Applications; Statistics & Probability ISI Document Delivery No.: 169MR AM HERITAGE DICT ENG : 2006 ANAL CHIM ACTA 150 : 1983 ARTFL PROJECT U CHIC : 2006 BASIC TASKS GOALS RU : 2006 CHEMOMETRY CHEMOMETR : 2006 GOOGLE SEARCH ENG : 2006 HUMAN DEV REPORTS 20 : 2006 IANAS ROOT ZONE WHO : 2006 ITU DIGITAL ACCESS I : 2006 J CHEMOMETR 3 : 453 MERRIAM WEBSTER ONLI : 2006 OMNIGLOT WRITING SYS : 2006 ONLINE ETYMOLOGICAL : 2006 TOWER BABEL EVOLUTIO : 2006 UNCTAD REPORT 2003 I : 2006 UNDP HUMAN DEV REPOR : 2006 UNESCO SCI REPORT 20 : 2006 WHAT IS CHEMOMETRICS : 2006 WIKIPEDIA FREE ENCY : 2006 YAHOO SEARCH ENG : 2006 *INF PIR 3 11 : 2003 *MATHWORKS MATL 6 5 : 2003 AUSTIN P ATLAS LINGUAS : 2001 BEEBE KR CHEMOMETRICS PRACTIC : 1998 BEK WK CHEMOM INTELL LAB SY 5 : 98 1988 BRAUN T International collaboration: Will it be keeping alive east European research? SCIENTOMETRICS 36 : 247 1996 BUYUKKOCA E ABSTR PAP AM CHEM SO 188 : 1984 CAVALLISFORZA LL GENES POVOS LINGUAS : 2003 CAVALLISFORZA LL Genes, peoples, and languages PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 94 : 7719 1997 DYEN I AN INDO-EUROPEAN CLASSIFICATION, A LEXICOSTATISTICAL EXPERIMENT .1. TRANSACTIONS OF THE AMERICAN PHILOSOPHICAL SOCIETY 82 : 1 1992 ESBENSEN K THE START AND EARLY HISTORY OF CHEMOMETRICS - SELECTED INTERVIEWS .2. JOURNAL OF CHEMOMETRICS 4 : 389 1990 ESBENSEN KH 1ST SCANDINAVIAN SYMPOSIUM ON CHEMOMETRICS (SSC1), LAPPEENRANTA, FINLAND, 6-8 OCTOBER 1988 CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS 6 : 2 1989 FABER K CHEMOMETRY CONSULTAN : 2006 FRAME JD INTERNATIONAL RESEARCH COLLABORATION SOCIAL STUDIES OF SCIENCE 9 : 481 1979 GELADI P Scatter plotting in multivariate data analysis JOURNAL OF CHEMOMETRICS 17 : 503 DOI 10.1002/cem.814 2003 GELADI P J CHEMOMETR 4 : 331 1990 GREENBERG JH INDOEUROPEAN ITS CLO 1 : 2000 HART PW Relationship between growth in gross domestic product (GDP) and growth in the chemical engineering literature in five different countries SCIENTOMETRICS 42 : 299 1998 HE TW Basic research in biochemistry and molecular biology in China: A bibliometric analysis SCIENTOMETRICS 62 : 249 2005 HEMMATEENEJAD B Chemometrics in Iran CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS 81 : 202 DOI 10.1016/j.chemolab.2005.12.004 2006 HUDSON J HIST CHEM : 22 1992 JACOBSEN T CHEMOMETRIC STUDY OF SOME BEER FLAVOR COMPONENTS JOURNAL OF THE INSTITUTE OF BREWING 85 : 265 1979 JAMES HP ASS AS STUD ANN M MA : 2006 JINNO K MICROCOLUMN LIQUID-CHROMATOGRAPHY COMBINED WITH COMPUTER-ASSISTED RETENTION PREDICTION SYSTEM FOR POLYCYCLIC AROMATIC-HYDROCARBONS IN EXTRACT FROM DIESEL PARTICULATE MATTER ANALYTICAL LETTERS PART A-CHEMICAL ANALYSIS 17 : 905 1984 KIM MJ Korean science and international collaboration, 1995-2000 SCIENTOMETRICS 63 : 321 DOI 10.1007/s11192-005-0215-1 2005 KIRALJ R CHEMOMETRICS DIFFERE : 2002 KOWALSKI B J CHEMOMETR 1 : 1 1987 KOWALSKI BR ACS S SER 52 : 1977 KOWALSKI BR ANAL CHEM 52 : R11 1980 KOWALSKI BR CHEMOMETRICS - VIEWS AND PROPOSITIONS JOURNAL OF CHEMICAL INFORMATION AND COMPUTER SCIENCES 15 : 201 1975 LAVINE B Chemometrics ANALYTICAL CHEMISTRY 76 : 3365 DOI 10.1021/ac040053p 2004 MAAR JH PEQUENA HIST QUIMICA : 25 1999 MCMAHON R Genes and languages COMMUNITY GENETICS 7 : 2 DOI 10.1159/000080298 2004 MIERZECKI R HIST DEV CHEM CONCEP : 6 1991 MOED HF INTERNATIONAL SCIENTIFIC COOPERATION AND AWARENESS WITHIN THE EUROPEAN COMMUNITY - PROBLEMS AND PERSPECTIVES SCIENTOMETRICS 21 : 291 1991 MOIN M Scientific output of Iran at the threshold of the 21st century SCIENTOMETRICS 62 : 239 2005 MOORE FJ HIST CHEM : 2 1939 MULTHAUF RP ORIGIN CHEM : 102 1966 OJASOO T SCI TRIBUNE AUG : 2006 OSAREH F Collaboration in Iranian scientific publications LIBRI 52 : 88 2002 PARTINGTON JR SHORT HIST CHEM : 20 1951 SALZBERG W CAVEMAN CHEM CIRCUMS : 33 1991 TANOVIC L RTD STATUS BOSNIA HE : 2006 TOMAS X J CHEMOMETR 3 : 101 1988 VANDEGINSTE B ABSTR PAP AM CHEM SO 182 : 1981 WOLD S NONSYMMETRY OF REACTION PARAMETER (RHO) AND SUBSTITUENT PARAMETER (SIGMA) IN HAMMETT EQUATION AND SIMILAR EXTRATHERMODYNAMIC RELATIONSHIPS ACTA CHEMICA SCANDINAVICA 27 : 3602 1973 WOLD S Chemometrics; What do we mean with it, and what do we want from it? CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS 30 : 109 1995 WOLD S KEM TIDSKR 3 : 34 1972 From harnad at ECS.SOTON.AC.UK Thu Jun 26 09:35:33 2008 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Thu, 26 Jun 2008 14:35:33 +0100 Subject: Stanford School of Education Manadate Green OA Message-ID: Just announced by John Willinsky at ELPUB 2008. From John.McDonald at LIBRARIES.CLAREMONT.EDU Thu Jun 26 23:20:24 2008 From: John.McDonald at LIBRARIES.CLAREMONT.EDU (John McDonald) Date: Thu, 26 Jun 2008 20:20:24 -0700 Subject: Call for Papers - Special Issue of the Journal of Electronic Resources Librarianship In-Reply-To: A Message-ID: The Journal of Electronic Resources Librarianship (JERL) http://www.jerl-info.com is a peer-reviewed journal addressing issues in electronic resources librarianship. The journal is published quarterly by The Haworth Press (Taylor & Francis). Submissions are being accepted for a special issue of this journal titled, "Electronic Resources Usage Statistics: Research & Practice.", guest edited by John McDonald, Director of Information & Bibliographic Management and Faculty Relations, Claremont University Consortium. JERL aims to inform librarians and other information professionals about evolving work-related processes and procedures, current research and the latest news on topics related to electronic resources and the digital environment's impact on collecting, acquiring, and making accessible library materials. This issue of JERL will focus on the use of statistics and quantitative or qualitative data analysis relating to the acquisition and management of electronic resources in libraries. Articles will include original research on journal and database usage statistics, collections decisions, electronic books, and library services in general. JERL strives to find a balance between original, scholarly research, and practical communications about relevant topics in electronic resources librarianship. The journal will publish the following types of articles: * Peer-reviewed articles of a scholarly (original research) nature * Practice-related articles, such as case studies or pieces on the state of the field/new areas of work * Review articles of books, conferences, and other resources of interest in the field Suggested topics include, but are not limited to, the theory, application or usage of statistics in collection development, including: * assessment and evaluation of e-resources * determining value of e-resources * economics of e-resources in libraries * e-resources usage by format types (online journals, e-books, databases) * standards development for statistics relating to digital resources and collections * statistical research relating to usability of resources or user preferences * information needs and behaviors of users * statistical affect of access & discovery tools * evidence of changes in the nature of research in the digital environment * statistics on digital Libraries and digital repositories * statistics supporting collection planning * novel techniques for statistical research on bibliometric data For details or more information, contact: Guest Editor of this Issue: John McDonald Director of Information & Bibliographic Management and Faculty Relations Libraries, Claremont University Consortium Claremont, CA 91711 909-621-8014 John.mcdonald at libraries.claremont.edu Editor, Journal of Electronic Resources Librarianship Bonnie Tijerina Digital Collections Services Librarian University of California, Los Angeles 33456 Charles E. Young Research Library Los Angeles, CA 90095 AIM: bltijerina btijerina at library.ucla.edu From loet at LEYDESDORFF.NET Fri Jun 27 03:15:57 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Fri, 27 Jun 2008 09:15:57 +0200 Subject: The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication Message-ID: The Knowledge-Based Economy: The Potentially Globalizing and Self-Organizing Dynamics of Interactions among Differently Codified Systems of Communication Alongside economic exchange relations and political control, the organization of codified knowledge in scientific discourses has become increasingly a third coordination mechanism at the level of the social system. When three coordination mechanisms interact, one can expect the resulting dynamics to be complex and self-organizing. Each coordination mechanism is specific in terms of its code of communication. For example, "energy" has a meaning in physics very different from its meaning in the economy or for policy-makers. In addition to providing the communications with functionally different meanings, the codes can be symbolically generalized, and then meaning can be globalized. Symbolically generalized codes of communication can be expected to span competing horizons of meaning that 'self-organize' given historical conditions. From this perspective, the historical organization of meaning-for example, in discourses-can be considered as instantiations or retention mechanisms. In other words, meaning can further be codified in communication flows. Knowledge, for example, can be considered as a meaning which makes a difference. In the case of discursive knowledge, this difference is defined with reference to a code in the communication. When discursive knowledge is socially organized (e.g., as R&D) its dynamics can increasingly compete with other social coordination mechanisms in the construction and reproduction of a knowledge-based order. < pdf-version> _____ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ Visiting Professor 2007-2010, ISTIC, Beijing; Honorary Fellow 2007-2010, SPRU, University of Sussex Now available: The Knowledge-Based Economy: Modeled, Measured, Simulated, 385 pp.; US$ 18.95; The Self-Organization of the Knowledge-Based Society ; The Challenge of Scientometrics -------------- next part -------------- An HTML attachment was scrubbed... URL: From notsjb at LSU.EDU Fri Jun 27 09:48:58 2008 From: notsjb at LSU.EDU (Stephen J Bensman) Date: Fri, 27 Jun 2008 08:48:58 -0500 Subject: IMU Critique of Citation Analysis Message-ID: In re the recent flap caused by the International Mathematical Union critique of citation analysis, I checked the distribution of mathematics journals by impact factor in the 2007 SCI JCR. It was as I suspected. The range of impact factors was only from 0.108 to 2.739--extraordinarily low and tight--and the top journals on the impact factor had no review articles. This is suggestive of an extremely random citation pattern with no development of consensual paradigms. Therefore, math acts like a humanities in terms of its literature use, and citation analysis is probably not applicable to this discipline. If citation analysis is used, it has to be backed by other measures. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From isidro at CINDOC.CSIC.ES Fri Jun 27 11:25:30 2008 From: isidro at CINDOC.CSIC.ES (Isidro F. Aguillo) Date: Fri, 27 Jun 2008 17:25:30 +0200 Subject: Quick question... In-Reply-To: <20080623123826.GA4272@trabbi.openlib.org> Message-ID: Dear colleagues: Sorry for the delay, but the electronic version of the ISSI 2007 Proceedings will be ready soon from the website. Unfortunately, our stock of printed books is exhausted due to the large number of people attending the event. Please, be patient. thanks and see you again in Brazil! Thomas Krichel escribi?: > Isidro F. Aguillo writes, on 14 January 2008 > > >> Unfortunately there is no more printed Proceedings available. But we are >> working now on the electronic version that will be available online in >> the Conference website soon: >> >> http://issi2007.cindoc.csic.es >> > > Is it there now? I had a look but I did not see it. > > > Cheers, > > Thomas Krichel http://openlib.org/home/krichel > RePEc:per:1965-06-05:thomas_krichel > phone: +7 383 330 6813 skype: thomaskrichel > > > -- **************************** Isidro F. Aguillo Laboratorio de Cibermetr?a Cybermetrics Lab CCHS - CSIC Joaquin Costa, 22 28002 Madrid. Spain isidro @ cindoc.csic.es +34-91-5635482 ext 313 **************************** From eugene.garfield at THOMSONREUTERS.COM Fri Jun 27 12:09:29 2008 From: eugene.garfield at THOMSONREUTERS.COM (Eugene Garfield) Date: Fri, 27 Jun 2008 12:09:29 -0400 Subject: IMU Critique of Citation Analysis In-Reply-To: <4928689828488E458AECE7AFDCB52CFE560ECC@email003.lsu.edu> Message-ID: I think you have to be careful about using the term citation analysis in a blanket fashion. Even if the IMU was only concerned about rating mathematicians there are no blanket statements that apply. Years ago I did several citation analyses of mathematicians and math journals. I have listed the group I find quickly from my web page: Document Title Journal Citation Studies. 36. Pure and Applied Mathematics Journals. What they cite and vice versa. http://www.garfield.library.upenn.edu/essays/v5p484y1981-82.pdf The 200 "Pure" Mathematicians Most Cited in 1978 and 1979, Including a List of Most-Cited Publications for the Top 100 http://www.garfield.library.upenn.edu/essays/v5p666y1981-82.pdf The Multidisciplinary Impact of Math and Computer Science Is Reflected in the 100 Most-Cited Articles in CompuMath Citation Index, 1976-1980 http://www.garfield.library.upenn.edu/essays/v7p232y1984.pdf The Most-Cited Physical-Sciences Publications in the 1945-1954 Science Citation Index. Part 2. Twenty Citation Classics in Mathematics http://www.garfield.library.upenn.edu/essays/v13p376y1990.pdf gpd7213.tmp http://www.garfield.library.upenn.edu/essays/v15p439subjectindexy1992-93 .pdf The Most-Cited Physical-Sciences Publications in the 1945-1954 Science Citation Index. Part 2. Twenty Citation Classics in Mathematics http://www.garfield.library.upenn.edu/essays/v13p381y1990.pdf I never heard any objection from IMU or anyone else to these studies. Also of interest is: The 100 most-cited books in the CompuMath Citation Index, 1976-1980 http://www.garfield.library.upenn.edu/essays/v7p264y1984.pdf Someone needs to do a citation analysis of the winners of Fields Medals including Hi-Indexes. I haven't determined whether anyone has done co-citation analyses of math subjects which would be a better way to confirm your assertion that math is not susceptible to identifying paradigm shifts. It all depends on how you do it and what you are looking for. EG ________________________________ From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stephen J Bensman Sent: Friday, June 27, 2008 9:49 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] IMU Critique of Citation Analysis In re the recent flap caused by the International Mathematical Union critique of citation analysis, I checked the distribution of mathematics journals by impact factor in the 2007 SCI JCR. It was as I suspected. The range of impact factors was only from 0.108 to 2.739--extraordinarily low and tight--and the top journals on the impact factor had no review articles. This is suggestive of an extremely random citation pattern with no development of consensual paradigms. Therefore, math acts like a humanities in terms of its literature use, and citation analysis is probably not applicable to this discipline. If citation analysis is used, it has to be backed by other measures. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.gif Type: image/gif Size: 88 bytes Desc: image001.gif URL: From dwojick at HUGHES.NET Fri Jun 27 12:56:47 2008 From: dwojick at HUGHES.NET (David E. Wojick) Date: Fri, 27 Jun 2008 12:56:47 -0400 Subject: The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication In-Reply-To: <001901c8d825$a5c46400$6402a8c0@loet> Message-ID: Dear Loet (and all), This abstract and the paper are written in a technical language (or code?) that I barely understand, so I may be off the mark. (A nontechnical version would be most useful). But I have two related observations. 1. Technological innovation and science are two different domains and only loosely coupled. Most innovation is part of economic activity, not science. I therefore question whether scientific discourse has in fact become a coordination mechanism at the social system level. But scientific knowledge diffusion beyond science is largely invisible, precisely because it is diffuse, so I may be wrong. 2. Conversely, there is an historic activity in progress whereby scientific discourse and political control are in direct communication. This is the climate change debate. I have been studying this debate for many years and it is unprecedented. The latest scientific findings are circulated and debated in real time in the US Congress and in the national press. The Internet is playing a leading role. The economic implications and proposals are staggering. This might be an exemplar of your coordination mechanism model, but it is not about economic or technological innovation, it is about science and public policy. With best regards, David Wojick The Knowledge-Based Economy: The Potentially Globalizing and Self-Organizing Dynamics of Interactions among Differently Codified Systems of Communication Alongside economic exchange relations and political control, the organization of codified knowledge in scientific discourses has become increasingly a third coordination mechanism at the level of the social system. When three coordination mechanisms interact, one can expect the resulting dynamics to be complex and self-organizing. Each coordination mechanism is specific in terms of its code of communication. For example, "energy" has a meaning in physics very different from its meaning in the economy or for policy-makers. In addition to providing the communications with functionally different meanings, the codes can be symbolically generalized, and then meaning can be globalized. Symbolically generalized codes of communication can be expected to span competing horizons of meaning that 'self-organize' given historical conditions. From this perspective, the historical organization of meaning-for example, in discourses-can be considered as instantiations or retention mechanisms. In other words, meaning can further be codified in communication flows. Knowledge, for example, can be considered as a meaning which makes a difference. In the case of discursive knowledge, this difference is defined with reference to a code in the communication. When discursive knowledge is socially organized (e.g., as R&D) its dynamics can increasingly compete with other social coordination mechanisms in the construction and reproduction of a knowledge-based order. <pdf-version> Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ Visiting Professor 2007-2010, ISTIC, Beijing; Honorary Fellow 2007-2010, SPRU, University of Sussex Now available: The Knowledge-Based Economy: Modeled, Measured, Simulated, 385 pp.; US$ 18.95; The Self-Organization of the Knowledge-Based Society ; The Challenge of Scientometrics -- "David E. Wojick, PhD" Senior Consultant for Innovation Office of Scientific and Technical Information US Department of Energy http://www.osti.gov/innovation/ 391 Flickertail Lane, Star Tannery, VA 22654 USA 540-858-3136 http://www.bydesign.com/powervision/resume.html provides my bio and past client list. http://www.bydesign.com/powervision/Mathematics_Philosophy_Science/ presents some of my own research on information structure and dynamics. -------------- next part -------------- An HTML attachment was scrubbed... URL: From notsjb at LSU.EDU Fri Jun 27 13:14:31 2008 From: notsjb at LSU.EDU (Stephen J Bensman) Date: Fri, 27 Jun 2008 12:14:31 -0500 Subject: IMU Critique of Citation Analysis In-Reply-To: A<311174B69873F148881A743FCF1EE5370562B01E@TSHUSPAPHIMBX02.ERF.THOMSON.COM> Message-ID: Let me phrase what I wrote much more carefully. In my opinion, the accuracy of any rating measure is dependent on the level of consensus in the field. High levels of consensus lead to high levels of inter-correlations among measures. To show an example of this, Mathematics was classified with the physical sciences in the 1993 National Research Council assessment of US research-doctorate programs, and, in descending rank order, the correlations of the peer ratings of these programs with citations per program faculty are below: Chemistry - 0.81 Geosciences - 0.74 Astrophysics and Astronomy - 0.73 Physics - .070 Oceanography - 0.70 Computer Sciences - 0.61 Mathematics - 0.56 Statistics and Biostatistics - 0.17 The last seems to be some kind of outlier fluke and probably should be discarded. When that is done, Math is on the bottom and even below Computer Sciences, which are related to engineering fields and therefore not as academic as the other fields. The low consensus in mathematics as witnessed by the absence of dominant review journals probably plays a role in Math's relatively low correlation. With a correlation of only 0.56, I would be loath to rely on citations alone in any ratings of mathematicians but utilize together with these other measures for comparative and counterbalancing purposes. However, the correlation is high enough for citations to be informative. As for the distribution of journals by impact factor, there were 200 math journals covered by the 2007 SCI JCR, and these are all compressed into a range of 2.739. I would be careful of using impact factor as a rating method for math journals, particularly below the top 10%. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at listserv.utk.edu] On Behalf Of Eugene Garfield Sent: Friday, June 27, 2008 11:09 AM To: SIGMETRICS at listserv.utk.edu Subject: Re: [SIGMETRICS] IMU Critique of Citation Analysis I think you have to be careful about using the term citation analysis in a blanket fashion. Even if the IMU was only concerned about rating mathematicians there are no blanket statements that apply. Years ago I did several citation analyses of mathematicians and math journals. I have listed the group I find quickly from my web page: Document Title Journal Citation Studies. 36. Pure and Applied Mathematics Journals. What they cite and vice versa. http://www.garfield.library.upenn.edu/essays/v5p484y1981-82.pdf The 200 "Pure" Mathematicians Most Cited in 1978 and 1979, Including a List of Most-Cited Publications for the Top 100 http://www.garfield.library.upenn.edu/essays/v5p666y1981-82.pdf The Multidisciplinary Impact of Math and Computer Science Is Reflected in the 100 Most-Cited Articles in CompuMath Citation Index, 1976-1980 http://www.garfield.library.upenn.edu/essays/v7p232y1984.pdf The Most-Cited Physical-Sciences Publications in the 1945-1954 Science Citation Index. Part 2. Twenty Citation Classics in Mathematics http://www.garfield.library.upenn.edu/essays/v13p376y1990.pdf gpd7213.tmp http://www.garfield.library.upenn.edu/essays/v15p439subjectindexy1992-93 .pdf The Most-Cited Physical-Sciences Publications in the 1945-1954 Science Citation Index. Part 2. Twenty Citation Classics in Mathematics http://www.garfield.library.upenn.edu/essays/v13p381y1990.pdf I never heard any objection from IMU or anyone else to these studies. Also of interest is: The 100 most-cited books in the CompuMath Citation Index, 1976-1980 http://www.garfield.library.upenn.edu/essays/v7p264y1984.pdf Someone needs to do a citation analysis of the winners of Fields Medals including Hi-Indexes. I haven't determined whether anyone has done co-citation analyses of math subjects which would be a better way to confirm your assertion that math is not susceptible to identifying paradigm shifts. It all depends on how you do it and what you are looking for. EG ________________________________ From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Stephen J Bensman Sent: Friday, June 27, 2008 9:49 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] IMU Critique of Citation Analysis In re the recent flap caused by the International Mathematical Union critique of citation analysis, I checked the distribution of mathematics journals by impact factor in the 2007 SCI JCR. It was as I suspected. The range of impact factors was only from 0.108 to 2.739--extraordinarily low and tight--and the top journals on the impact factor had no review articles. This is suggestive of an extremely random citation pattern with no development of consensual paradigms. Therefore, math acts like a humanities in terms of its literature use, and citation analysis is probably not applicable to this discipline. If citation analysis is used, it has to be backed by other measures. Stephen J. Bensman LSU Libraries Louisiana State University Baton Rouge, LA 70803 USA notsjb at lsu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.gif Type: image/gif Size: 88 bytes Desc: image001.gif URL: From loet at LEYDESDORFF.NET Sat Jun 28 04:10:48 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Sat, 28 Jun 2008 10:10:48 +0200 Subject: The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication In-Reply-To: Message-ID: Dear David, This abstract and the paper are written in a technical language (or code?) that I barely understand, so I may be off the mark. (A nontechnical version would be most useful). But I have two related observations. Indeed, this text is difficult to read because of the level of abstraction. (It was not meant to be empirical.) 1. Technological innovation and science are two different domains and only loosely coupled. Most innovation is part of economic activity, not science. I therefore question whether scientific discourse has in fact become a coordination mechanism at the social system level. But scientific knowledge diffusion beyond science is largely invisible, precisely because it is diffuse, so I may be wrong. There is a lot of innovation going on in the economy which is not knowledge-based, but practice-based. 2. Conversely, there is an historic activity in progress whereby scientific discourse and political control are in direct communication. This is the climate change debate. I have been studying this debate for many years and it is unprecedented. The latest scientific findings are circulated and debated in real time in the US Congress and in the national press. The Internet is playing a leading role. The economic implications and proposals are staggering. This might be an exemplar of your coordination mechanism model, but it is not about economic or technological innovation, it is about science and public policy. I did not work on this, but on the issue of "stem-cell research". You may find the methodology useful: Loet Leydesdorff & Iina Hellsten, Metaphors and Diaphors in Science Communication: Mapping the Case of 'Stem-Cell Research', Science Communication 27(1), 2005, 64-99. > With best wishes, Loet With best regards, David Wojick The Knowledge-Based Economy: The Potentially Globalizing and Self-Organizing Dynamics of Interactions among Differently Codified Systems of Communication Alongside economic exchange relations and political control, the organization of codified knowledge in scientific discourses has become increasingly a third coordination mechanism at the level of the social system. When three coordination mechanisms interact, one can expect the resulting dynamics to be complex and self-organizing. Each coordination mechanism is specific in terms of its code of communication. For example, "energy" has a meaning in physics very different from its meaning in the economy or for policy-makers. In addition to providing the communications with functionally different meanings, the codes can be symbolically generalized, and then meaning can be globalized. Symbolically generalized codes of communication can be expected to span competing horizons of meaning that 'self-organize' given historical conditions. From this perspective, the historical organization of meaning-for example, in discourses-can be considered as instantiations or retention mechanisms. In other words, meaning can further be codified in communication flows. Knowledge, for example, can be considered as a meaning which makes a difference. In the case of discursive knowledge, this difference is defined with reference to a code in the communication. When discursive knowledge is socially organized (e.g., as R&D) its dynamics can increasingly compete with other social coordination mechanisms in the construction and reproduction of a knowledge-based order. > _____ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ Visiting Professor 2007-2010, ISTIC, Beijing; Honorary Fellow 2007-2010, SPRU, University of Sussex Now available: The Knowledge-Based Economy: Modeled, Measured, Simulated, 385 pp.; US$ 18.95; The Self-Organization of the Knowledge-Based Society ; The Challenge of Scientometrics -- "David E. Wojick, PhD" Senior Consultant for Innovation Office of Scientific and Technical Information US Department of Energy http://www.osti.gov/innovation/ 391 Flickertail Lane, Star Tannery, VA 22654 USA 540-858-3136 http://www.bydesign.com/powervision/resume.html provides my bio and past client list. http://www.bydesign.com/powervision/Mathematics_Philosophy_Science/ presents some of my own research on information structure and dynamics. -------------- next part -------------- An HTML attachment was scrubbed... URL: From dwojick at HUGHES.NET Sat Jun 28 06:54:45 2008 From: dwojick at HUGHES.NET (David Wojick) Date: Sat, 28 Jun 2008 10:54:45 +0000 Subject: The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication Message-ID: An HTML attachment was scrubbed... URL: From loet at LEYDESDORFF.NET Sat Jun 28 07:28:05 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Sat, 28 Jun 2008 13:28:05 +0200 Subject: The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication In-Reply-To: <415842791.173691214650485192.JavaMail.mail@webmail05> Message-ID: _____ From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at listserv.utk.edu] On Behalf Of David Wojick Sent: Saturday, June 28, 2008 12:55 PM To: SIGMETRICS at listserv.utk.edu Subject: Re: [SIGMETRICS] The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication Dear Loet, The difficulty is not abstraction (my field is applied philosophy and logic), it is specialized language. Key technical concepts like "code of communication" and "coordination mechanism" are not explained. Plus you seem to be using "knowledge" (your central concept) in a special way. In analytical philosophy knowledge is generally defined as something like true belief. You seem to be refering to codified scientific knowledge, but you do not say that. Do patents represent knowledge, as you are using that term, or just practice? It seems to me that I focus on codified scientific knowledge and say that repeatingly throughout the paper. Indeed, there is a difference between considering knowledge as "true belief" of individuals versus considering scientific knowledge as a system of rationalized expectations. But you seem to have missed my main point. I work at the intersection of government control, industry and science. I do not see science as becoming a third coordination mechanism (with the exception of climate science), which I take to be your central thesis. (Correct me if I am wrong.). I agree that climate change would be a beautiful case, but I gave the example of the stem-cell debate as another one where scientific arguments, political discourse, and economic considerations interact and make the issues structurally complex. But this is an empirical question about which we have almost no knowledge, and desperately need some. So I am wondering why you think science is becoming the third coordination mechanism? My research question was to explain the "knowledge-based economy". How can an economy be based on knowledge instead of agriculture, industries, and services? My suggestion is that the functional differentiation of the codes of communication which is historically to be placed in the time of the reformation and the Scientific Revolution, has led to complex interactions among social coordination mechanism which first generated political economies in the period 1780-1870, and that these political economies then began to compete in another dimension of the system for systematic innovations. This is extensively explained in the paper. Thus, I use a functionalist-structuralist model for the explanation, but this is also explained in the paper. I am sorry if it does not communicate. (Perhaps, we should take this discussion therefore off-line.) Best wishes, Loet My greatest regards, David Jun 28, 2008 04:24:37 AM, SIGMETRICS at LISTSERV.UTK.EDU wrote: Dear David, This abstract and the paper are written in a technical language (or code?) that I barely understand, so I may be off the mark. (A nontechnical version would be most useful). But I have two related observations. Indeed, this text is difficult to read because of the level of abstraction. (It was not meant to be empirical.) 1. Technological innovation and science are two different domains and only loosely coupled. Most innovation is part of economic activity, not science. I therefore question whether scientific discourse has in fact become a coordination mechanism at the social system level. But scientific knowledge diffusion beyond science is largely invisible, precisely because it is diffuse, so I may be wrong. There is a lot of innovation going on in the economy which is not knowledge-based, but practice-based. 2. Conversely, there is an historic activity in progress whereby scientific discourse and political control are in direct communication. This is the climate change debate. I have been studying this debate for many years and it is unprecedented. The latest scientific findings are circulated and debated in real time in the US Congress and in the national press. The Internet is playing a leading role. The economic implications and proposals are staggering. This might be an exemplar of your coordination mechanism model, but it is not about economic or technological innovation, it is about science and public policy. I did not work on this, but on the issue of "stem-cell research". You may find the methodology useful: Loet Leydesdorff & Iina Hellsten, Metaphors and Diaphors in Science Communication: Mapping the Case of 'Stem-Cell Research', Science Communication 27(1), 2005, 64-99. > With best wishes, Loet With best regards, David Wojick The Knowledge-Based Economy: The Potentially Globalizing and Self-Organizing Dynamics of Interactions among Differently Codified Systems of Communication Alongside economic exchange relations and political control, the organization of codified knowledge in scientific discourses has become increasingly a third coordination mechanism at the level of the social system. When three coordination mechanisms interact, one can expect the resulting dynamics to be complex and self-organizing. Each coordination mechanism is specific in terms of its code of communication. For example, "energy" has a meaning in physics very different from its meaning in the economy or for policy-makers. In addition to providing the communications with functionally different meanings, the codes can be symbolically generalized, and then meaning can be globalized. Symbolically generalized codes of communication can be expected to span competing horizons of meaning that 'self-organize' given historical conditions. From this perspective, the historical organization of meaning-for example, in discourses-can be considered as instantiations or retention mechanisms. In other words, meaning can further be codified in communication flows. Knowledge, for example, can be considered as a meaning which makes a difference. In the case of discursive knowledge, this difference is defined with reference to a code in the communication. When discursive knowledge is socially organized (e.g., as R&D) its dynamics can increasingly compete with other social coordination mechanisms in the construction and reproduction of a knowledge-based order. > _____ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ Visiting Professor 2007-2010, ISTIC, Beijing; Honorary Fellow 2007-2010, SPRU, University of Sussex Now available: The Knowledge-Based Economy: Modeled, Measured, Simulated, 385 pp.; US$ 18.95; The Self-Organization of the Knowledge-Based Society ; The Challenge of Scientometrics -- "David E. Wojick, PhD" Senior Consultant for Innovation Office of Scientific and Technical Information US Department of Energy http://www.osti.gov/innovation/ 391 Flickertail Lane, Star Tannery, VA 22654 USA 540-858-3136 http://www.bydesign.com/powervision/resume.html provides my bio and past client list. http://www.bydesign.com/powervision/Mathematics_Philosophy_Science/ presents some of my own research on information structure and dynamics. -------------- next part -------------- An HTML attachment was scrubbed... URL: From dwojick at HUGHES.NET Sat Jun 28 12:55:52 2008 From: dwojick at HUGHES.NET (David E. Wojick) Date: Sat, 28 Jun 2008 12:55:52 -0400 Subject: The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication In-Reply-To: <001701c8d912$09b5fea0$6402a8c0@loet> Message-ID: Dear Loet, my point is that most of the knowledge in the knowledge based economy is not scientific knowledge. I take you to be arguing that science is becoming, or has become, the third coordinating mechanism in society, to rival economic activity and government control. If that is indeed your claim then I disagree. If you are merely saying that there are cases where science is important then we agree completely. I would say that the role of science in the knowledge revolution is like its role in the industrial revolution, important but by no means the driving force. Moreover, the impact of science is not by means of the flow of scientific knowledge (or code of communication). Scientific knowledge is used to produce technology and it is the diffusion of this technology whereby the impact of science occurs. This is why the impact is so hard to trace and measure, the science does not flow with the technology. It is my understanding that this group is mostly interested in the impact of science on science, but the impact of science on the knowlede economy seems like a closely related topic. However, for the reasons described above it probably requires different mehods of analysis. Products do not carry citations, would that they did. In some cases patents provide the middle ground and we are trying to link patents back to basic research so as to tie the science to the technology. Progress is slow. Best regards, David From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at listserv.utk.edu] On Behalf Of David Wojick Sent: Saturday, June 28, 2008 12:55 PM To: SIGMETRICS at listserv.utk.edu Subject: Re: [SIGMETRICS] The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication Dear Loet, The difficulty is not abstraction (my field is applied philosophy and logic), it is specialized language. Key technical concepts like "code of communication" and "coordination mechanism" are not explained. Plus you seem to be using "knowledge" (your central concept) in a special way. In analytical philosophy knowledge is generally defined as something like true belief. You seem to be refering to codified scientific knowledge, but you do not say that. Do patents represent knowledge, as you are using that term, or just practice? It seems to me that I focus on codified scientific knowledge and say that repeatingly throughout the paper. Indeed, there is a difference between considering knowledge as "true belief" of individuals versus considering scientific knowledge as a system of rationalized expectations. But you seem to have missed my main point. I work at the intersection of government control, industry and science. I do not see science as becoming a third coordination mechanism (with the exception of climate science), which I take to be your central thesis. (Correct me if I am wrong.). I agree that climate change would be a beautiful case, but I gave the example of the stem-cell debate as another one where scientific arguments, political discourse, and economic considerations interact and make the issues structurally complex. But this is an empirical question about which we have almost no knowledge, and desperately need some. So I am wondering why you think science is becoming the third coordination mechanism? My research question was to explain the "knowledge-based economy". How can an economy be based on knowledge instead of agriculture, industries, and services? My suggestion is that the functional differentiation of the codes of communication which is historically to be placed in the time of the reformation and the Scientific Revolution, has led to complex interactions among social coordination mechanism which first generated political economies in the period 1780-1870, and that these political economies then began to compete in another dimension of the system for systematic innovations. This is extensively explained in the paper. Thus, I use a functionalist-structuralist model for the explanation, but this is also explained in the paper. I am sorry if it does not communicate. (Perhaps, we should take this discussion therefore off-line.) Best wishes, Loet My greatest regards, David Jun 28, 2008 04:24:37 AM, SIGMETRICS at LISTSERV.UTK.EDU wrote: Dear David, This abstract and the paper are written in a technical language (or code?) that I barely understand, so I may be off the mark. (A nontechnical version would be most useful). But I have two related observations. Indeed, this text is difficult to read because of the level of abstraction. (It was not meant to be empirical.) 1. Technological innovation and science are two different domains and only loosely coupled. Most innovation is part of economic activity, not science. I therefore question whether scientific discourse has in fact become a coordination mechanism at the social system level. But scientific knowledge diffusion beyond science is largely invisible, precisely because it is diffuse, so I may be wrong. There is a lot of innovation going on in the economy which is not knowledge-based, but practice-based. 2. Conversely, there is an historic activity in progress whereby scientific discourse and political control are in direct communication. This is the climate change debate. I have been studying this debate for many years and it is unprecedented. The latest scientific findings are circulated and debated in real time in the US Congress and in the national press. The Internet is playing a leading role. The economic implications and proposals are staggering. This might be an exemplar of your coordination mechanism model, but it is not about economic or technological innovation, it is about science and public policy. I did not work on this, but on the issue of "stem-cell research". You may find the methodology useful: Loet Leydesdorff & Iina Hellsten, Metaphors and Diaphors in Science Communication: Mapping the Case of 'Stem-Cell Research', Science Communication 27(1), 2005, 64-99. <pdf-version> With best wishes, Loet With best regards, David Wojick The Knowledge-Based Economy: The Potentially Globalizing and Self-Organizing Dynamics of Interactions among Differently Codified Systems of Communication Alongside economic exchange relations and political control, the organization of codified knowledge in scientific discourses has become increasingly a third coordination mechanism at the level of the social system. When three coordination mechanisms interact, one can expect the resulting dynamics to be complex and self-organizing. Each coordination mechanism is specific in terms of its code of communication. For example, "energy" has a meaning in physics very different from its meaning in the economy or for policy-makers. In addition to providing the communications with functionally different meanings, the codes can be symbolically generalized, and then meaning can be globalized. Symbolically generalized codes of communication can be expected to span competing horizons of meaning that 'self-organize' given historical conditions. From this perspective, the historical organization of meaning-for example, in discourses-can be considered as instantiations or retention mechanisms. In other words, meaning can further be codified in communication flows. Knowledge, for example, can be considered as a meaning which makes a difference. In the case of discursive knowledge, this difference is defined with reference to a code in the communication. When discursive knowledge is socially organized (e.g., as R&D) its dynamics can increasingly compete with other social coordination mechanisms in the construction and reproduction of a knowledge-based order. <pdf-version> Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ Visiting Professor 2007-2010, ISTIC, Beijing; Honorary Fellow 2007-2010, SPRU, University of Sussex Now available: The Knowledge-Based Economy: Modeled, Measured, Simulated, 385 pp.; US$ 18.95; The Self-Organization of the Knowledge-Based Society ; The Challenge of Scientometrics -- "David E. Wojick, PhD" Senior Consultant for Innovation Office of Scientific and Technical Information US Department of Energy http://www.osti.gov/innovation/ 391 Flickertail Lane, Star Tannery, VA 22654 USA 540-858-3136 http://www.bydesign.com/powervision/resume.html provides my bio and past client list. http://www.bydesign.com/powervision/Mathematics_Philosophy_Science/ presents some of my own research on information structure and dynamics. -------------- next part -------------- An HTML attachment was scrubbed... URL: From loet at LEYDESDORFF.NET Sun Jun 29 02:47:56 2008 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Sun, 29 Jun 2008 08:47:56 +0200 Subject: The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication In-Reply-To: Message-ID: _____ From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at listserv.utk.edu] On Behalf Of David E. Wojick Sent: Saturday, June 28, 2008 6:56 PM To: SIGMETRICS at listserv.utk.edu Subject: Re: [SIGMETRICS] The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication Dear Loet, my point is that most of the knowledge in the knowledge based economy is not scientific knowledge. I take you to be arguing that science is becoming, or has become, the third coordinating mechanism in society, to rival economic activity and government control. If that is indeed your claim then I disagree. If you are merely saying that there are cases where science is important then we agree completely. I would say that the role of science in the knowledge revolution is like its role in the industrial revolution, important but by no means the driving force. Dear David, You may wish to believe so, but this seems to me an empirical question. In my opinion, one can expect differences among sectors and nations (regions) in the extent to which the economy is still essentially a political economy absorbing knowledge (e.g., via patents) at an increasing speed or a knowledge-based economy. One can only investigate this question if organized knowledge production and control is declared in the model as an independent variable. The model specification has to be theoretically informed. I did not provide empirical results in the paper under discussion. With best wishes, Loet Moreover, the impact of science is not by means of the flow of scientific knowledge (or code of communication). Scientific knowledge is used to produce technology and it is the diffusion of this technology whereby the impact of science occurs. This is why the impact is so hard to trace and measure, the science does not flow with the technology. It is my understanding that this group is mostly interested in the impact of science on science, but the impact of science on the knowlede economy seems like a closely related topic. However, for the reasons described above it probably requires different mehods of analysis. Products do not carry citations, would that they did. In some cases patents provide the middle ground and we are trying to link patents back to basic research so as to tie the science to the technology. Progress is slow. Best regards, David _____ From: ASIS&T Special Interest Group on Metrics [mailto:SIGMETRICS at listserv.utk.edu] On Behalf Of David Wojick Sent: Saturday, June 28, 2008 12:55 PM To: SIGMETRICS at listserv.utk.edu Subject: Re: [SIGMETRICS] The Knowledge-Based Economy: Globalization and Self-Organization in the Dynamics of Communication Dear Loet, The difficulty is not abstraction (my field is applied philosophy and logic), it is specialized language. Key technical concepts like "code of communication" and "coordination mechanism" are not explained. Plus you seem to be using "knowledge" (your central concept) in a special way. In analytical philosophy knowledge is generally defined as something like true belief. You seem to be refering to codified scientific knowledge, but you do not say that. Do patents represent knowledge, as you are using that term, or just practice? It seems to me that I focus on codified scientific knowledge and say that repeatingly throughout the paper. Indeed, there is a difference between considering knowledge as "true belief" of individuals versus considering scientific knowledge as a system of rationalized expectations. But you seem to have missed my main point. I work at the intersection of government control, industry and science. I do not see science as becoming a third coordination mechanism (with the exception of climate science), which I take to be your central thesis. (Correct me if I am wrong.). I agree that climate change would be a beautiful case, but I gave the example of the stem-cell debate as another one where scientific arguments, political discourse, and economic considerations interact and make the issues structurally complex. But this is an empirical question about which we have almost no knowledge, and desperately need some. So I am wondering why you think science is becoming the third coordination mechanism? My research question was to explain the "knowledge-based economy". How can an economy be based on knowledge instead of agriculture, industries, and services? My suggestion is that the functional differentiation of the codes of communication which is historically to be placed in the time of the reformation and the Scientific Revolution, has led to complex interactions among social coordination mechanism which first generated political economies in the period 1780-1870, and that these political economies then began to compete in another dimension of the system for systematic innovations. This is extensively explained in the paper. Thus, I use a functionalist-structuralist model for the explanation, but this is also explained in the paper. I am sorry if it does not communicate. (Perhaps, we should take this discussion therefore off-line.) Best wishes, Loet My greatest regards, David Jun 28, 2008 04:24:37 AM, SIGMETRICS at LISTSERV.UTK.EDU wrote: Dear David, This abstract and the paper are written in a technical language (or code?) that I barely understand, so I may be off the mark. (A nontechnical version would be most useful). But I have two related observations. Indeed, this text is difficult to read because of the level of abstraction. (It was not meant to be empirical.) 1. Technological innovation and science are two different domains and only loosely coupled. Most innovation is part of economic activity, not science. I therefore question whether scientific discourse has in fact become a coordination mechanism at the social system level. But scientific knowledge diffusion beyond science is largely invisible, precisely because it is diffuse, so I may be wrong. There is a lot of innovation going on in the economy which is not knowledge-based, but practice-based. 2. Conversely, there is an historic activity in progress whereby scientific discourse and political control are in direct communication. This is the climate change debate. I have been studying this debate for many years and it is unprecedented. The latest scientific findings are circulated and debated in real time in the US Congress and in the national press. The Internet is playing a leading role. The economic implications and proposals are staggering. This might be an exemplar of your coordination mechanism model, but it is not about economic or technological innovation, it is about science and public policy. I did not work on this, but on the issue of "stem-cell research". You may find the methodology useful: Loet Leydesdorff & Iina Hellsten, Metaphors and Diaphors in Science Communication: Mapping the Case of 'Stem-Cell Research', Science Communication 27(1), 2005, 64-99. > With best wishes, Loet With best regards, David Wojick The Knowledge-Based Economy: The Potentially Globalizing and Self-Organizing Dynamics of Interactions among Differently Codified Systems of Communication Alongside economic exchange relations and political control, the organization of codified knowledge in scientific discourses has become increasingly a third coordination mechanism at the level of the social system. When three coordination mechanisms interact, one can expect the resulting dynamics to be complex and self-organizing. Each coordination mechanism is specific in terms of its code of communication. For example, "energy" has a meaning in physics very different from its meaning in the economy or for policy-makers. In addition to providing the communications with functionally different meanings, the codes can be symbolically generalized, and then meaning can be globalized. Symbolically generalized codes of communication can be expected to span competing horizons of meaning that 'self-organize' given historical conditions. From this perspective, the historical organization of meaning-for example, in discourses-can be considered as instantiations or retention mechanisms. In other words, meaning can further be codified in communication flows. Knowledge, for example, can be considered as a meaning which makes a difference. In the case of discursive knowledge, this difference is defined with reference to a code in the communication. When discursive knowledge is socially organized (e.g., as R&D) its dynamics can increasingly compete with other social coordination mechanisms in the construction and reproduction of a knowledge-based order. > _____ Loet Leydesdorff Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam loet at leydesdorff.net ; http://www.leydesdorff.net/ Visiting Professor 2007-2010, ISTIC, Beijing; Honorary Fellow 2007-2010, SPRU, University of Sussex Now available: The Knowledge-Based Economy: Modeled, Measured, Simulated, 385 pp.; US$ 18.95; The Self-Organization of the Knowledge-Based Society ; The Challenge of Scientometrics -- "David E. Wojick, PhD" Senior Consultant for Innovation Office of Scientific and Technical Information US Department of Energy http://www.osti.gov/innovation/ 391 Flickertail Lane, Star Tannery, VA 22654 USA 540-858-3136 http://www.bydesign.com/powervision/resume.html provides my bio and past client list. http://www.bydesign.com/powervision/Mathematics_Philosophy_Science/ presents some of my own research on information structure and dynamics. -------------- next part -------------- An HTML attachment was scrubbed... URL: From garfield at CODEX.CIS.UPENN.EDU Mon Jun 30 13:01:08 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 30 Jun 2008 13:01:08 -0400 Subject: Celayir, S; Sander, S; Ellicevik, M; Vural, A; Celayir, AC The most commonly cited articles in Pediatric Surgical Journals EUROPEAN JOURNAL OF PEDIATRIC SURGERY, 18 (3): 160-163 JUN 2008 Message-ID: E-mail Address: scelayir at istanbul.edu.tr Author(s): Celayir, S (Celayir, S.); Sander, S (Sander, S.); Ellicevik, M (Ellicevik, M.); Vural, A (Vural, A.); Celayir, AC (Celayir, A. C.) Title: The most commonly cited articles in Pediatric Surgical Journals Source: EUROPEAN JOURNAL OF PEDIATRIC SURGERY, 18 (3): 160-163 JUN 2008 Language: English Document Type: Article Author Keywords: citation; impact factor; pediatric surgery; journal Keywords Plus: 100 CITATION-CLASSICS; ASSOCIATION; BIAS Abstract: Aim: This study aimed to investigate the characteristics of the most frequently cited articles published in 3 main journals dedicated to the field of pediatric surgery (journal of Pediatric Surgery, Pediatric Surgery International and European journal of Pediatric Surgery). Material and Methods: A search was initiated using the database (1985 - 2006) of the Science Citation Index of the Institute for Scientific Information. The total number of publications and their citation numbers were found and the most cited articles were investigated in detail. A total of 600 (200 from each journal) most cited articles were identified and chosen for further analysis. Results: The total number of citations in these 3 journals was 20271. The citations of the most cited articles ranged from 10 to 224. The articles were published between 1985 and 2003 and the mean number of citations/article was 33.78. Articles originated from 39 counties and 256 institutions. The leading countries were the United States (203 articles from 75 institutions), Germany (50 articles from 21 institutions), Japan (34 articles from 17 institutions), Switzerland (34 articles from 8 institutions), United Kingdom (32 articles from 19 institutions), and Canada (28 articles from 7 institutions). Of the institutions with the highest number of cited articles, four institutions were from the USA followed by Switzerland with two institutions. The leading topics were the gastrointestinal system (n=239), respiratory system (n=94), urology (n=61) and oncology (n=56), and diaphragmatic hernia (n=41) was the most common special topic. There were 42 case reports (7%) and 75 experimental research articles (12.5%). Thirty-four authors from 14 countries and 30 institutions had articles in more than one journal. The most cited author was N. S. Adzick from the USA with 224 citations. Conclusion: In this study, we found that the journal of Pediatric Surgery predominated with the greatest number of cited articles. The most cited articles, authors and institutions originated from the USA and English- speaking countries. The gastrointestinal system, respiratory system, urology and oncology were the leading topics and diaphragmatic hernia was the most common special topic. Addresses: Istanbul Uni Cerrahpasa Med Fac, Dept Pediat Surg, TR-34303 Istanbul, Turkey; Bakirkoy Maternal & Child Hosp, Dept Pediat Surg, Istanbul, Turkey; Zeynep Kamil Maternal & Child Hosp, Istanbul, Turkey Reprint Address: Celayir, S, Istanbul Uni Cerrahpasa Med Fac, Dept Pediat Surg, TR-34303 Istanbul, Turkey. E-mail Address: scelayir at istanbul.edu.tr Cited Reference Count: 12 Times Cited: 0 Publisher: GEORG THIEME VERLAG KG Publisher Address: RUDIGERSTR 14, D-70469 STUTTGART, GERMANY ISSN: 0939-7248 29-char Source Abbrev.: EUR J PEDIATR SURG ISO Source Abbrev.: Eur. J. Pediatr. Surg. Source Item Page Count: 4 Subject Category: Pediatrics; Surgery ISI Document Delivery No.: 307IV CALLAHAM M Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 287 : 2847 2002 CAMPBELL FM NATIONAL BIAS - A COMPARISON OF CITATION PRACTICES BY HEALTH-PROFESSIONALS BULLETIN OF THE MEDICAL LIBRARY ASSOCIATION 78 : 376 1990 DUBIN D CITATION-CLASSICS IN CLINICAL DERMATOLOGICAL JOURNALS - CITATION ANALYSIS, BIOMEDICAL JOURNALS, AND LANDMARK ARTICLES, 1945-1990 ARCHIVES OF DERMATOLOGY 129 : 1121 1993 GARFIELD E 100 CITATION-CLASSICS FROM THE JOURNAL-OF-THE-AMERICAN-MEDICAL-ASSOCIATION JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 257 : 52 1987 LEE KP Association of journal quality indicators with methodological quality of clinical research articles JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 287 : 2805 2002 LIN AM JAMA-J AM MED ASSOC 280 : 246 1998 NIEMINEN P BMC MED RES METHODOL 6 : 42 2006 PALADUGU R One hundred citation classics in general surgical journals WORLD JOURNAL OF SURGERY 26 : 1099 DOI 10.1007/s00268-002-6376-7 2002 PICKNETT T J MOL BIOL 293 : 171 1999 SCHEIN M Where can surgeons publish? BRITISH JOURNAL OF SURGERY 87 : 261 2000 SCHEIN M CURR SURG 57 : 252 2000 WEALE AR BMC MED RES METHODOL 4 : 14 2004 From garfield at CODEX.CIS.UPENN.EDU Mon Jun 30 14:27:19 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 30 Jun 2008 14:27:19 -0400 Subject: Yeo, TK (Yeo, Tun Kuan); Eong, KGA (Eong, Kah-Guan Au) The 100 most frequently cited articles in ophthalmology journals: Another perspective ARCHIVES OF OPHTHALMOLOGY, 126 (6): 873-874 JUN 2008 Message-ID: E-mail Address: tun.kuan.yeo at nathealthgroup.com Author(s): Yeo, TK (Yeo, Tun Kuan); Eong, KGA (Eong, Kah-Guan Au) Title: The 100 most frequently cited articles in ophthalmology journals: Another perspective Source: ARCHIVES OF OPHTHALMOLOGY, 126 (6): 873-874 JUN 2008 Language: English Document Type: Editorial Material Reprint Address: Yeo, TK, Alexandra Hosp, Dept Ophthalmol & Visual Sci, 378 Alexandra Rd, Singapore 159964, Singapore. E-mail Address: tun.kuan.yeo at nathealthgroup.com Cited Reference Count: 2 Times Cited: 0 Publisher: AMER MEDICAL ASSOC Publisher Address: 515 N STATE ST, CHICAGO, IL 60610-0946 USA ISSN: 0003-9950 29-char Source Abbrev.: ARCH OPHTHALMOL ISO Source Abbrev.: Arch. Ophthalmol. Source Item Page Count: 2 Subject Category: Ophthalmology ISI Document Delivery No.: 310RX *NEW FACE RES THOMS SCI ISI WEB KN : 2007 OHBA N The 100 most frequently cited articles in ophthalmology journals ARCHIVES OF OPHTHALMOLOGY 125 : 952 2007 From garfield at CODEX.CIS.UPENN.EDU Mon Jun 30 14:33:39 2008 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 30 Jun 2008 14:33:39 -0400 Subject: Obha, N (Obha, Norio) The 100 most frequently cited articles in ophthalmology journals: Another perspective - In reply ARCHIVES OF OPHTHALMOLOGY, 126 (6): 874-875 JUN 2008 Message-ID: E-mail Address: ohbanm at gctv.ne.jp Author(s): Obha, N (Obha, Norio) Title: The 100 most frequently cited articles in ophthalmology journals: Another perspective - In reply Source: ARCHIVES OF OPHTHALMOLOGY, 126 (6): 874-875 JUN 2008 Language: English Document Type: Editorial Material Reprint Address: Obha, N, Aichi Shukutoku Univ, Fac Med Welfare, Asahigaoka 109-3 Minamisakaemachi, Owariasahishi, Aichiken 4880046, Japan. E-mail Address: ohbanm at gctv.ne.jp Cited Reference Count: 5 Times Cited: 0 Publisher: AMER MEDICAL ASSOC Publisher Address: 515 N STATE ST, CHICAGO, IL 60610-0946 USA ISSN: 0003-9950 29-char Source Abbrev.: ARCH OPHTHALMOL ISO Source Abbrev.: Arch. Ophthalmol. Source Item Page Count: 4 Subject Category: Ophthalmology ISI Document Delivery No.: 310RX *THOMS SCI INF WEB SCI WEB SIT : 2007 BEHCET H Reduced aphtose using a virus-originated cancer in mouth, eyes and genitals DERMATOLOGISCHE WOCHENSCHRIFT 105 : 1152 1937 GREGG NM Congenital cataract following German measles in the mother TRANSACTIONS OF THE OPHTHALMOLOGICAL SOCIETY OF AUSTRALIA 3 : 35 1941 JACSO P As we may search - Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases CURRENT SCIENCE 89 : 1537 2005 OHBA N The 100 most frequently cited articles in ophthalmology journals ARCHIVES OF OPHTHALMOLOGY 125 : 952 2007