From kboyack at MAPOFSCIENCE.COM Wed Apr 1 15:35:47 2009 From: kboyack at MAPOFSCIENCE.COM (Kevin Boyack) Date: Wed, 1 Apr 2009 13:35:47 -0600 Subject: Announcement of workshop on using science maps to teach science at ISSI 2009 In-Reply-To: Message-ID: Dear Colleagues, We will be hosting a half-day workshop at the ISSI 2009 (http://www.issi2009.org/php/index.php) meeting in Rio entitled "Using Maps of Science to Teach Science". The formal call for papers/presentations is attached. The workshop will be during the afternoon of July 14, 2009. We welcome submissions of short papers as specified in the call, and look forward to seeing many of you in Rio this summer. Best regards, Kevin Kevin Boyack SciTech Strategies, Inc. www.mapofscience.com -------------- next part -------------- A non-text attachment was scrubbed... Name: ISSI_wkshp_teaching.pdf Type: application/pdf Size: 23051 bytes Desc: not available URL: From garfield at CODEX.CIS.UPENN.EDU Thu Apr 2 13:50:03 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 2 Apr 2009 13:50:03 -0400 Subject: Alzheimer's disease research: scientific productivity and impact of the top 100 investigators in the field. Sorensen, Aaron A J Alzheimers Dis 16 (3) : 451-65 2009 Mar Message-ID: URL: http://iospress.metapress.com/content/v932x18k23300844/fulltext.pdf Email Address:sorensen at collexis.com PubMed ID: 19221406 Publication Type: Journal Article Title: Alzheimer's disease research: scientific productivity and impact of the top 100 investigators in the field. Author(s): Sorensen, Aaron A Source: J Alzheimers Dis 16 (3) : 451-65 2009 Mar Language: English Abstract: The online availability of scientific-literature databases and natural-language-processing (NLP) algorithms has enabled large-scale bibliometric studies within the field of scientometrics. Using NLP techniques and Thomson ISI reports, an initial analysis of the role of Alzheimer's disease (AD) within the neurosciences as well as a summary of the various research foci within the AD scientific community are presented. Citation analyses and productivity filters are applied to post- 1984, AD-specific subsets of the PubMed and Thomson ISI Web-of-Science literature bases to algorithmically identify a pool of the top AD researchers. From the initial pool of AD investigators, top-100 rankings are compiled to assess productivity and impact. One of the impact and productivity metrics employed is an AD-specific H-index. Within the AD- specific H-index ranking, there are many cases of multiple AD investigators with similar or identical H-indices. In order to facilitate differentiation among investigators with equal or near-equal H indices, two derivatives of the H-index are proposed: the Second-Tier H-index and the Scientific Following H-index. Winners of two prestigious AD-research awards are highlighted, membership to the Institute of Medicine of the US National Academy of Sciences is acknowledged, and an analysis of highly- productive, high-impact, AD-research collaborations is presented. Address: Collexis Holdings, Inc., Life Science Solutions Leader, Europe, Via Bramantino 1, 6600 Locarno, Switzerland. Citation Subset: Index Medicus ISSN: 1387-2877 NLM Unique ID: 9814863 Country: Netherlands Date Created: 12 Mar 2009 From garfield at CODEX.CIS.UPENN.EDU Thu Apr 2 14:27:27 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 2 Apr 2009 14:27:27 -0400 Subject: Shibata, N; et al Comparative Study on Methods of Detecting Research Fronts Using Different Types of Citation JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 60 (3): 571-580 MAR 2009 Message-ID: E-mail Address: shibata at biz-model.t.u-tokyo.ac.jp; kaji at biz-model.t.u- tokyo.ac.jp; takeda at biz-model.t.u-tokyo.ac.jp; matsushima at iijmio-mail.jp Author(s): Shibata, N (Shibata, Naoki); Kajikawa, Y (Kajikawa, Yuya); Takeda, Y (Takeda, Yoshiyuki); Matsushima, K (Matsushima, Katsumori) Title: Comparative Study on Methods of Detecting Research Fronts Using Different Types of Citation Source: JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 60 (3): 571-580 MAR 2009 Language: English Document Type: Article KeyWords Plus: SCIENTIFIC PAPERS; NETWORKS; SCIENCE; COCITATION; INTERDISCIPLINARITY; SPECIALTIES; RETRIEVAL; DOCUMENTS; JOURNALS; TRACKING Abstract: In this article, we performed a comparative study to investigate the performance of methods for detecting emerging research fronts. Three types of citation network, co-citation, bibliographic coupling, and direct citation, were tested in three research domains, gallium nitride (GaN), complex network (CNW), and carbon nanotube (CNT). Three types of citation network were constructed for each research domain, and the papers in those domains were divided into clusters to detect the research front. We evaluated the performance of each type of citation network in detecting a research front by using the following measures of papers in the cluster: visibility, measured by normalized cluster size, speed, measured by average publication year, and topological relevance, measured by density. Direct citation, which could detect large and young emerging clusters earlier, shows the best performance in detecting a research front, and co- citation shows the worst. Additionally, in direct citation networks, the clustering coefficient was the largest, which suggests that the content similarity of papers connected by direct citations is the greatest and that direct citation networks have the least risk of missing emerging research domains because core papers are included in the largest component. Addresses: [Shibata, Naoki; Kajikawa, Yuya; Takeda, Yoshiyuki; Matsushima, Katsumori] Univ Tokyo, Inst Engn Innovat, Sch Engn, Bunkyo Ku, Tokyo 1138656, Japan Reprint Address: Shibata, N, Univ Tokyo, Inst Engn Innovat, Sch Engn, Bunkyo Ku, 2-11-16 Yayoi, Tokyo 1138656, Japan. E-mail Address: shibata at biz-model.t.u-tokyo.ac.jp; kaji at biz-model.t.u- tokyo.ac.jp; takeda at biz-model.t.u-tokyo.ac.jp; matsushima at iijmio-mail.jp Cited Reference Count: 26 Times Cited: 0 Publisher: JOHN WILEY & SONS INC Publisher Address: 111 RIVER ST, HOBOKEN, NJ 07030 USA ISSN: 1532-2882 DOI: 10.1002/asi.20994 29-char Source Abbrev.: J AM SOC INF SCI TECHNOL ISO Source Abbrev.: J. Am. Soc. Inf. Sci. Technol. Source Item Page Count: 10 Subject Category: Computer Science, Information Systems; Information Science & Library Science ISI Document Delivery No.: 415LK ADAMS J Early citation counts correlate with accumulated impact SCIENTOMETRICS 63 : 567 DOI 10.1007/s11192-005-0228-9 2005 BRAAM RR MAPPING OF SCIENCE BY COMBINED COCITATION AND WORD ANALYSIS .1. STRUCTURAL ASPECTS JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 42 : 233 1991 BRAUN T No-bells for ambiguous lists of ranked Nobelists as science indicators of national merit in physics, chemistry and medicine, 1901-2001 SCIENTOMETRICS 56 : 3 2003 CHEN C P SPIE IS T VISUALIZ : 63 2005 EGGHE L Co-citation, bibliographic coupling and a characterization of lattice citation networks SCIENTOMETRICS 55 : 349 2002 FANG Y Lattices in citation networks: An investigation into the structure of citation graphs SCIENTOMETRICS 50 : 273 2001 GARFIELD E Historiographic mapping of knowledge domains literature JOURNAL OF INFORMATION SCIENCE 30 : 119 DOI 10.1177/0165551504042802 2004 GARFIELD E CITATION ANALYSIS AS A TOOL IN JOURNAL EVALUATION - JOURNALS CAN BE RANKED BY FREQUENCY AND IMPACT OF CITATIONS FOR SCIENCE POLICY STUDIES SCIENCE 178 : 471 1972 HOPCROFT J Tracking evolving communities in large linked networks PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 101 : 5249 DOI 10.1073/pnas.0307750100 2004 KARAZIJA R The Nobel prize in physics - regularities and tendencies SCIENTOMETRICS 61 : 191 2004 KESSLER MM BIBLIOGRAPHIC COUPLING BETWEEN SCIENTIFIC PAPERS AMERICAN DOCUMENTATION 14 : 10 1963 KLAVANS R Identifying a better measure of relatedness for mapping science JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 57 : 251 DOI 10.1002/asi.20274 2006 KOSTOFF RN Database tomography for information retrieval JOURNAL OF INFORMATION SCIENCE 23 : 301 1997 LEYDESDORFF L Betweenness centrality as an indicator of the interdisciplinarity of scientific journals JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 1303 DOI 10.1002/asi.20614 2007 LEYDESDORFF L Mapping interdisciplinarity at the interfaces between the science citation index and the social science citation index SCIENTOMETRICS 71 : 391 DOI 10.1007/s11192-007-1694-z 2007 NEWMAN MEJ Fast algorithm for detecting community structure in networks PHYSICAL REVIEW E 69 : 6133 2004 PRICE DJD NETWORKS OF SCIENTIFIC PAPERS SCIENCE 149 : 510 1965 SCHIMINOVICH S AUTOMATIC CLASSIFICATION AND RETRIEVAL OF DOCUMENTS BY MEANS OF A BIBLIOGRAPHIC PATTERN DISCOVERY ALGORITHM INFORMATION STORAGE AND RETRIEVAL 6 : 417 1971 SHIBATA N Topological analysis of citation networks to discover the future core articles JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 872 DOI 10.1002/asi.20529 2007 SHIBATA N Detecting emerging research fronts based on topological measures in citation networks of scientific publications TECHNOVATION 28 : 758 DOI 10.1016/j.technovation.2008.03.009 2008 SMALL H COCITATION IN SCIENTIFIC LITERATURE - NEW MEASURE OF RELATIONSHIP BETWEEN 2 DOCUMENTS JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 24 : 265 1973 SMALL H STRUCTURE OF SCIENTIFIC LITERATURES .1. IDENTIFYING AND GRAPHING SPECIALTIES SCIENCE STUDIES 4 : 17 1974 SMALL H Tracking and predicting growth areas in science SCIENTOMETRICS 68 : 595 DOI 10.1007/s11192-006-0132-y 2006 SMALL H Update on science mapping: Creating large document spaces SCIENTOMETRICS 38 : 275 1997 VANDENBESSELAAR P Mapping change in scientific specialties: A scientometric reconstruction of the development of artificial intelligence JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 47 : 415 1996 WATTS DJ Collective dynamics of 'small-world' networks NATURE 393 : 440 1998 From garfield at CODEX.CIS.UPENN.EDU Thu Apr 2 15:08:52 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 2 Apr 2009 15:08:52 -0400 Subject: Satcher, MJ; Litton, AG; Waterbor, JW; Brooks, CM (Brooks, C. Michael) The Journal of Cancer Education: A Retrospective Review of Quality Indicators JOURNAL OF CANCER EDUCATION, 24 (1): 16-21 2009 Message-ID: E-mail Address: mbrooks at uab.edu Author(s): Satcher, MJ (Satcher, Matthew J.); Litton, AG (Litton, Allison G.); Waterbor, JW (Waterbor, John W.); Brooks, CM (Brooks, C. Michael) Title: The Journal of Cancer Education: A Retrospective Review of Quality Indicators Source: JOURNAL OF CANCER EDUCATION, 24 (1): 16-21 2009 Language: English Document Type: Editorial Material KeyWords Plus: IMPACT FACTOR; PUBLIC-HEALTH Abstract: The JCE publication history exceeds 600 peer reviewed cancer education articles. Two methodological approaches were used for a retrospective perspective of JCE quality: Journal Impact Factor (JIF) and Citation Analysis (CA). The Journal Impact Factor comparison included only medical or health journals with an educational focus. Citation Analysis was conducted to identify attributes of most cited JCE articles and their cancer education focus. Despite concerns in the literature about the merits of both methods, results provided useful insights about JCE quality. Results will guide quality improvement plans and assist authors interested in publishing their cancer education research results in the JCE. Addresses: [Brooks, C. Michael] Univ Alabama, Sch Hlth Profess, Birmingham, AL 35294 USA; [Brooks, C. Michael] Univ Alabama, Off UAB Provost, Birmingham, AL 35294 USA; [Satcher, Matthew J.] Univ Alabama, Sch Med, Birmingham, AL 35294 USA; [Litton, Allison G.; Waterbor, John W.] Univ Alabama, Sch Publ Hlth, Birmingham, AL 35294 USA Reprint Address: Brooks, CM, Univ Alabama, Sch Hlth Profess, 933 19th St S,CHSB 19,Room 302, Birmingham, AL 35294 USA. E-mail Address: mbrooks at uab.edu Cited Reference Count: 24 Times Cited: 0 Publisher: LAWRENCE ERLBAUM ASSOC INC-TAYLOR & FRANCIS Publisher Address: 325 CHESTNUT STREET, STE 800, PHILADELPHIA, PA 19106 USA ISSN: 0885-8195 DOI: 10.1080/08858190802665153 29-char Source Abbrev.: J CANCER EDUC ISO Source Abbrev.: J. Cancer Educ. Source Item Page Count: 6 Subject Category: Oncology; Medical Informatics ISI Document Delivery No.: 414OJ ADAM D The counting house NATURE 415 : 726 2002 BAILE WF J CANCER EDUC 12 : 166 1997 BARBOUR V The impact of open access upon public health BULLETIN OF THE WORLD HEALTH ORGANIZATION 84 : 339 2006 BENOS DJ Ethics and scientific publication ADVANCES IN PHYSIOLOGY EDUCATION 29 : 59 DOI 10.1152/advan.00056.2004 2005 BROWNSTEIN JN J CANCER EDUC 7 : 321 1992 BULLER MK J CANCER EDUC 9 : 155 1994 CHAITCHIK S J CANCER EDUC 7 : 41 1992 CHEEK J What's in a number? Issues in providing evidence of impact and quality of research(ers) QUALITATIVE HEALTH RESEARCH 16 : 423 DOI 10.1177/1049732305285701 2006 COLEMAN R Impact factors: Use and abuse in biomedical research ANATOMICAL RECORD 257 : 54 1999 COYNE CA J CANCER EDUC 7 : 293 1992 EYSENBACH G Citation advantage of open access articles PLOS BIOLOGY 4 : 692 ARTN e157 2006 FRANKS AL Assessing prevention research impact - A bibliometric analysis AMERICAN JOURNAL OF PREVENTIVE MEDICINE 30 : 211 DOI 10.1016/j.amepre.2005.10.025 2006 FRIEDMAN LC J CANCER EDUC 10 : 213 1995 GARFIELD E The history and meaning of the journal impact factor JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 295 : 90 2006 KURMIS AP Current concepts review - Understanding the limitations of the journal impact factor JOURNAL OF BONE AND JOINT SURGERY-AMERICAN VOLUME 85 : 2449 2003 LOPEZABENTE G Time trends in the impact factor of Public Health journals BMC PUBLIC HEALTH 5 : ARTN 24 2005 MICHIELUTTE R J CANCER EDUC 7 : 251 1992 PHAM CT J CANCER EDUC 7 : 305 1992 PRICE JH Journal impact factor: Bibliometrics and the Journal of School Health JOURNAL OF SCHOOL HEALTH 76 : 123 2006 SIMS JL Citation analysis and journal impact factors in ophthalmology and vision science journals CLINICAL AND EXPERIMENTAL OPHTHALMOLOGY 31 : 14 2003 SLENKER SE J CANCER EDUC 4 : 61 1989 VAKIL N The journal impact factor: Judging a book by its cover AMERICAN JOURNAL OF GASTROENTEROLOGY 100 : 2436 DOI 10.1111/j.1572- 0241.2005.00324.x 2005 VONELM E Different patterns of duplicate publication - An analysis of articles used in systematic reviews JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 291 : 974 2004 YANCEY AK J CANCER EDUC 9 : 46 1994 From garfield at CODEX.CIS.UPENN.EDU Thu Apr 2 15:33:44 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Thu, 2 Apr 2009 15:33:44 -0400 Subject: Jefferson, T; et al Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review BRITISH MEDICAL JOURNAL, 338: Art. No. b354 FEB 12 2009 Message-ID: E-mail Address: jefferson.tom at gmail.com Author(s): Jefferson, T (Jefferson, T.); Di Pietrantonj, C (Di Pietrantonj, C.); Debalini, MG (Debalini, M. G.); Rivetti, A (Rivetti, A.); Demicheli, V (Demicheli, V.) Title: Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review Source: BRITISH MEDICAL JOURNAL, 338: Art. No. b354 FEB 12 2009 Language: English Document Type: Review KeyWords Plus: INFORMATION-SEEKING BEHAVIOR; CONFLICTS-OF-INTEREST; ELDERLY-PEOPLE; DRUG TRIALS; VACCINATION; ASSOCIATION; CARE; CONCLUSIONS; MORTALITY; BENEFITS Abstract: Objective To explore the relation between study concordance, take home message, funding, and dissemination of comparative studies assessing the effects of influenza vaccines. Design Systematic review without meta-analysis. Data extraction Search of the Cochrane Library, PubMed, Embase, and the web, without language restriction, for any studies comparing the effects of influenza vaccines against placebo or no intervention. Abstraction and assessment of quality of methods were carried out. Data synthesis We identified 259 primary studies ( 274 datasets). Higher quality studies were significantly more likely to show concordance between data presented and conclusions (odds ratio 16.35, 95% confidence interval 4.24 to 63.04) and less likely to favour effectiveness of vaccines (0.04, 0.02 to 0.09). Government funded studies were less likely to have conclusions favouring the vaccines (0.45, 0.26 to 0.90). A higher mean journal impact factor was associated with complete or partial industry funding compared with government or private funding and no funding (differences between means 5.04). Study size was not associated with concordance, content of take home message, funding, and study quality. Higher citation index factor was associated with partial or complete industry funding. This was sensitive to the exclusion from the analysis of studies with undeclared funding. Conclusion Publication in prestigious journals is associated with partial or total industry funding, and this association is not explained by study quality or size. Addresses: [Jefferson, T.; Di Pietrantonj, C.; Debalini, M. G.; Rivetti, A.; Demicheli, V.] ASL AL 20, Cochrane Vaccines Field, I-15100 Alessandria, Italy Reprint Address: Jefferson, T, ASL AL 20, Cochrane Vaccines Field, I-15100 Alessandria, Italy. E-mail Address: jefferson.tom at gmail.com Cited Reference Count: 33 Times Cited: 0 Publisher: B M J PUBLISHING GROUP Publisher Address: BRITISH MED ASSOC HOUSE, TAVISTOCK SQUARE, LONDON WC1H 9JR, ENGLAND ISSN: 0959-8146 DOI: 10.1136/bmj.b354 29-char Source Abbrev.: BRIT MED J ISO Source Abbrev.: Br. Med. J. Source Item Page Count: 7 Subject Category: Medicine, General & Internal ISI Document Delivery No.: 415ZY ALPER BS How much effort is needed to keep up with the literature relevant for primary care? JOURNAL OF THE MEDICAL LIBRARY ASSOCIATION 92 : 429 2004 ALSNIELSEN B 12 INT COCHR COLL OT 2004 88 ALSNIELSEN B Association of funding and conclusions in randomized drug trials - A reflection of treatment effect or adverse events? JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 290 : 921 2003 BEKELMAN JE Scope and impact of financial conflicts of interest in biomedical research - A systematic review JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 289 : 454 2003 BERO LA SPONSORED SYMPOSIA ON ENVIRONMENTAL TOBACCO-SMOKE JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 271 : 612 1994 CARMAN WF Effects of influenza vaccination of health-care workers on mortality of elderly people in long-term care: a randomised controlled trial LANCET 355 : 93 2000 DAVIES K The information-seeking behaviour of doctors: a review of the evidence HEALTH INFORMATION AND LIBRARIES JOURNAL 24 : 78 2007 DAWES M Knowledge management in clinical practice: a systematic review of information seeking behavior in physicians INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS 71 : 9 DOI 10.1016/S1386-5056 (03)00023-6 2003 ELY JW Analysis of questions asked by family doctors regarding patient care BRITISH MEDICAL JOURNAL 319 : 358 1999 EURICH DT Mortality reduction with influenza vaccine in patients with pneumonia outside "Flu" season - Pleiotropic benefits or residual confounding? AMERICAN JOURNAL OF RESPIRATORY AND CRITICAL CARE MEDICINE 178 : 527 DOI 10.1164/rccm.200802-282OC 2008 FRIEDMAN LS Relationship between conflicts of interest and research results JOURNAL OF GENERAL INTERNAL MEDICINE 19 : 51 2004 GARFIELD E Journal impact factor: a brief review CANADIAN MEDICAL ASSOCIATION JOURNAL 161 : 979 1999 GARFIELD E The history and meaning of the journal impact factor JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 295 : 90 2006 HIGGINS JPT COCHRANE HDB SYSTEMA : 2008 JACKSON LA Evidence of bias in estimates of influenza vaccine effectiveness in seniors INTERNATIONAL JOURNAL OF EPIDEMIOLOGY 35 : 337 DOI 10.1093/ije/dyi274 2006 JEFFERSON T Public health - Influenza vaccination: policy versus evidence BRITISH MEDICAL JOURNAL 333 : 912 DOI 10.1136/bmj.38995.531701.80 2006 JORDAN R Universal vaccination of children against influenza: Are there indirect benefits to the community? A systematic review of the evidence VACCINE 24 : 1047 DOI 10.1016/j.vaccine.2005.09.017 2006 KJAERGARD LL Association between competing interests and authors' conclusions: epidemiological study of ramdomised clinical trials published in the BMJ BRITISH MEDICAL JOURNAL 325 : 249 2002 LEOPOLD SS Association between funding source and study outcome in orthopaedic research CLINICAL ORTHOPAEDICS AND RELATED RESEARCH : 293 DOI 10.1097/01.blo.0000093888.12372.d9 2003 LEXCHIN J Pharmaceutical industry sponsorship and research outcome and quality: systematic review BRITISH MEDICAL JOURNAL 326 : 1167 2003 MOHER D Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? LANCET 352 : 609 1998 SAINT S Journal reading habits of internists JOURNAL OF GENERAL INTERNAL MEDICINE 15 : 881 2000 SCHULZ KF EMPIRICAL-EVIDENCE OF BIAS - DIMENSIONS OF METHODOLOGICAL QUALITY ASSOCIATED WITH ESTIMATES OF TREATMENT EFFECTS IN CONTROLLED TRIALS JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 273 : 408 1995 SIMONSEN L Mortality benefits of influenza vaccination in elderly people: an ongoing controversy LANCET INFECTIOUS DISEASES 7 : 658 2007 STELFOX HT Conflict of interest in the debate over calcium-channel antagonists NEW ENGLAND JOURNAL OF MEDICINE 338 : 101 1998 TENOPIR C Journal reading patterns and preferences of pediatricians JOURNAL OF THE MEDICAL LIBRARY ASSOCIATION 95 : 56 2007 THOMAS RE COCHRANE DB SYST REV 3 : UNSP CD005187 2006 WELLS GA NEWCASTLE OTTAWA SCA : 2005 WILDE JA Effectiveness of influenza vaccine in health care professionals - A randomized trial JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 281 : 908 1999 WONGSURAKIAT P Acute respiratory illness in patients with COPD and the effectiveness of influenza vaccination - A randomized controlled study CHEST 125 : 2011 2004 WOOD L 14 COCHR C OCT 23 26 2006 YANK V Financial ties and concordance between results and conclusions in meta- analyses: retrospective cohort study BRITISH MEDICAL JOURNAL 335 : 1202 DOI 10.1136/bmj.39376.447211.BE 2007 YAPHE J The association between funding by commercial interests and study outcome in randomized controlled drug trials FAMILY PRACTICE 18 : 565 2001 From p.vandenbesselaar at RATHENAU.NL Sun Apr 5 16:15:48 2009 From: p.vandenbesselaar at RATHENAU.NL (Peter van den Besselaar) Date: Sun, 5 Apr 2009 22:15:48 +0200 Subject: Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Message-ID: Past performance, peer review, and project selection: A case study in the social and behavioral sciences Peter van den Besselaar & Loet Leydesdorff Abstract Does past performance influence success in grant applications? In this study we test whether the grant allocation decisions of the Netherlands Research Council for the Economic and Social Sciences correlate with the past performances of the applicants in terms of publications and citations, and with the results of the peer review process organized by the Council. We show that the Council is successful in distinguishing grant applicants with above-average performance from those with below-average performance, but within the former group no correlation could be found between past performance and receiving a grant. When comparing the best performing researchers who were denied funding with the group of researchers who received it, the rejected researchers significantly outperformed the funded ones. Furthermore, the best rejected proposals score on average as high on the outcomes of the peer review process as the accepted proposals. Finally, we found that the Council under study successfully corrected for gender effects during the selection process. We explain why these findings may be more general than for this case only. However, if research councils are not able to select the ?best? researchers, perhaps they should reconsider their mission. In a final section with policy implications, we discuss the role of research councils at the level of the science system in terms of variation, innovation, and quality control. PDF version available at: http://home.medewerker.uva.nl/p.a.a.vandenbesselaar/bestanden/20090327%20magw.pdf Peter van den Besselaar --------------------------------------- professor, head of department Address: Rathenau Instituut Dpt. Science System Assessment PO Box 95366, 2509 CJ Den Haag, The Netherlands email: p.vandenbesselaar at rathenau.nl From Christian.Box at IOP.ORG Sun Apr 5 17:01:30 2009 From: Christian.Box at IOP.ORG (Christian Box) Date: Sun, 5 Apr 2009 22:01:30 +0100 Subject: Christian Box is out of the office. Message-ID: I will be out of the office starting 03/04/2009 and will not return until 06/04/2009. I will respond to your message when I return. ************************************************************************ This email (and attachments) are confidential and intended for the addressee(s) only. If you are not the intended recipient please notify the sender, delete any copies and do not take action in reliance on it. Any views expressed are the author's and do not represent those of IOP, except where specifically stated. IOP takes reasonable precautions to protect against viruses but accepts no responsibility for loss or damage arising from virus infection. For the protection of IOP's systems and staff emails are scanned automatically. IOP Publishing Limited Registered in England under Registration No 467514. Registered Office: Dirac House, Temple Back, Bristol BS1 6BE England Vat No GB 461 6000 84. Please consider the environment before printing this e-mail. -------------- next part -------------- An HTML attachment was scrubbed... URL: From dwojick at HUGHES.NET Sun Apr 5 17:26:11 2009 From: dwojick at HUGHES.NET (David Wojick) Date: Sun, 5 Apr 2009 21:26:11 +0000 Subject: Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Message-ID: An HTML attachment was scrubbed... URL: From p.vandenbesselaar at RATHENAU.NL Mon Apr 6 03:06:25 2009 From: p.vandenbesselaar at RATHENAU.NL (Peter van den Besselaar) Date: Mon, 6 Apr 2009 09:06:25 +0200 Subject: Past performance, peer review, and projectselection: A case study in the social and behavioral sciences: PDF version In-Reply-To: <1119353797.287781.1238966772558.JavaMail.mail@webmail05> Message-ID: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Dear David, The paper is on my website (see url in the mail). Some clarification: - we take into account only recent past performance, and not the whole life time performance. One may expect that recent performance relates to the quality of the proposal and to the decision about the proposal. In the case we studied, the funding body does take into account both quality of the proposal and quality of the researcher. - we show that past performance and quality of the proposal are independent (low correlation). The question we try to answer us: Do recent past performance and quality of the proposal (referee scores) explain success? The findings: 1. researchers with weak past performance and with low referee scores are generally unsuccessful. 2. Comparing the successful applicants with an equally large group of the best scoring rejected applicants shows: - no difference in referee score and citations received between the two groups. - the rejected group has in average more publications in the recent past. Hope this clarifies. Best regards, Peter Peter van den Besselaar ---------------------------- Professor, Head of Department Rathenau Instituut Dept. Science System Assessment ________________________________ From: David Wojick Date: Sun, 5 Apr 2009 23:26:11 +0200 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Dear Peter van den Besselaar, This is very interesting, but after reading only the abstract I find it puzzling. There seems to be an assumption that past performance should be a significant factor in the success of proposals. One hopes that proposals are selected on their own merit, more or less independently of past performance. If so then the empirical question is whether past performance influences the quality of present proposals, not whether it influences their selection. Moreover, one should not be surprised to find that past performance does not correlate with present quality, for a variety of reasons. For example, past performance may be based on important discoveries that only occur once or a few times for a given researcher, so new proposals weaken with time. Or the focus of science may shift so that past discoveries, and their performers, are no longer relevant. In other words, the dynamics of science might tend to work against a correlation between past performance and proposal selection. If so then the lack of such correlation is not a criticism of the proposal selection body. Past performance and present quality of proposals are simply independent variables. But perhaps I misunderstand the abstract. Cheers, David David Wojick, Ph.D. 391 Flickertail Lane Star Tannery VA USA http://www.osti.gov/innovation/ Apr 5, 2009 04:23:27 PM, SIGMETRICS at listserv.utk.edu wrote: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Past performance, peer review, and project selection: A case study in the social and behavioral sciences Peter van den Besselaar & Loet Leydesdorff Abstract Does past performance influence success in grant applications? In this study we test whether the grant allocation decisions of the Netherlands Research Council for the Economic and Social Sciences correlate with the past performances of the applicants in terms of publications and citations, and with the results of the peer review process organized by the Council. We show that the Council is successful in distinguishing grant applicants with above-average performance from those with below-average performance, but within the former group no correlation could be found between past performance and receiving a grant. When comparing the best performing researchers who were denied funding with the group of researchers who received it, the rejected researchers significantly outperformed the funded ones. Furthermore, the best rejected proposals score on average as high on the outcomes of the peer review process as the accepted proposals. Finally, we found that the Council under study! successfully corrected for gender effects during the selection process. We explain why these findings may be more general than for this case only. However, if research councils are not able to select the ?best? researchers, perhaps they should reconsider their mission. In a final section with policy implications, we discuss the role of research councils at the level of the science system in terms of variation, innovation, and quality control. PDF version available at: http://home.medewerker.uva.nl/p.a.a.vandenbesselaar/bestanden/20090327%20magw.pdf Peter van den Besselaar --------------------------------------- professor, head of department Address: Rathenau Instituut Dpt. Science System Assessment PO Box 95366, 2509 CJ Den Haag, The Netherlands email: p.vandenbesselaar at rathenau.nl -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.hartley at PSY.KEELE.AC.UK Mon Apr 6 06:35:09 2009 From: j.hartley at PSY.KEELE.AC.UK (James Hartley) Date: Mon, 6 Apr 2009 11:35:09 +0100 Subject: Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Message-ID: Re - David's point that research proposals should be judged on their merit, more or less independently of past performance. Some (most?) research councils in the UK require applicants to list their previous applications to them, and their success or not at obtaining a grant from them - so it is hard not to imagine that previous performance plays a part in the refereeing process - undesirable as this might be! Jim James Hartley School of Psychology Keele University Staffordshire ST5 5BG UK j.hartley at psy.keele.ac.uk http://www.keele.ac.uk/depts/ps/people/JHartley/index.htm ----- Original Message ----- From: David Wojick To: SIGMETRICS at listserv.utk.edu Sent: Sunday, April 05, 2009 10:26 PM Subject: Re: [SIGMETRICS] Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Dear Peter van den Besselaar, This is very interesting, but after reading only the abstract I find it puzzling. There seems to be an assumption that past performance should be a significant factor in the success of proposals. One hopes that proposals are selected on their own merit, more or less independently of past performance. If so then the empirical question is whether past performance influences the quality of present proposals, not whether it influences their selection. Moreover, one should not be surprised to find that past performance does not correlate with present quality, for a variety of reasons. For example, past performance may be based on important discoveries that only occur once or a few times for a given researcher, so new proposals weaken with time. Or the focus of science may shift so that past discoveries, and their performers, are no longer relevant. In other words, the dynamics of science might tend to work against a correlation between past performance and proposal selection. If so then the lack of such correlation is not a criticism of the proposal selection body. Past performance and present quality of proposals are simply independent variables. But perhaps I misunderstand the abstract. Cheers, David David Wojick, Ph.D. 391 Flickertail Lane Star Tannery VA USA http://www.osti.gov/innovation/ Apr 5, 2009 04:23:27 PM, SIGMETRICS at listserv.utk.edu wrote: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Past performance, peer review, and project selection: A case study in the social and behavioral sciences Peter van den Besselaar & Loet Leydesdorff Abstract Does past performance influence success in grant applications? In this study we test whether the grant allocation decisions of the Netherlands Research Council for the Economic and Social Sciences correlate with the past performances of the applicants in terms of publications and citations, and with the results of the peer review process organized by the Council. We show that the Council is successful in distinguishing grant applicants with above-average performance from those with below-average performance, but within the former group no correlation could be found between past performance and receiving a grant. When comparing the best performing researchers who were denied funding with the group of researchers who received it, the rejected researchers significantly outperformed the funded ones. Furthermore, the best rejected proposals score on average as high on the outcomes of the peer review process as the accepted proposals. Finally, we found that the Council under study! successfully corrected for gender effects during the selection process. We explain why these findings may be more general than for this case only. However, if research councils are not able to select the ?best? researchers, perhaps they should reconsider their mission. In a final section with policy implications, we discuss the role of research councils at the level of the science system in terms of variation, innovation, and quality control. PDF version available at: http://home.medewerker.uva.nl/p.a.a.vandenbesselaar/bestanden/20090327%20magw.pdf Peter van den Besselaar --------------------------------------- professor, head of department Address: Rathenau Instituut Dpt. Science System Assessment PO Box 95366, 2509 CJ Den Haag, The Netherlands email: p.vandenbesselaar at rathenau.nl -------------- next part -------------- An HTML attachment was scrubbed... URL: From ronald.rousseau at KHBO.BE Mon Apr 6 08:29:49 2009 From: ronald.rousseau at KHBO.BE (Ronald Rousseau) Date: Mon, 6 Apr 2009 14:29:49 +0200 Subject: Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version In-Reply-To: <7D0CFE454F1E4BA8844339946F1942A7@vig371267> Message-ID: I do not agree with David. Past performance (but certainly not restricted to grant applications) is proof of what one is able to do. A research proposal - taken on its own - only shows if one has the skills to make credible promises. Leaving young scientists aside (their case is about giving chances to prove what they are capable of) I'd always go for proven merit (in recent years). Ronald Rousseau > > Re - David's point that research proposals should be judged on their > merit, more or less independently of past performance. > > Some (most?) research councils in the UK require applicants to list > their previous applications to them, and their success or not at > obtaining a grant from them - so it is hard not to imagine that > previous performance plays a part in the refereeing process - > undesirable as this might be! > > Jim > > James Hartley > School of Psychology > Keele University > Staffordshire > ST5 5BG > UK > j.hartley at psy.keele.ac.uk > http://www.keele.ac.uk/depts/ps/people/JHartley/index.htm > ----- Original Message ----- > From: David Wojick > To: SIGMETRICS at listserv.utk.edu > Sent: Sunday, April 05, 2009 10:26 PM > Subject: Re: [SIGMETRICS] Past performance, peer review, and > project selection: A case study in the social and behavioral > sciences: PDF version > > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > Dear Peter van den Besselaar, > > This is very interesting, but after reading only the abstract I > find it puzzling. There seems to be an assumption that past > performance should be a significant factor in the success of > proposals. One hopes that proposals are selected on their own merit, > more or less independently of past performance. If so then the > empirical question is whether past performance influences the > quality of present proposals, not whether it influences their > selection. > > Moreover, one should not be surprised to find that past > performance does not correlate with present quality, for a variety > of reasons. For example, past performance may be based on important > discoveries that only occur once or a few times for a given > researcher, so new proposals weaken with time. Or the focus of > science may shift so that past discoveries, and their performers, > are no longer relevant. In other words, the dynamics of science > might tend to work against a correlation between past performance > and proposal selection. If so then the lack of such correlation is > not a criticism of the proposal selection body. Past performance and > present quality of proposals are simply independent variables. But > perhaps I misunderstand the abstract. > > Cheers, David > > David Wojick, Ph.D. > 391 Flickertail Lane > Star Tannery VA USA > http://www.osti.gov/innovation/ > > Apr 5, 2009 04:23:27 PM, SIGMETRICS at listserv.utk.edu wrote: > > > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > Past performance, peer review, and project selection: A case > study in the social and behavioral sciences > > Peter van den Besselaar & Loet Leydesdorff > > Abstract > Does past performance influence success in grant applications? > In this study we test whether the grant allocation decisions of the > Netherlands Research Council for the Economic and Social Sciences > correlate with the past performances of the applicants in terms of > publications and citations, and with the results of the peer review > process organized by the Council. We show that the Council is > successful in distinguishing grant applicants with above-average > performance from those with below-average performance, but within > the former group no correlation could be found between past > performance and receiving a grant. When comparing the best > performing researchers who were denied funding with the group of > researchers who received it, the rejected researchers significantly > outperformed the funded ones. Furthermore, the best rejected > proposals score on average as high on the outcomes of the peer > review process as the accepted proposals. Finally, we found that the > Council under study! > successfully corrected for gender effects during the selection > process. We explain why these findings may be more general than for > this case only. However, if research councils are not able to select > the ?best? researchers, perhaps they should reconsider their > mission. In a final section with policy implications, we discuss the > role of research councils at the level of the science system in > terms of variation, innovation, and quality control. > > PDF version available at: > > http://home.medewerker.uva.nl/p.a.a.vandenbesselaar/bestanden/20090327%20magw.pdf > > > Peter van den Besselaar > --------------------------------------- > professor, head of department > > Address: > Rathenau Instituut > Dpt. Science System Assessment > PO Box 95366, 2509 CJ Den Haag, The Netherlands > > email: p.vandenbesselaar at rathenau.nl > -- Ronald Rousseau President of the ISSI KHBO - Association K.U.Leuven Industrial Sciences and Technology Zeedijk 101 - 8400 Oostende, Belgium Professor associated to K.U.Leuven Honorary Professor Henan Normal University (Xinxiang, China) Adjunct professor of Shanghai University Guest Professor at the National Library of Sciences CAS (Beijing) Guest Professor at Dalian University of Technology E-mail: ronald.rousseau at khbo.be web page: http://users.telenet.be/ronald.rousseau In scientific affairs one can never be too generous. ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program. From garfield at CODEX.CIS.UPENN.EDU Mon Apr 6 11:28:22 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 6 Apr 2009 11:28:22 -0400 Subject: Levitt, JM (Levitt, Jonathan M.); Thelwall, M (Thelwall, Mike) Citation Levels and Collaboration Within Library and Information Science JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 60 (3): 434-442 MAR 2009 Message-ID: E-mail Address: j.m.levitt at wlv.ac.uk; m.thelwall at wlv.ac.uk Author(s): Levitt, JM (Levitt, Jonathan M.); Thelwall, M (Thelwall, Mike) Title: Citation Levels and Collaboration Within Library and Information Science Source: JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 60 (3): 434-442 MAR 2009 Language: English Document Type: Article KeyWords Plus: SCIENTIFIC COLLABORATION; INTERNATIONAL COLLABORATION; BIOMEDICAL-RESEARCH; MOLECULAR-BIOLOGY; IMPACT; COAUTHORSHIP; COOPERATION; INDICATORS; AUTHORSHIP; NETWORKS Abstract: Collaboration is a major research policy objective, but does it deliver higher quality research? This study uses citation analysis to examine the Web of Science (WoS) Information Science & Library Science subject category (IS&LS) to ascertain whether, in general, more highly cited articles are more highly collaborative than other articles. It consists of two investigations. The first investigation is a longitudinal comparison of the degree and proportion of collaboration in five strata of citation; it found that collaboration in the highest four citation strata (all in the most highly cited 22%) increased in unison over time, whereas collaboration in the lowest citation strata (un-cited articles) remained low and stable. Given that over 40% of the articles were un-cited, it seems important to take into account the differences found between un- cited articles and relatively highly cited articles when investigating collaboration in IS&LS. The second investigation compares collaboration for 35 influential information scientists; it found that their more highly cited articles on average were not more highly collaborative than their less highly cited articles. In summary, although collaborative research is conducive to high citation in general, collaboration has apparently not tended to be essential to the success of current and former elite information scientists. Addresses: [Levitt, Jonathan M.; Thelwall, Mike] Wolverhampton Univ, Stat Cybermetr Res Grp, Sch Comp & Informat Technol, Wolverhampton WV1 1SB, England Reprint Address: Levitt, JM, Wolverhampton Univ, Stat Cybermetr Res Grp, Sch Comp & Informat Technol, Wulfruna St, Wolverhampton WV1 1SB, England. E-mail Address: j.m.levitt at wlv.ac.uk; m.thelwall at wlv.ac.uk Cited Reference Count: 32 Times Cited: 0 Publisher: JOHN WILEY & SONS INC Publisher Address: 111 RIVER ST, HOBOKEN, NJ 07030 USA ISSN: 1532-2882 DOI: 10.1002/asi.21000 29-char Source Abbrev.: J AM SOC INF SCI TECHNOL ISO Source Abbrev.: J. Am. Soc. Inf. Sci. Technol. Source Item Page Count: 9 Subject Category: Computer Science, Information Systems; Information Science & Library Science ISI Document Delivery No.: 415LK AVKIRAN NK Scientific collaboration in finance does not lead to better quality research SCIENTOMETRICS 39 : 173 1997 BARABASI AL Evolution of the social network of scientific collaborations PHYSICA A 311 : 590 2002 BORDONS M Local, domestic and international scientific collaboration in biomedical research SCIENTOMETRICS 37 : 279 1996 CRASE D J PHYSICAL ED RECREA 63 : 28 1992 CRONIN B Timelines of creativity: A study of intellectual innovators in information science JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 1948 DOI 10.1002/asi.20667 2007 CRONIN B A cast of thousands: Coauthorship and subauthorship collaboration in the 20th century as manifested in the scholarly journal literature of psychology and philosophy JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 54 : 855 DOI 10.1002/asi.10278 2003 CROW GM ARE 3 HEADS BETTER THAN ONE - REFLECTIONS ON DOING COLLABORATIVE INTERDISCIPLINARY RESEARCH AMERICAN EDUCATIONAL RESEARCH JOURNAL 29 : 737 1992 DRENTH JPH Multiple authorship - The contribution of senior authors JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 280 : 219 1998 EGGHE L Theory and practise of the g-index SCIENTOMETRICS 69 : 131 DOI 10.1007/s11192-006-0144-7 2006 FOX MF INDEPENDENCE AND COOPERATION IN RESEARCH - THE MOTIVATIONS AND COSTS OF COLLABORATION JOURNAL OF HIGHER EDUCATION 55 : 347 1984 FREDERIKSEN LF Disciplinary determinants of bibliometric impact in Danish industrial research: Collaboration and visibility SCIENTOMETRICS 61 : 253 2004 GLANZEL W Coauthorship patterns and trends in the sciences (1980-1998): A bibliometric study with implications for database indexing and search strategies LIBRARY TRENDS 50 : 461 2002 GLANZEL W Science in Scandinavia: A bibliometric approach SCIENTOMETRICS 48 : 121 2000 GOLDFINCH S Science from the periphery: Collaboration, networks and 'Periphery Effects' in the citation of New Zealand Crown Research Institutes articles, 1995-2000 SCIENTOMETRICS 57 : 321 2003 GOMEZ I Analysis of the structure of international scientific cooperation networks through bibliometric indicators SCIENTOMETRICS 44 : 441 1999 HART RL Collaboration and article quality in the literature of academic librarianship JOURNAL OF ACADEMIC LIBRARIANSHIP 33 : 190 2007 HERBERTZ H DOES IT PAY TO COOPERATE - A BIBLIOMETRIC CASE-STUDY IN MOLECULAR-BIOLOGY SCIENTOMETRICS 33 : 117 1995 KATZ JS What is research collaboration? RESEARCH POLICY 26 : 1 1997 KATZ JS How much is a collaboration worth? A calibrated bibliometric model SCIENTOMETRICS 40 : 541 1997 LEIMU R BIOSCIENCE 55 : 2005 LETA J Recognition and international collaboration: the Brazilian case SCIENTOMETRICS 53 : 325 2002 LEVITT JM SCIENTOMETRICS 78 : 41 2008 MA N An exploratory study on collaboration profiles of Chinese publications in Molecular Biology SCIENTOMETRICS 65 : 343 DOI 10.1007/s11192-005-0278-z 2005 NEWMAN MEJ Power laws, Pareto distributions and Zipf's law CONTEMPORARY PHYSICS 46 : 323 DOI 10.1080/00107510500052444 2005 PEREIRA JCR Driving factors of high performance in Brazilian Management Sciences for the 1981-1995 period SCIENTOMETRICS 49 : 307 2000 PERSSON O Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies SCIENTOMETRICS 60 : 421 2004 SHAPIRO DW THE CONTRIBUTIONS OF AUTHORS TO MULTIAUTHORED BIOMEDICAL-RESEARCH PAPERS JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 271 : 438 1994 UTHMAN OA BMC INFECT DIS 8 : 19 2008 VANRAAN AFJ The influence of international collaboration on the impact of research results - Some simple mathematical considerations concerning the role of self-citations SCIENTOMETRICS 42 : 423 1998 VOGEL EE Impact factor and international collaboration in Chilean physics: 1987- 1994 SCIENTOMETRICS 38 : 253 1997 WANG Y Scientific collaboration in China as reflected in co-authorship SCIENTOMETRICS 62 : 183 2005 YI H Use of citation per publication as an indicator to evaluate pentachlorophenol research SCIENTOMETRICS 75 : 67 2008 From garfield at CODEX.CIS.UPENN.EDU Mon Apr 6 12:14:53 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 6 Apr 2009 12:14:53 -0400 Subject: Klavans, R (Klavans, Richard); Boyack, KW (Boyack, Kevin W.) Toward a Consensus Map of Science JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 60 (3): 455-476 MAR 2009 Message-ID: E-mail Address: rklavans at mapofscience.com; kboyack at mapofscience.com Author(s): Klavans, R (Klavans, Richard); Boyack, KW (Boyack, Kevin W.) Title: Toward a Consensus Map of Science Source: JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 60 (3): 455-476 MAR 2009 Language: English Document Type: Article KeyWords Plus: SCIENTIFIC JOURNALS; DOMAINS Abstract: A consensus map of science is generated from an analysis of 20 existing maps of science. These 20 maps occur in three basic forms: hierarchical, centric, and noncentric (or circular). The consensus map, generated from consensus edges that occur in at least half of the input maps, emerges in a circular form. The ordering of areas is as follows: mathematics is (arbitrarily) placed at the top of the circle, and is followed clockwise by physics, physical chemistry, engineering, chemistry, earth sciences, biology, biochemistry, infectious diseases, medicine, health services, brain research, psychology, humanities, social sciences, and computer science. The link between computer science and mathematics completes the circle. If the lowest weighted edges are pruned from this consensus circular map, a hierarchical map stretching from mathematics to social sciences results. The circular map of science is found to have a high level of correspondence with the 20 existing maps, and has a variety of advantages over hierarchical and centric forms. A one-dimensional Riemannian version of the consensus map is also proposed. Addresses: [Klavans, Richard] SciTech Strategies Inc, Berwyn, PA 19312 USA; [Boyack, Kevin W.] SciTech Strategies Inc, Albuquerque, NM 87122 USA Reprint Address: Klavans, R, SciTech Strategies Inc, Berwyn, PA 19312 USA. E-mail Address: rklavans at mapofscience.com; kboyack at mapofscience.com Cited Reference Count: 26 Times Cited: 0 Publisher: JOHN WILEY & SONS INC Publisher Address: 111 RIVER ST, HOBOKEN, NJ 07030 USA ISSN: 1532-2882 DOI: 10.1002/asi.20991 29-char Source Abbrev.: J AM SOC INF SCI TECHNOL ISO Source Abbrev.: J. Am. Soc. Inf. Sci. Technol. Source Item Page Count: 22 Subject Category: Computer Science, Information Systems; Information Science & Library Science ISI Document Delivery No.: 415LK BALABAN AT Is chemistry 'The Central Science'? How are different sciences related? Co- citations, reductionism, emergence, and posets SCIENTOMETRICS 69 : 615 2006 BASSECOULARD E Indicators in a research institute: A multi-level classification of scientific journals SCIENTOMETRICS 44 : 323 1999 BERNAL JD SOCIAL FUNCTION SCI : 1939 BOYACK KW SCIENTOMETRICS 79 : 27 2009 BOYACK KW SCIENTOMETRICS 79 : 45 2009 BOYACK KW Mapping the backbone of science SCIENTOMETRICS 64 : 351 DOI 10.1007/s11192-005-0255-6 2005 COMTE A COURS PHILOS POSITIV 1 : 1830 ELLINGHAM HJT ROYAL SOC SCI INF C : 477 2008 GRIFFITH BC STRUCTURE OF SCIENTIFIC LITERATURES .2. TOWARD A MACROSTRUCTURE AND MICROSTRUCTURE FOR SCIENCE SCIENCE STUDIES 4 : 339 1974 KLAVANS R FORECASTING LA UNPUB : 2008 KLAVANS R Identifying a better measure of relatedness for mapping science JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 57 : 251 DOI 10.1002/asi.20274 2006 KLAVANS R Is there a convergent structure of science? A comparison of maps using the ISI and scopus databases Proceedings of ISSI 2007: 11th International Conference of the International Society for Scientometrics and Informetrics, Vols I and II : 437 2007 KLAVANS R Thought leadership: A new indicator for national and institutional comparison SCIENTOMETRICS 75 : 239 DOI 10.1007/s11192-007-1854-1 2008 KLAVANS R Quantitative evaluation of large maps of science SCIENTOMETRICS 68 : 475 DOI 10.1007/s11192-006-0125-x 2006 LEYDESDORFF L J AM SOC IN IN PRESS : DOI 10.1002/ASI20967 2008 MARRIS E Gallery: Brilliant display NATURE 444 : 985 DOI 10.1038/444985a 2006 MARTIN S 20082936J SAND SAND 2008 MOYAANEGON F J AM SOC INFORM SCI 58 : 2167 2007 MOYAANEGON F A new technique for building maps of large scientific domains based on the cocitation of classes and categories SCIENTOMETRICS 61 : 129 2004 NARIN F INTERRELATIONSHIPS OF SCIENTIFIC JOURNALS JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 23 : 323 1972 ROSVALLT M Maps of random walks on complex networks reveal community structure PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 105 : 1118 DOI 10.1073/pnas.0706851105 2008 SAMOYLENKO I Visualizing the scientific world and its evolution JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 57 : 1461 DOI 10.1002/asi.20450 2006 SHIFFRIN RM Mapping knowledge domains PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 101 : 5183 DOI 10.1073/pnas.0307852100 2004 SMALL H Visualizing science by citation mapping JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 50 : 799 1999 SMALL H THE GEOGRAPHY OF SCIENCE - DISCIPLINARY AND NATIONAL MAPPINGS JOURNAL OF INFORMATION SCIENCE 11 : 147 1985 SPENCER H ILLUSTRATIONS UNIVER : 1864 From garfield at CODEX.CIS.UPENN.EDU Mon Apr 6 12:24:27 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Mon, 6 Apr 2009 12:24:27 -0400 Subject: Mukherjee, B Do Open-Access Journals in Library and Information Science Have Any Scholarly Impact? A Bibliometric Study of Selected Open-Access Journals Using Google Scholar JOUR OF THE AMER SOCIETY FOR INFOR SCI AND TECH, 60 (3): 581-594 MAR 2009 Message-ID: E-mail Address: mukherjee.bhaskar at gmail.com Author(s): Mukherjee, B (Mukherjee, Bhaskar) Title: Do Open-Access Journals in Library and Information Science Have Any Scholarly Impact? A Bibliometric Study of Selected Open-Access Journals Using Google Scholar Source: JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 60 (3): 581-594 MAR 2009 Language: English Document Type: Article KeyWords Plus: RESEARCH PERFORMANCE; CITATION INDEXES; WEB; DOCUMENTATION; COUNTS Abstract: Using 17 fully open-access journals published uninterruptedly during 2000 to 2004 in the field of library and information science, the present study investigates the impact of these open-access journals in terms of quantity of articles published, subject distribution of the articles, synchronous and diachronous impact factor, immediacy index, and journals' and authors' self-citation. The results indicate that during this 5-year publication period, there are as many as 1,636 articles published by these journals. At the same time, the articles have received a total of 8,591 Web citations during a 7-year citation period. Eight of 17 journals have received more than 100 citations. First Monday received the highest number of citations; however, the average number of citations per article was the highest in D-Lib Magazine. The value of the synchronous impact factor varies from 0.6989 to 1.0014 during 2002 to 2005, and the diachronous impact factor varies from 1.472 to 2.487 during 2000 to 2004. The range of the immediacy index varies between 0.0714 and 1.395. D-Lib Magazine has an immediacy index value above 0.5 in all the years whereas the immediacy index value varies from year to year for the other journals. When the citations of sample articles were analyzed according to source, it was found that 40.32% of the citations came from full-text articles, followed by 33.35% from journal articles. The percentage of journals' self-citation was only 6.04%. E-mail Address: mukherjee.bhaskar at gmail.com Cited Reference Count: 47 Times Cited: 0 Publisher: JOHN WILEY & SONS INC Publisher Address: 111 RIVER ST, HOBOKEN, NJ 07030 USA ISSN: 1532-2882 DOI: 10.1002/asi.21003 29-char Source Abbrev.: J AM SOC INF SCI TECHNOL ISO Source Abbrev.: J. Am. Soc. Inf. Sci. Technol. Source Item Page Count: 14 Subject Category: Computer Science, Information Systems; Information Science & Library Science ISI Document Delivery No.: 415LK *GOOGL INC GOOGL SCHOL : 2007 ADAM D The counting house NATURE 415 : 726 2002 ASAI I ADJUSTED AGE DISTRIBUTION AND ITS APPLICATION TO IMPACT FACTOR AND IMMEDIACY INDEX JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 32 : 172 1981 BAUER K D LIB MAGAZINE 11 : 2005 BRODY T Earlier web usage statistics as predictors of later citation impact JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 57 : 1060 DOI 10.1002/asi.20373 2006 COLEMAN A Validation of the Omron 705IT (HEM-759-E) oscillometric blood pressure monitoring device according to the British Hypertension Society protocol BLOOD PRESSURE MONITORING 11 : 27 2006 FRANDSEN TF Article impact calculated over arbitrary periods JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 56 : 58 DOI 10.1002/asi.20100 2005 FUSSLER HH PATTERN USE BOOKS LA : 1969 GARFIELD E Journal impact factor: a brief review CANADIAN MEDICAL ASSOCIATION JOURNAL 161 : 979 1999 GARFIELD E The history and meaning of the journal impact factor JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 295 : 90 2006 GARFIELD E CITATION INDEXES FOR SCIENCE - NEW DIMENSION IN DOCUMENTATION THROUGH ASSOCIATION OF IDEAS SCIENCE 122 : 108 1955 GLANZEL W A BIBLIOMETRIC STUDY ON AGING AND RECEPTION PROCESSES OF SCIENTIFIC LITERATURE JOURNAL OF INFORMATION SCIENCE 21 : 37 1995 GONZALEZ L Structure of the impact factor of journals included in the Social Sciences Citation Index: Citations from documents labeled "editorial material" JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 58 : 252 DOI 10.1002/asi.20424 2007 HARTER SP PUBLIC ACCESS COMPUT 7 : 5 1996 HARZING AW GOOGLE SCHOLAR NEW D : 2008 HIRST G DISCIPLINE IMPACT FACTORS - METHOD FOR DETERMINING CORE JOURNAL LISTS JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE 29 : 171 1978 INGWERSEN P The publication-citation matrix and its derived quantities CHINESE SCIENCE BULLETIN 46 : 524 2001 INGWERSEN P The calculation of Web impact factors JOURNAL OF DOCUMENTATION 54 : 236 1998 JACSO P A deficiency in the algorithm for calculating the impact factor of scholarly journals: The journal impact factor CORTEX 37 : 590 2001 JACSO P Dubious hit counts and cuckoo's eggs ONLINE INFORMATION REVIEW 30 : 188 DOI 10.1108/14694520610659201 2006 JACSO P Deflated, inflated and phantom citation counts ONLINE INFORMATION REVIEW 30 : 297 DOI 10.1108/14684520610675816 2006 JACSO P Google Scholar: the pros and the cons ONLINE INFORMATION REVIEW 29 : 208 2005 KOUSHA K INF SCIENT 7 COLLNET : 2006 KOUSHA K SCIENTOMETRICS 68 : 50 2006 LAWRENCE PA MEASUREMENT SCI : 2007 MOED HF MEASUREMENT RES PERF : 1987 MOED HF THE USE OF BIBLIOMETRIC DATA FOR THE MEASUREMENT OF UNIVERSITY-RESEARCH PERFORMANCE RESEARCH POLICY 14 : 131 1985 MUKHERJEE B J ELECT PUBLISHI SPR : 2007 MUKHERJEE B SCIENTOMETR IN PRESS 79 : NORUZI A Google Scholar: The new generation of citation indexes LIBRI 55 : 170 2005 RAMIREZ AM Renormalized impact factor SCIENTOMETRICS 47 : 3 2000 ROUSSEAU R Median and percentile impact factors: A set of new indicators SCIENTOMETRICS 63 : 431 DOI 10.1007/s11192-005-0223-1 2005 SCHLOEGL C Impact and relevance of LIS journals: A scientometric analysis of international and German-language LIS journals - Citation analysis versus reader survey JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 55 : 1155 DOI 10.1002/asi.20070 2004 SEGLEN PO Why the impact factor of journals should not be used for evaluating research BRITISH MEDICAL JOURNAL 314 : 498 1997 SEVINC A Manipulating impact factor: an unethical issue or an Editor's choice? SWISS MEDICAL WEEKLY 134 : 410 2004 SMITH AG IFLA J 31 : 76 2005 SMITH R Journal accused of manipulating impact factor BRITISH MEDICAL JOURNAL 314 : 463 1997 SOMBATSOMPOP N Making an equality of ISI impact factors for different subject fields JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 56 : 676 DOI 10.1002/asi.20150 2005 SOMBATSOMPOP N An evaluation of research performance for different subject categories using Impact Factor Point Average (IFPA) index: Thailand case study SCIENTOMETRICS 65 : 293 DOI 10.1007/s11192-005-0275-2 2005 SOMBATSOMPOP N A modified method for calculating the Impact Factors of journals in ISI Journal Citation Reports: Polymer Science Category in 1997-2001 SCIENTOMETRICS 60 : 217 2004 THELWALL M Conceptualizing documentation on the Web: An evaluation of different heuristic-based models for counting links between university Web sites JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 53 : 995 DOI 10.1002/asi.10135 2002 VANLEEUWEN TN Development and application of journal impact measures in the Dutch science system SCIENTOMETRICS 53 : 249 2002 VAUGHAN L 9 INT SCI TECHN IND 2006 155 VAUGHAN L Web citation data for impact assessment: A comparison of four science disciplines JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 56 : 1075 DOI 10.1002/asi.20199 2005 VAUGHAN L Bibliographic and web citations: What is the difference? JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 54 : 1313 DOI 10.1002/asi.10338 2003 WALTER G Counting on citations: a flawed way to measure quality MEDICAL JOURNAL OF AUSTRALIA 178 : 280 2003 WHITEHOUSE G Citation rates and impact factors: should they matter? BRITISH JOURNAL OF RADIOLOGY 74 : 1 2001 From dwojick at HUGHES.NET Mon Apr 6 18:33:46 2009 From: dwojick at HUGHES.NET (David Wojick) Date: Mon, 6 Apr 2009 22:33:46 +0000 Subject: Past performance, peer review, and projectselection: A case study in the social and behavioral sciences: PDF version Message-ID: An HTML attachment was scrubbed... URL: From dwojick at HUGHES.NET Mon Apr 6 18:44:28 2009 From: dwojick at HUGHES.NET (David Wojick) Date: Mon, 6 Apr 2009 22:44:28 +0000 Subject: Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Message-ID: An HTML attachment was scrubbed... URL: From p.vandenbesselaar at RATHENAU.NL Tue Apr 7 02:35:40 2009 From: p.vandenbesselaar at RATHENAU.NL (Peter van den Besselaar) Date: Tue, 7 Apr 2009 08:35:40 +0200 Subject: Past performance, peer review, and projectselection: A case study in the social and behavioral sciences: PDF version In-Reply-To: <1287042064.107449.1239057868182.JavaMail.mail@webmail08> Message-ID: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Dear David, It is not so much on making a mistake, but about the de facto difference between the idea of competition in order to have the best proposals/researchers selected and the observed results of the selection process. We studied a variety of funding schemes, more particularly the open competition, and the career grants. Whereas in the former the quality of the proposal is dominant, in the latter it is about selecting the best and most promising (young) researchers. Consequently, one would expect a strong relation between success and referee scores in the open competition and a strong relation between past performance and success in the career grants. Interestingly, this is not the case. In both cases, success within the top half cannot be explained in terms of recent past performance and also not in terms of referee scores. The council is able to remove the weaker proposals and researchers, but not to select the best out of the large group op good one's. I do not consider this as a mistake, but as a de facto gap between what councils do (removing the tail of the distribution) and what they claim to do (selecting the best - which may be an impossible task anyhow). In other words, past performance and review scores do enter into the decision making process but do not have systematic influence on the decision taken. This has a few implications. As obtaining grants from the research council heavily influences the career of researchers, two problems have to be solved: - is enough funding available in order to have good researchers their grant applications approved on a regular basis? - is the system open enough, or does someone's position in the network (of decisionmakers) explain success in grant applications? I am currently doing a project that tries to answer the second question. Best regards Peter ----- Peter van den Besselaar ---------------------------- Professor, Head of Department Rathenau Instituut Dept. Science System Assessment ________________________________ From: David Wojick Date: Tue, 7 Apr 2009 00:44:28 +0200 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Dear Jim, I never meant to suggest that past performance plays no role in proposal selection, for of course it does, and it should. That is why I chose the term "more or less." But this role may be either negative or positive, for various reasons, in different cases. This study seems to suggest that it is not strongly positive, while the authors seem to suggest that there is something wrong with this result. That is my puzzlement. The finding may be important but the conclusion seems strange and disconnected from the findings. Cheers, David David Wojick, Ph.D. 391 Flickertail Lane Star Tannery VA USA http://www.osti.gov/innovation/ Apr 6, 2009 06:39:11 AM, SIGMETRICS at listserv.utk.edu wrote: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html ? Re - David's point that research proposals should be judged on their merit, more or less independently of past performance. Some (most?) research councils in the UK require applicants to list their previous applications to them, and their success or not at obtaining a grant from them - so it is hard not to imagine that previous performance plays a part in the refereeing process - undesirable as this might be! Jim James Hartley School of Psychology Keele University Staffordshire ST5 5BG UK j.hartley at psy.keele.ac.uk http://www.keele.ac.uk/depts/ps/people/JHartley/index.htm ----- Original Message ----- From: David Wojick To: SIGMETRICS at listserv.utk.edu Sent: Sunday, April 05, 2009 10:26 PM Subject: Re: [SIGMETRICS] Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Dear Peter van den Besselaar, This is very interesting, but after reading only the abstract I find it puzzling. There seems to be an assumption that past performance should be a significant factor in the success of proposals. One hopes that proposals are selected on their own merit, more or less independently of past performance. If so then the empirical question is whether past performance influences the quality of present proposals, not whether it influences their selection. Moreover, one should not be surprised to find that past performance does not correlate with present quality, for a variety of reasons. For example, past performance may be based on important discoveries that only occur once or a few times for a given researcher, so new proposals weaken with time. Or the focus of science may shift so that past discoveries, and their performers, are no longer relevant. In other words, the dynamics of science might tend to work against a correlation between past performance and proposal selection. If so then the lack of such correlation is not a criticism of the proposal selection body. Past performance and present quality of proposals are simply independent variables. But perhaps I misunderstand the abstract. Cheers, David David Wojick, Ph.D. 391 Flickertail Lane Star Tannery VA USA http://www.osti.gov/innovation/ Apr 5, 2009 04:23:27 PM, SIGMETRICS at listserv.utk.edu wrote: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Past performance, peer review, and project selection: A case study in the social and behavioral sciences Peter van den Besselaar & Loet Leydesdorff Abstract Does past performance influence success in grant applications? In this study we test whether the grant allocation decisions of the Netherlands Research Council for the Economic and Social Sciences correlate with the past performances of the applicants in terms of publications and citations, and with the results of the peer review process organized by the Council. We show that the Council is successful in distinguishing grant applicants with above-average performance from those with below-average performance, but within the former group no correlation could be found between past performance and receiving a grant. When comparing the best performing researchers who were denied funding with the group of researchers who received it, the rejected researchers significantly outperformed the funded ones. Furthermore, the best rejected proposals score on average as high on the outcomes of the peer review process as the accepted proposals. Finally, we found that the Council under study! successfully corrected for gender effects during the selection process. We explain why these findings may be more general than for this case only. However, if research councils are not able to select the ?best? researchers, perhaps they should reconsider their mission. In a final section with policy implications, we discuss the role of research councils at the level of the science system in terms of variation, innovation, and quality control. PDF version available at: http://home.medewerker.uva.nl/p.a.a.vandenbesselaar/bestanden/20090327%20magw.pdf Peter van den Besselaar --------------------------------------- professor, head of department Address: Rathenau Instituut Dpt. Science System Assessment PO Box 95366, 2509 CJ Den Haag, The Netherlands email: p.vandenbesselaar at rathenau.nl -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.hartley at PSY.KEELE.AC.UK Wed Apr 8 03:29:33 2009 From: j.hartley at PSY.KEELE.AC.UK (James Hartley) Date: Wed, 8 Apr 2009 08:29:33 +0100 Subject: Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Message-ID: Thanks for your clarification...I suspect we both leapt on what it said in the abstract without reading thea article fully until the end... Anyway, I think that is what I did! Cheers Jim James Hartley School of Psychology Keele University Staffordshire ST5 5BG UK j.hartley at psy.keele.ac.uk http://www.keele.ac.uk/depts/ps/people/JHartley/index.htm ----- Original Message ----- From: David Wojick To: SIGMETRICS at listserv.utk.edu Sent: Monday, April 06, 2009 11:44 PM Subject: Re: [SIGMETRICS] Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Dear Jim, I never meant to suggest that past performance plays no role in proposal selection, for of course it does, and it should. That is why I chose the term "more or less." But this role may be either negative or positive, for various reasons, in different cases. This study seems to suggest that it is not strongly positive, while the authors seem to suggest that there is something wrong with this result. That is my puzzlement. The finding may be important but the conclusion seems strange and disconnected from the findings. Cheers, David David Wojick, Ph.D. 391 Flickertail Lane Star Tannery VA USA http://www.osti.gov/innovation/ Apr 6, 2009 06:39:11 AM, SIGMETRICS at listserv.utk.edu wrote: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html ? Re - David's point that research proposals should be judged on their merit, more or less independently of past performance. Some (most?) research councils in the UK require applicants to list their previous applications to them, and their success or not at obtaining a grant from them - so it is hard not to imagine that previous performance plays a part in the refereeing process - undesirable as this might be! Jim James Hartley School of Psychology Keele University Staffordshire ST5 5BG UK j.hartley at psy.keele.ac.uk http://www.keele.ac.uk/depts/ps/people/JHartley/index.htm ----- Original Message ----- From: David Wojick To: SIGMETRICS at listserv.utk.edu Sent: Sunday, April 05, 2009 10:26 PM Subject: Re: [SIGMETRICS] Past performance, peer review, and project selection: A case study in the social and behavioral sciences: PDF version Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Dear Peter van den Besselaar, This is very interesting, but after reading only the abstract I find it puzzling. There seems to be an assumption that past performance should be a significant factor in the success of proposals. One hopes that proposals are selected on their own merit, more or less independently of past performance. If so then the empirical question is whether past performance influences the quality of present proposals, not whether it influences their selection. Moreover, one should not be surprised to find that past performance does not correlate with present quality, for a variety of reasons. For example, past performance may be based on important discoveries that only occur once or a few times for a given researcher, so new proposals weaken with time. Or the focus of science may shift so that past discoveries, and their performers, are no longer relevant. In other words, the dynamics of science might tend to work against a correlation between past performance and proposal selection. If so then the lack of such correlation is not a criticism of the proposal selection body. Past performance and present quality of proposals are simply independent variables. But perhaps I misunderstand the abstract. Cheers, David David Wojick, Ph.D. 391 Flickertail Lane Star Tannery VA USA http://www.osti.gov/innovation/ Apr 5, 2009 04:23:27 PM, SIGMETRICS at listserv.utk.edu wrote: Adminstrative info for SIGMETRICS (for example unsubscribe): http://web.utk.edu/~gwhitney/sigmetrics.html Past performance, peer review, and project selection: A case study in the social and behavioral sciences Peter van den Besselaar & Loet Leydesdorff Abstract Does past performance influence success in grant applications? In this study we test whether the grant allocation decisions of the Netherlands Research Council for the Economic and Social Sciences correlate with the past performances of the applicants in terms of publications and citations, and with the results of the peer review process organized by the Council. We show that the Council is successful in distinguishing grant applicants with above-average performance from those with below-average performance, but within the former group no correlation could be found between past performance and receiving a grant. When comparing the best performing researchers who were denied funding with the group of researchers who received it, the rejected researchers significantly outperformed the funded ones. Furthermore, the best rejected proposals score on average as high on the outcomes of the peer review process as the accepted proposals. Finally, we found that the Council under study! successfully corrected for gender effects during the selection process. We explain why these findings may be more general than for this case only. However, if research councils are not able to select the ?best? researchers, perhaps they should reconsider their mission. In a final section with policy implications, we discuss the role of research councils at the level of the science system in terms of variation, innovation, and quality control. PDF version available at: http://home.medewerker.uva.nl/p.a.a.vandenbesselaar/bestanden/20090327%20magw.pdf Peter van den Besselaar --------------------------------------- professor, head of department Address: Rathenau Instituut Dpt. Science System Assessment PO Box 95366, 2509 CJ Den Haag, The Netherlands email: p.vandenbesselaar at rathenau.nl -------------- next part -------------- An HTML attachment was scrubbed... URL: From dwojick at HUGHES.NET Wed Apr 8 07:47:53 2009 From: dwojick at HUGHES.NET (David Wojick) Date: Wed, 8 Apr 2009 11:47:53 +0000 Subject: Past performance, peer review, and projectselection: A case study in the social and behavioral sciences: PDF version Message-ID: An HTML attachment was scrubbed... URL: From havemanf at CMS.HU-BERLIN.DE Tue Apr 14 06:32:47 2009 From: havemanf at CMS.HU-BERLIN.DE (Frank Havemann) Date: Tue, 14 Apr 2009 12:32:47 +0200 Subject: PhD position =?windows-1252?Q?=84Measuring_the_Diversity_o_f_Research=93?= In-Reply-To: Message-ID: PhD position ?Measuring the Diversity of Research? Humboldt-Universitaet zu Berlin, Institut fuer Bibliotheks- und Informationswissenschaft Project description: The aim of the project is to develop and to assess bibliometric methods for measuring the diversity of research outputs of international scientific communities, their national sub-communities, and research organizations. The PhD candidate is expected to develop bibliometric methods, to translate them into algorithms and computer programmes, and to experiment with the methods. A publication from the project is available at http://www.collnet.de/Berlin-2008/MitesserWIS2008mdr.pdf For further information please contact Frank Havemann (frank.havemann (at) ibi.hu-berlin.de). Requirements: The project combines knowledge and methods from several fields including Advanced statistics and linear algebra; Bibliometrics; Software development (scripts, preferably R, perl or MySQL, other languages possible); and Sociology of science. In addition to an excellent masters degree in the natural or social sciences we expect the willingness and ability to acquire and combine knowledge from these fields. Fluency in English is a requirement. Conditions of employment: Start: As soon as possible after 1 May 2009. Duration: 3 years Maximum hours per week: 20 Salary: about 1100 EURO after tax Please send your applications to Frank Havemann (frank.havemann (at) ibi.hu-berlin.de) Deadline: 29 April 2009 announcement in German: http://www.hu-info.hu-berlin.de/2009/07 From garfield at CODEX.CIS.UPENN.EDU Tue Apr 14 11:19:26 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 14 Apr 2009 11:19:26 -0400 Subject: Xuan, ZG; Chen, L; Dang, YZ; Yu, J IEEE Research Field Discovery Based on Text Clustering 2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31: 11345-11348 2008 Message-ID: Email Addresses: xzg at dl.cn, chenli_stu at 163.com, yzhdang at dlut.edu.cn, yujiang_999 at hotmail.com Author(s): Xuan, ZG (Xuan, Zhaoguo); Chen, L (Chen, Li); Dang, YZ (Dang, Yanzhong); Yu, J (Yu, Jiang) Book Group Author(s): IEEE Title: Research Field Discovery Based on Text Clustering Source: 2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31: 11345-11348 2008 Book series title: International Conference on Wireless Communications, Networking and Mobile Computing Language: English Document Type: Proceedings Paper Conference Title: 4th International Conference on Wireless Communications, Networking and Mobile Computing Conference Date: OCT 12-17, 2008 Conference Location: Dalian, PEOPLES R CHINA Conference Sponsors: IEEE Commun Soc.; IEEE Antennas & Propagat Soc.; Dalian Univ Technol.; Wuhan Univ.; Sci Res Publishing. Author Keywords: research field; text mining; text clustering; analysis Abstract: For the need of revealing the structure and dynamics of science, text mining technologies have been widely used in extracting technical intelligence from research literature. To analyze the status of research fields, this paper applies text clustering to Chinese national science research proposals. By using vector-space model to represent the proposals, an improved Newman fast clustering algorithm has been carried out to explore the clusters of each year, which indicate the yearly research fields. After that, the paper gives an insightful representation of the whole status of the research fields. Then the similarities of clusters of different years are calculated to discover the groups, which identify the major research fields and illustrate their stability and changes over the time. These analyses will be helpful to discover the development trends of basic research fields. Addresses: [Xuan, Zhaoguo; Chen, Li; Dang, Yanzhong; Yu, Jiang] Dalian Univ Technol, Inst Syst Engn, Dalian, Peoples R China Reprint Address: Xuan, ZG, Dalian Univ Technol, Inst Syst Engn, Dalian, Peoples R China. Cited Reference Count: 14 Times Cited: 0 Publisher: IEEE Publisher Address: 345 E 47TH ST, NEW YORK, NY 10017 USA ISBN: 978-1-4244-2107-7 29-char Source Abbrev.: I C WIREL COM NETW MOBILE COM Source Item Page Count: 4 Subject Category: Telecommunications ISI Document Delivery No.: BIW81 CHINESE CLASSIFIED T : 2007 BHATTACHARYA S Mapping a research area at the micro level using co-word analysis SCIENTOMETRICS 43 : 359 1998 DELEN D Seeding the survey and analysis of research literature with text mining EXPERT SYSTEMS WITH APPLICATIONS 34 : 1707 2008 GARFIELD E CITATION INDEXES FOR SCIENCE - NEW DIMENSION IN DOCUMENTATION THROUGH ASSOCIATION OF IDEAS SCIENCE 122 : 108 1955 KESSLER MM BIBLIOGRAPHIC COUPLING BETWEEN SCIENTIFIC PAPERS AMERICAN DOCUMENTATION 14 : 10 1963 MCKNIGHT W DM REV : 21 2005 MILLER TW DATA TEXT MINING BUS : 2005 NEWMAN MEJ Finding and evaluating community structure in networks PHYSICAL REVIEW E 69 : ARTN 026113 2004 NEWMAN MEJ Fast algorithm for detecting community structure in networks PHYSICAL REVIEW E 69 : 6133 2004 SALTON G VECTOR-SPACE MODEL FOR AUTOMATIC INDEXING COMMUNICATIONS OF THE ACM 18 : 613 1975 SALTON G PHYS REV E 69 : 6113 2004 SMALL H J AM SOC INFORM SCI 24 : 256 1973 VANDENBESSELAAR P Mapping research topics using word-reference co-occurrences: A method and an exploratory case study SCIENTOMETRICS 68 : 377 DOI 10.1007/s11192-006-0118-9 2006 XUAN ZG INT J KNOWLEDGE SYST 4 : 36 2007 From garfield at CODEX.CIS.UPENN.EDU Tue Apr 14 11:24:51 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 14 Apr 2009 11:24:51 -0400 Subject: Liu, JW (Liu Jun-wan) IEEE Trends in Fiber Optics: Citation Analysis of the Fiber Optic SCI Papers (1974-2007) 2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31: 11550-11553 2008 Message-ID: Email Address: liujunwan at sina.com Author(s): Liu, JW (Liu Jun-wan) Book Group Author(s): IEEE Title: Trends in Fiber Optics: Citation Analysis of the Fiber Optic SCI Papers (1974-2007) Source: 2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31: 11550-11553 2008 Book series title: International Conference on Wireless Communications, Networking and Mobile Computing Language: English Document Type: Proceedings Paper Conference Title: 4th International Conference on Wireless Communications, Networking and Mobile Computing Conference Date: OCT 12-17, 2008 Conference Location: Dalian, PEOPLES R CHINA Conference Sponsors: IEEE Commun Soc.; IEEE Antennas & Propagat Soc.; Dalian Univ Technol.; Wuhan Univ.; Sci Res Publishing . Author Keywords: Fiber optics; Progressive knowledge domain visualization; CiteSpace Abstract: We analyze thematic trends and challenging issues in fiber optics research based on the metadata of 4970 research papers indexed in Science Citation Index (SCI) database between 1974 and 2007. We specifically address 1) all-time prominent challenges in fiber optics, 2) a trend of progression in fiber optics 3) the structure and dynamics of the fiber optics community. We utilize CiteSpace, a progressive domain visualization tool, to identify and visualize the movement of research fronts and intellectual bases, persistent clusters of papers, and the evolution of co-authorship networks as well as citation networks. The result contributed an in-depth analysis of a major forum of fiber optics and a systematic and streamlined method to keep abreast of the history and the state of the research of fiber optics. Addresses: Beijing Univ Technol, Sch Econ & Management, Beijing 100124, Peoples R China Reprint Address: Liu, JW, Beijing Univ Technol, Sch Econ & Management, Beijing 100124, Peoples R China. Cited Reference Count: 6 Times Cited: 0 Publisher: IEEE Publisher Address: 345 E 47TH ST, NEW YORK, NY 10017 USA ISBN: 978-1-4244-2107-7 29-char Source Abbrev.: I C WIREL COM NETW MOBILE COM Source Item Page Count: 4 Subject Category: Telecommunications ISI Document Delivery No.: BIW81 *WIK FIB BRAGG GRAT : 2008 *WIK OPT COH TOM : 2008 CHEN CM CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 57 : 359 DOI 10.1002/asi.20317 2006 CHEN CM Searching for intellectual turning points: Progressive knowledge domain visualization PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA 101 : 5303 DOI 10.1073/pnas.0307513100 2004 FITZPATRICK C OPTICAL FIBRE SENSOR : 2008 FREUDENRICH C FIBER OPTICS WORK : 2008 From garfield at CODEX.CIS.UPENN.EDU Tue Apr 14 11:33:14 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 14 Apr 2009 11:33:14 -0400 Subject: Celiktas, MS (Celiktas, Melih Soner); Sevgili, T (Sevgili, Tarkan); Kocar, G (Kocar, Gunnur) A snapshot of renewable energy research in Turkey RENEWABLE ENERGY, 34 (6): 1479-1486 JUN 2009 Message-ID: E-mail Address: soner.celiktas at ege.edu.tr Author(s): Celiktas, MS (Celiktas, Melih Soner); Sevgili, T (Sevgili, Tarkan); Kocar, G (Kocar, Gunnur) Title: A snapshot of renewable energy research in Turkey Source: RENEWABLE ENERGY, 34 (6): 1479-1486 JUN 2009 Language: English Document Type: Article Author Keywords: Renewable energy; Energy; Scientometric; Science; Technology; R&D KeyWords Plus: BIBLIOMETRIC ANALYSIS; EXERGY ANALYSIS; LOTKA LAW; BIOMASS; PRODUCTIVITY; CONVERSION; STORAGE; FUELS; PLANT; POWER Abstract: The present study was conducted to find out the development trends of the scientific studies in the field of renewable energies in Turkey. All the publications in the ISI Web database were screened using 36 different keywords in title or topics based on the affiliation addresses including the word "Turkey". A total of 12,197 publications were processed article by article and as a result 1555 papers were found to focus on renewable energies between the years 1980 and 2008 with the contributions of 1605 authors. The results showed that 45.2% was experimental, 34.3% informational studies whereas 20.5% was available system analysis. Number of publications in biomass and conversion system (39.1%) and solar energy systems (20.0%) were dominating. Both number of publications and citations increased in the last decade and more than half of total contributions were published last four years. Results indicated that policy development studies (3.3%) were the weakest among the whole parameters investigated. (c) 2008 Elsevier Ltd. All rights reserved. Addresses: [Celiktas, Melih Soner; Sevgili, Tarkan] Ege Univ, Sci & Technol Res Ctr, EBILTEM, Izmir, Turkey; [Kocar, Gunnur] Ege Univ, Solar Energy Inst, Izmir, Turkey Reprint Address: Celiktas, MS, Ege Univ, Sci & Technol Res Ctr, EBILTEM, Izmir, Turkey. E-mail Address: soner.celiktas at ege.edu.tr Cited Reference Count: 41 Times Cited: 0 Publisher: PERGAMON-ELSEVIER SCIENCE LTD Publisher Address: THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, ENGLAND ISSN: 0960-1481 DOI: 10.1016/j.renene.2008.10.021 29-char Source Abbrev.: RENEWABLE ENERGY ISO Source Abbrev.: Renew. Energy Source Item Page Count: 8 Subject Category: Energy & Fuels ISI Document Delivery No.: 420RI *REN21 REN 2007 GLOB STAT R : 2008 BAO X IEA AEGSET WORKSH NO : 2005 BENGISU M Forecasting emerging technologies with the aid of science and technology databases TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE 73 : 835 DOI 10.1016/j.techfore.2005.09.001 2006 CHIU WT Bibliometric analysis of homeopathy research during the period of 1991 to 2003 SCIENTOMETRICS 63 : 3 2005 DALPE R Bibliometric analysis of biotechnology SCIENTOMETRICS 55 : 189 2002 DEMIRBAS A Energy balance, energy sources, energy policy, future developments and energy investments in Turkey ENERGY CONVERSION AND MANAGEMENT 42 : 1239 2001 DEMIRBAS A Biomass resource facilities and biomass conversion processing for fuels and chemicals ENERGY CONVERSION AND MANAGEMENT 42 : 1357 2001 DEMIRBAS A Mechanisms of liquefaction and pyrolysis reactions of biomass ENERGY CONVERSION AND MANAGEMENT 41 : 633 2000 DEMIRBAS A Turkey's water resources and hydropower potential ENERGY EXPLORATION & EXPLOITATION 21 : 405 2003 EDIGER VS Renewable energy potential as an alternative to fossil fuels in Turkey ENERGY CONVERSION AND MANAGEMENT 40 : 743 1999 FANG PH A MODIFICATION OF LOTKA FUNCTION FOR SCIENTIFIC PRODUCTIVITY INFORMATION PROCESSING & MANAGEMENT 31 : 133 1995 GARFIELD E CONTRACT RESEARCH SERVICES AT ISI - CITATION ANALYSIS FOR GOVERNMENT, INDUSTRY, AND ACADEMIC CLIENTS CURRENT CONTENTS 23 : 5 1992 GARFIELD E ESSAYS INFORM SCI 1 : 133 1970 GUNERHAN GG Geothermal energy utilization in Turkey INTERNATIONAL JOURNAL OF ENERGY RESEARCH 25 : 769 2001 HASSAN E The evolution of the knowledge structure of fuel cells SCIENTOMETRICS 62 : 223 2005 HEPBASLI A Energy and exergy analysis of a ground source (geothermal) heat pump system ENERGY CONVERSION AND MANAGEMENT 45 : 737 DOI 10.1016/S0196-8904(03)00185- 7 2004 KANOGLU M Exergy analysis of a dual-level binary geothermal power plant GEOTHERMICS 31 : 709 2002 KAYGUSUZ K Hydropower potential in Turkey ENERGY SOURCES 21 : 581 1999 KAYGUSUZ K The viability of thermal energy storage ENERGY SOURCES 21 : 745 1999 KAYGUSUZ K Energy and water potential of the Southeastern Anatolia Project (GAP) ENERGY SOURCES 21 : 913 1999 MIDILLI A Mathematical modeling of thin layer drying of pistachio by using solar energy ENERGY CONVERSION AND MANAGEMENT 44 : 1111 2003 NAGPAUL PS EMERGING TRENDS SCIE : 1999 NALIMOV VV NAUKOMETRIYA IZUCHEN : 1969 NICHOLLS PT EMPIRICAL VALIDATION OF LOTKA LAW INFORMATION PROCESSING & MANAGEMENT 22 : 417 1986 NWAGWU W A bibliometric analysis of productivity patterns of biomedical authors of Nigeria during 1967-2002 SCIENTOMETRICS 69 : 259 DOI 10.1007/s11192-006-0152-7 2006 OBYRNE D FINANCIAL TIMES 0610 : 2008 OGULATA RT Energy sector and wind energy potential in Turkey RENEWABLE & SUSTAINABLE ENERGY REVIEWS 7 : 469 DOI 10.1016/S1364-0321(03) 00090-X 2003 OZTOPAL A On the regional wind energy potential of Turkey ENERGY 25 : 189 2000 PAO ML LOTKA LAW - A TESTING PROCEDURE INFORMATION PROCESSING & MANAGEMENT 21 : 305 1985 PRITCHARD A STATISTICAL BIBLIOGRAPHY OR BIBLIOMETRICS JOURNAL OF DOCUMENTATION 25 : 348 1969 SCHUBERT A Scientometrics: A citation based bibliography, 1990 SCIENTOMETRICS 35 : 155 1996 SEN Z Regional assessment of wind power in western Turkey by the cumulative semivariogram method RENEWABLE ENERGY 12 : 169 1997 STREHL L CIENC HOJE 31 : 34 2002 THOMAS SM THE EVALUATION OF PLANT BIOMASS RESEARCH - A CASE-STUDY OF THE PROBLEMS INHERENT IN BIBLIOMETRIC INDICATORS SCIENTOMETRICS 23 : 149 1992 TOGRUL IT A study for estimating solar radiation in Elazig using geographical and meteorological data ENERGY CONVERSION AND MANAGEMENT 40 : 1577 1999 TRIMM DL Onboard fuel conversion for hydrogen-fuel-cell-driven vehicles CATALYSIS REVIEWS-SCIENCE AND ENGINEERING 43 : 31 2001 TSAY MY A bibliometric analysis of hydrogen energy literature, 1965-2005 SCIENTOMETRICS 75 : 421 DOI 10.1007/s11192-007-1785-x 2008 ULGEN K Determination of Weibull parameters for wind energy analysis of Izmir, Turkey INTERNATIONAL JOURNAL OF ENERGY RESEARCH 26 : 495 2002 VANRAAN AFJ Scientometrics: State-of-the-art SCIENTOMETRICS 38 : 205 1997 WILSON CS Informetrics ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY 34 : 107 1999 YILDIRIM T Titanium-decorated carbon nanotubes as a potential high-capacity hydrogen storage medium PHYSICAL REVIEW LETTERS 94 : ARTN 175501 2005 From garfield at CODEX.CIS.UPENN.EDU Tue Apr 14 11:37:43 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 14 Apr 2009 11:37:43 -0400 Subject: Grzybowski, A (Grzybowski, Andrzej) The Journal Impact Factor: How to interpret its true value and importance MEDICAL SCIENCE MONITOR, 15 (2): SR1-SR4 FEB 2009 Message-ID: E-mail Address: grzyb at am.poznan.pl Author(s): Grzybowski, A (Grzybowski, Andrzej) Title: The Journal Impact Factor: How to interpret its true value and importance Source: MEDICAL SCIENCE MONITOR, 15 (2): SR1-SR4 FEB 2009 Language: English Document Type: Article Author Keywords: journal impact factor; parametrization of science; scientometrics KeyWords Plus: SCIENCE Abstract: In 1955, Garfield suggested that the number of references could be used to measure the "impact" of a journal, but the term "impact factor" was introduced 1963 by Garfield and Sher. The primary goal of impact factor analysis was to improve the management of library journal collections. Single-parameter measurements of the quality of a journal article have become increasingly popular as a substitute for scientific quality. The simplicity of its counting system and convenience of its use are significant benefits. Probably for these reasons, funding bodies, academic authorities, and some governments began using the impact factor to guide decisions about allocating grants, awarding appointments and academic degrees, and defining scientific policy. The journal impact factor, which is often recognized as a symbol of scientific prestige and relevance, can be, however, greatly influenced by the type of medical article (review vs original work), clinical specialty, and research. The true value and implications of the journal impact factor (JIF) are important to understand. It is critical to remember that JIF can be used only to evaluate journals. All comparisons should include only journals and never individuals or departments. Only similar journals (particularly those dedicated to the same scientific specialty) must be compared, because the value of the impact factor varies greatly by discipline. Addresses: [Grzybowski, Andrzej] Karol Marcinkowski Univ Med Sch Poznan, Dept Hist Med, PL-60812 Poznan, Poland; [Grzybowski, Andrzej] Poznan City Hosp, Dept Ophthalmol, Poznan, Poland Reprint Address: Grzybowski, A, Karol Marcinkowski Univ Med Sch Poznan, Dept Hist Med, Bukowska 70, PL-60812 Poznan, Poland. E-mail Address: grzyb at am.poznan.pl Cited Reference Count: 23 Times Cited: 0 Publisher: INT SCIENTIFIC LITERATURE, INC Publisher Address: 1125 WILLIS AVE, ALBERTSON, NY 11507 USA ISSN: 1234-1010 29-char Source Abbrev.: MED SCI MONITOR ISO Source Abbrev.: Med. Sci. Monitor Source Item Page Count: 4 Subject Category: Medicine, Research & Experimental ISI Document Delivery No.: 420PD *ISI J CITATION REPORTS : BROWN H How impact factors changed medical publishing - and science BRITISH MEDICAL JOURNAL 334 : 561 2007 GAFIELD E THOMSON SCI IMPACT F : GARFIELD E AGONY ECSTASY HIST M : GARFIELD E NEW FACTORS IN EVALUATION OF SCIENTIFIC LITERATURE THROUGH CITATION INDEXING AMERICAN DOCUMENTATION 14 : 195 1963 GARFIELD E How can impact factors be improved? BRITISH MEDICAL JOURNAL 313 : 411 1996 GARFIELD E CITATION ANALYSIS AS A TOOL IN JOURNAL EVALUATION - JOURNALS CAN BE RANKED BY FREQUENCY AND IMPACT OF CITATIONS FOR SCIENCE POLICY STUDIES SCIENCE 178 : 471 1972 GARFIELD E CITATION INDEXES FOR SCIENCE - NEW DIMENSION IN DOCUMENTATION THROUGH ASSOCIATION OF IDEAS SCIENCE 122 : 108 1955 GARFIELD E USE J IMPACT FACTORS : GRACZYNSKI MR Personal Impact Factor: The need for speed MEDICAL SCIENCE MONITOR 14 : ED1 2008 GROSS PLK SCIENCE 66 : 385 1927 GRZYBOWSKI A The development and future of Polish Science in Medicine once again KARDIOLOGIA POLSKA 66 : 1024 2008 HA TC The journal impact factor: Too much of an impact? ANNALS ACADEMY OF MEDICINE SINGAPORE 35 : 911 2006 HALL AR PHILOS WAR QUARREL N : 2002 KANTHRAJ GR IJDVL 72 : 322 2006 MABE M Growth dynamics of scholarly and scientific journals SCIENTOMETRICS 51 : 147 2001 MCGARTY C CURRENT RES SOCIAL P 5 : 1 2000 MCVEIGH M J SELF CITATION J CI : 2002 SATYANARAYANA K Impact factor: Time to move on INDIAN JOURNAL OF MEDICAL RESEARCH 127 : 4 2008 SEGLEN PO BRIT MED J 314 : 497 1997 TESTA J THOMSON SCI J SELECT : VALLE E COLLECTIVE INTELLIGE : 1665 1999 WILLIAMS G Should we ditch impact factors? Yes BRITISH MEDICAL JOURNAL 334 : 568 2007 From garfield at CODEX.CIS.UPENN.EDU Tue Apr 14 12:26:34 2009 From: garfield at CODEX.CIS.UPENN.EDU (=?windows-1252?Q?Eugene_Garfield?=) Date: Tue, 14 Apr 2009 12:26:34 -0400 Subject: Sharan, U (Sharan, Umang); Neville, J (Neville, Jennifer) Temporal-Relational Classifiers for Prediction in Evolving Domains ICDM 2008: EIGHTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS: 540-549 2008 Message-ID: Author(s): Sharan, U (Sharan, Umang); Neville, J (Neville, Jennifer) Editor(s): Gunopulos, D; Turini, F; Zaniolo, C; Ramakrishnan, N; Wu, XD Book Author(s): Giannotti, F Title: Temporal-Relational Classifiers for Prediction in Evolving Domains Source: ICDM 2008: EIGHTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS: 540-549 2008 Book series title: IEEE International Conference on Data Mining Language: English Document Type: Proceedings Paper Conference Title: 8th IEEE International Conference on Data Mining Conference Date: DEC 15-19, 2008 Conference Location: Pisa, ITALY Conference Sponsors: IEEE.; Yahoo Res.; WIND.; Microsoft.; Ask com.; IBM.; Natl Sci Fdn.; coop.; base.; Univ Pisa.; Brite.; Comune Pisa.; Prov Pisa.; Prov Lucca.; Inst Sci & Tecnol Informazione.; Consiglio Nazl Ric.; GeoPKDD.; Camera Commercia Pisa. Abstract: Many relational domains contain temporal information and dynamics that are important to model (e.g., social networks, protein networks). However past work in relational learning has focused primarily on modeling static "snap-shots" of the data and has largely ignored the temporal dimension of these data. In. this work we extend relational techniques to temporally-evolving domains and outline a representational framework that is capable of modeling both temporal and relational dependencies in the data. We develop efficient learning and inference techniques within the framework by considering a restricted set of temporal-relational dependencies and using parameter-tying methods to generalize across relationships and entities. More specifically, we model dynamic relational data with a two-phase process, first summarizing the temporal-relational information with kernel smoothing, and then moderating attribute dependencies with the summarized relational information. We develop a number of novel temporal-relational models using the framework and then show that the current approaches to modeling static relational data are special cases within the framework. We compare the new models to the competing static relational methods on three real-world datasets and show that the temporal-relational models consistently outperform the relational models that ignore temporal information-achieving significant reductions in error ranging from 15% to 70%. Addresses: [Sharan, Umang] Purdue Univ, Dept Comp Sci, W Lafayette, IN 47907 USA Reprint Address: Sharan, U, Purdue Univ, Dept Comp Sci, W Lafayette, IN 47907 USA. Cited Reference Count: 24 Times Cited: 0 Publisher: IEEE COMPUTER SOC Publisher Address: 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA ISSN: 1550-4786 ISBN: 978-0-7695-3502-9 29-char Source Abbrev.: IEEE DATA MINING Source Item Page Count: 10 ISI Document Delivery No.: BJA60 AMITAY E Trend detection through temporal link analysis JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY 55 : 1270 DOI 10.1002/asi.20082 2004 BHARAT K P IEEE INT C DAT MIN : 2001 BLAU H 0128 U MASS AMH COMP : 2001 CAI D P 9 EUR C PRINC PRAC : 2005 CHAKRABARTI S P ACM SIGMODD INT C : 1998 CORTES C P 4 INT S INT DAT AN : 2001 DOMINGOS P On the optimality of the simple Bayesian classifier under zero-one loss MACHINE LEARNING 29 : 103 1997 DOMINGOS P P 7 ACM SIGKDD INT C : 2001 EGGHE L J AM SOC INF SCI TEC 52 : 2001 FRIEDMAN N P 16 INT JOINT C ART : 1999 GARFIELD E CITATION ANALYSIS AS A TOOL IN JOURNAL EVALUATION - JOURNALS CAN BE RANKED BY FREQUENCY AND IMPACT OF CITATIONS FOR SCIENCE POLICY STUDIES SCIENCE 178 : 471 1972 GHAHRAMANI Z Learning dynamic Bayesian networks ADAPTIVE PROCESSING OF SEQUENCES AND DATA STRUCTURES 1387 : 168 1998 GUESTRIN C P INT JOINT C ART IN : 2003 GUO F P 24 INT C MACH LEAR : 2007 J COMPUTATIONAL GRAP : 2006 JENSEN D P 19 INT C MACH LEAR : 2002 KUMAR R P 12 INT WWW C : 2003 MCCALLUM A P 16 INT JOINT C ART : 1999 NEVILLE J P 11 ACM SIGKDD INT : 2005 NEVILLE J P 3 IEEE INT C DAT M : 2003 NEVILLE J P 9 ACM SIGKDD INT C : 2003 PERLICH C P 9 ACM SIGKDD INT C : 2003 SNIJDERS TAB J SOCIAL STRUCTURE 3 : 2 2002 TASKAR B P 18 C UNC ART INT : 2002 From darvish at CANKAYA.EDU.TR Wed Apr 15 04:28:23 2009 From: darvish at CANKAYA.EDU.TR (Hamid R. Darvish) Date: Wed, 15 Apr 2009 11:28:23 +0300 Subject: PhD position =?iso-8859-9?Q?=84Measuring_the_Diversity_o_f_Research=93?= In-Reply-To: <49E4664F.7010108@cms.hu-berlin.de> Message-ID: Prof. Tonta, I lke to get your attention about the attached Thesis proposal by below University. They are trying implement LSA "again" for their Thesis( http://www.collnet.de/Berlin-2008/MitesserWIS2008mdr.pdf) can be found in the address). As you might recall, also, during our recent conversation, I was thinking of a novell approach using LSA for the Hacettepe Library or similar to it and so on.... For yor information. -best, > Adminstrative info for SIGMETRICS (for example unsubscribe): > http://web.utk.edu/~gwhitney/sigmetrics.html > > PhD position ?Measuring the Diversity of Research? > Humboldt-Universitaet zu Berlin, Institut fuer Bibliotheks- und > Informationswissenschaft > > Project description: > The aim of the project is to develop and to assess bibliometric methods > for measuring the diversity of research outputs of international > scientific communities, their national sub-communities, and research > organizations. The PhD candidate is expected to develop bibliometric > methods, to translate them into algorithms and computer programmes, and > to experiment with the methods. A publication from the project is > available at > http://www.collnet.de/Berlin-2008/MitesserWIS2008mdr.pdf > For further information please contact Frank Havemann (frank.havemann > (at) ibi.hu-berlin.de). > > Requirements: > The project combines knowledge and methods from several fields including > Advanced statistics and linear algebra; > Bibliometrics; > Software development (scripts, preferably R, perl or MySQL, other > languages possible); and > Sociology of science. > In addition to an excellent masters degree in the natural or social > sciences we expect the willingness and ability to acquire and combine > knowledge from these fields. Fluency in English is a requirement. > > Conditions of employment: > Start: As soon as possible after 1 May 2009. > Duration: 3 years > Maximum hours per week: 20 > Salary: about 1100 EURO after tax > Please send your applications to Frank Havemann (frank.havemann (at) > ibi.hu-berlin.de) > Deadline: 29 April 2009 > announcement in German: > http://www.hu-info.hu-berlin.de/2009/07 > -- PhD. Student at Information Management Department in Hacettepe University, Ankara Turkey. Ogretmenler Caddesi No:14 Yuzuncuyil 06530 Ankara Tel 0312 284 45 00 /170 Cankaya University http://academic.cankaya.edu.tr/~darvish www.cankaya.edu.tr From eugene.garfield at THOMSONREUTERS.COM Wed Apr 15 15:59:52 2009 From: eugene.garfield at THOMSONREUTERS.COM (Eugene Garfield) Date: Wed, 15 Apr 2009 15:59:52 -0400 Subject: New book by Nicola de Bellis "Bibliometrics and Citation Analysis" from Scarecrow Press Message-ID: Subscribers to this listserv will want to read this magnificent work by a scholar with an incredible knowledge of the history of our field. I first heard about it when it was published in Italian and suggested the author make it available in English translation. He went beyond that suggestion and completely revised it and produced an excellent index. I rarely make predictions but expect this work will become a classic. Eugene Garfield Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics Nicola De Bellis Can the methods of science be directed toward science itself? How did it happen that scientists, scientific documents, and their bibliographic links came to be regarded as mathematical variables in abstract models of scientific communication? What is the role of quantitative analyses of scientific and technical documentation in current science policy and management? Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics answers these questions through a comprehensive overview of theories, techniques, concepts, and applications in the interdisciplinary and steadily growing field of bibliometrics. Since citation indexes came into the limelight during the mid-1960s, citation networks have become increasingly important for many different research fields. The book begins by investigating the empirical, philosophical, and mathematical foundations of bibliometrics, including its beginnings with the Science Citation Index, the theoretical framework behind it, and its mathematical underpinnings. It then examines the application of bibliometrics and citation analysis in the sciences and science studies, especially the sociology of science and science policy. Finally it provides a view of the future of bibliometrics, exploring in detail the ongoing extension of bibliometric methods to the structure and dynamics of the World Wide Web. This book gives newcomers to the field of bibliometrics an accessible entry point to an entire research tradition otherwise scattered through a vast amount of journal literature. At the same time, it brings to the forefront the cross-disciplinary linkages between the various fields (sociology, philosophy, mathematics, politics) that intersect at the crossroads of citation analysis. Because of its discursive and interdisciplinary approach, the book is useful to those in every area of scholarship involved in the quantitative analysis of information exchanges, but also to science historians and general readers who simply wish to familiarize themselves with an important, albeit increasingly complex area of information science. Nicola De Bellis is a medical librarian at the University of Modena and Reggio Emilia. THE SCARECROW PRESS, INC. $55.00 * Paper * 0-8108-6713-3 | 978-0-8108-6713-0 * March 2009 * 450 pp -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 24689 bytes Desc: image001.jpg URL: From p.vandenbesselaar at RATHENAU.NL Sun Apr 19 05:24:41 2009 From: p.vandenbesselaar at RATHENAU.NL (Peter van den Besselaar) Date: Sun, 19 Apr 2009 11:24:41 +0200 Subject: Workshop on Interdisciplinarity in ISSI Conference In-Reply-To: <49C62FC7.2020300@googlemail.com> Message-ID: Hi Ismael I changed my holidays and are able to go to Rio. Is it still possible to submit a paper? I need a few days. best peter Peter van den Besselaar --------------------------------------- professor, head of department Rathenau Instituut Dpt. Science System Assessment ________________________________________ From: ASIS&T Special Interest Group on Metrics [SIGMETRICS at LISTSERV.UTK.EDU] On Behalf Of Ismael Rafols [ismaelrafols at GOOGLEMAIL.COM] Sent: Sunday, March 22, 2009 1:32 PM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] Workshop on Interdisciplinarity in ISSI Conference /12//th //International Conference on Scientometrics and Informetrics Rio de Janeiro, 14-17 July 2009 (//http://www.issi2009.org //)/ Call for papers and presentations ISSI 2009 Conference Workshop on July 14th: */Tracking and evaluating interdisciplinary research: metrics and maps/* This workshop aims to contrast perspectives on how to measure and map interdisciplinary research, exploring recent advances on three research fronts: 1. Conceptualizations and associated measures of interdisciplinarity, e.g. in terms of knowledge integration, network analyses, and disciplinary diversity. 2. Varied approaches to visualize (map) the relative position of bodies of research, ranging from that of an investigator to an emerging field. 3. Assessment of the benefits and downsides of interdisciplinary research (e.g., on citation impact), and the ensuing science policy implications. The workshop will include comments by selected discussants and time to exchange ideas and to identify promising research avenues. /See attachment for more details/ *Workshop organisers:* Alan Porter, Georgia Institute of Technology, US, alan.porter at isye.gatech.edu Ismael Rafols, SPRU, University of Sussex, England, i.rafols at sussex.ac.uk *Submissions:* Please send your contributions to Ismael Rafols (email: i.rafols at sussex.ac.uk ) by April 17^th , 2009. Submissions may include short papers (max. 2,000 words or 5 pages) or full presentations (max. 5,000 or 12 pages), author(s) name, affiliation and contact details. *Important dates:* Deadline for submission: April 17^th Acceptance decision by May 12^th *Registration and fees: *see ISSI conference registration webpage ** *Program Committee:* Chair: Alan Porter (Georgia Institute of Technology, US) Kevin Boyack (Map of Science, US) Loet Leydesdorff (University of Amsterdam, The Netherlands) Fernanda Morillo (CSIC, Spain) Ed Noyons (CTWS, University of Leiden, The Netherlands) David Roessner (SRI, US) Michel Zitt (INRA and Observatoire des Science et des Techniques, France) -- __________________________________________________________ Ismael Rafols, Research Fellow SPRU -Science and Technology Policy Research University of Sussex, Brighton, BN1 9QE, England i.rafols at sussex.ac.uk, +44(0)78 53865382 or ismaelrafols @ skype http://www.sussex.ac.uk/spru/irafols ___________________________________________________________ From ismaelrafols at GOOGLEMAIL.COM Mon Apr 20 20:37:35 2009 From: ismaelrafols at GOOGLEMAIL.COM (Ismael Rafols) Date: Tue, 21 Apr 2009 01:37:35 +0100 Subject: Workshop on Interdisciplinarity in ISSI Conf: Extension until April 30th Message-ID: Extended until *April 30th* 2009 the deadline for submission to the workshop: *Tracking and evaluating interdisciplinary research: metrics and maps* /ISSI 2009 Conference Workshop on July 14th, Rio de Janeiro/ This workshop aims to contrast perspectives on how to measure and map interdisciplinary research, exploring recent advances on three research fronts: 1.Conceptualizations and associated measures of interdisciplinarity, e.g. in terms of knowledge integration, network analyses, and disciplinary diversity. 2.Varied approaches to visualize (map) the relative position of bodies of research, ranging from that of an investigator to an emerging field. 3.Assessment of the benefits and downsides of interdisciplinary research (e.g., on citation impact), and the ensuing science policy implications. The workshop will include comments by selected discussants and time to exchange ideas and to identify promising research avenues. For more details visit webpage: http://www.issi2009.org/php/level.php?lang=en&component=56&item=1 *Workshop organisers* Alan Porter, Georgia Institute of Technology, US, alan.porter at isye.gatech.edu Ismael Rafols, SPRU, University of Sussex, England, i.rafols at sussex.ac.uk *Submissions*: Please send your contributions to Ismael Rafols (email: i.rafols at sussex.ac.uk ) by April 17th, 2009 (extended to *April 30th*). Submissions may include short papers (max. 2,000 words or 5 pages) or full presentations (max. 5,000 or 12 pages), author(s) name, affiliation and contact details. *Important dates* Deadline for submission: April 17th (extended to *April 30th*) Acceptance decision by May 12th *Registration and fees*: see ISSI conference registration webpage (http://www.issi2009.org) *Program Committee* Chair: Alan Porter (Georgia Institute of Technology, US) Kevin Boyack (Map of Science, US) Loet Leydesdorff (University of Amsterdam, The Netherlands) Fernanda Morillo (CSIC, Spain) Ed Noyons (CTWS, University of Leiden, The Netherlands) David Roessner (SRI, US) Michel Zitt (INRA and Observatoire des Science et des Techniques, France) From joachim.schopfel at UNIV-LILLE3.FR Mon Apr 27 15:44:30 2009 From: joachim.schopfel at UNIV-LILLE3.FR (Joachim SCHOPFEL) Date: Mon, 27 Apr 2009 21:44:30 +0200 Subject: International Symposium - last call for papers Message-ID: Last call for papers - new deadline 4 May 2009 *International Symposium "Academic Online Resources: * *Assessment and Usage"* *Lille (France), 26-27 November 2009 (http://epef.anr.free.fr) * *Charles de Gaulle University Lille 3* *GERiiCO laboratory ? SID team* *Suggested topics * 1. Access statistics: empirical studies 2. Usage behaviours in academic environment: plural methodologies 3. Metrics and assessment 4. Tools, standards, and services: prospective analyses 5. Access statistics and scientific research assessment 6. Usage behaviours and business models for academic online resources 7. Academic libraries in a digital environment: usage profiles and new services 8. New publishing models and access statistics 9. Usage assessment of new information resources: datasets, multimedia 10. Usage of online resources, competencies, and information literacy (Google generation) The symposium is open to contributions from France and other countries. Expected languages are French and English. Submission of proposals at the following address: xaviersense at wanadoo.fr Each tender for communication should include identity of the speaker and his contact numbers (name - corporate name - telephone - fax - addresses - e-mail), references and a short biography, title of the intervention with the selected theme, a summary of about 6000 characters (without blanks) written in French or English, and three key-words. -------------- next part -------------- An HTML attachment was scrubbed... URL: From blar at DB.DK Tue Apr 28 16:48:02 2009 From: blar at DB.DK (Birger Larsen) Date: Tue, 28 Apr 2009 22:48:02 +0200 Subject: ISSI 2009 CFP - early bird registration deadline: April 30 In-Reply-To: A<4690.81.56.1.91.1240861470.squirrel@webmail.univ-lille3.fr> Message-ID: (Apologies for cross postings) CALL FOR PARTICIPATION ISSI 2009 - 12th International Conference on Scientometrics and Informetrics July 14-17, 2009, Rio de Janeiro, Brazil http://www.issi2009.org *** Early bird registration deadline: April 30 *** *** List of accepted papers now online *** SCOPE The biannual ISSI conference is the premier international venue for research within the areas of informetrics, scientometrics and bibliometrics. The purpose of the ISSI 2009 conference is to bring together scientists, research managers and authorities, as well as information and communication related professionals in an open international forum to discuss advancements of theory and applications in the field, and to shape future research directions through the publication of high quality applied and theoretical research findings. ISSI 2009 also includes satellite workshops and a Doctoral Forum. ISSI 2009 is organised under the auspices of ISSI - the International Society for Informetrics and Scientometrics (http://www.issi-society.info/). VENUE The conference will be held at the Forum of Science and Culture, located on the Praia Vermelha Campus, which is one of the oldest and most charming buildings of the Federal University of Rio de Janeiro. The neoclassical palace built in 1852 has special installations adapted to host conferences and workshops. The City of Rio de Janeiro is an awe-inspiring city of contrasts. Impossibly steep granite mountains jut out of the ocean between glorious stretches of golden sand, impeccable colonial buildings nestle in between modern glass skyscrapers and verdant forests tumble down hillsides into densely populated residential areas. It is a city high on life, a city of beach worship, football, samba and Carnival. And high above all this fun and frivolity stands Rio's ever-present, iconic landmark - the statue of Christ the Redeemer. IMPORTANT DATES Early Bird Registration April 30, 2009 Conference Dates Workshops and Doctoral Forum: July 14, 2009 Main Conference: July 15-17, 2009 ORGANIZERS ISSI 2009 Chairs: Abel L. Packer (BIREME/PAHO/WHO, Brazil) Ronald Rousseau (KHBO, Belgium) Program Chairs: Birger Larsen (Royal School of Library & Information Science, Denmark) Jacqueline Leta (Universidade Federal do Rio de Janeiro, Brazil) Conference Chairs: Jacqueline Leta (Universidade Federal do Rio de Janeiro, Brazil) Rog?rio Meneghini (BIREME/PAHO/WHO, Brazil) Poster Chairs: Jane M. Russell (Universidad Nacional Aut?noma de M?xico, Mexico) Martin Meyer (University of Sussex, UK) Satellite Workshop Chair: Peter Ingwersen (Royal School of Library & Information Science, Denmark) Doctoral Forum Chairs: Jesper W. Schneider (Royal School of Library & Information Science, Denmark) Sonia M. R. Vasconcelos (Universidade Federal do Rio de Janeiro, Brazil) Regional Program Chairs: Africa: Dennis Ocholla (University of Zululand, South Africa) Australia / Oceania: Mari Davis (University of New South Wales, Australia) China / East Asia: Liming Liang (Henan Normal University, China) Europe: Wolfgang Gl?nzel (Katholieke Universiteit Leuven, Belgium) India / Middle east: Aparna Basu (University of Delhi, India) Latin America: Manuel Krauskopf (Universidad Nacional Andr?s Bello, Chile) North America: Katy B?rner (Indiana University, USA) In addition ISSI 2009 has an international scientific committee and a national committee. CONFIRMED SPONSORS CNPq - National Council for Scientific and Technological Development, Brazil The Eugene Garfield Foundation Thomson Reuters Elsevier CONTACT See http://www.issi2009.org/php/contact.php?lang=en