From garfield at CODEX.CIS.UPENN.EDU Mon Jul 8 15:20:43 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Mon, 8 Jul 2002 15:20:43 -0400 Subject: Wang YT, Kitsuregawa M "Use Link-based Clustering to Improve Web Search Results" Message-ID: kitsure at tkl.iis.u-tokyo.ac.jp Title Use Link-based Clustering to Improve Web Search Results Author Yitong Wang and Masaru Kitsuregawa The University of Tokyo Source Proceedings of the 2nd International Conference on Web Information Systems Engineering (WISE'01) Members who have access to IEEE Computer Society can access the article at : http://dlib2.computer.org/conferen/wise/1393/pdf/volume1/13930115.pdf Abstract While web search engine could retrieve information on the Web for a specific topic, users have to step a long ordered list in order to locate the needed information, which is often tedious and less efficient. In this paper, we propose a new link-based clustering approach to cluster search results returned from Web search engine by exploring both co-citation and coupling. Unlike document clustering algorithms in IR that are based on common words/phrases shared among documents, our approach is based on common links shared by pages. We also extend standard clustering algorithm, K-means, to make it more natural to handle noises and apply it to web search results. By filtering some irrelevant pages, our approach clusters high quality pages in web search results into semantically meaningful groups to facilitate users'accessing and browsing. Preliminary experiments and evaluations are conducted to investigate its effectiveness. The experimental results show that link-based clustering of web search results is promising and beneficial. Keywords: link analysis, co-citation, coupling, hub, authority Proceedings of the 2nd International Conference on Web Information Systems Engineering (WISE'01) Copyright (c) 2002 Institute of Electrical and Electronics Engineers, Inc. All rights reserved. From garfield at CODEX.CIS.UPENN.EDU Mon Jul 8 15:33:19 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Mon, 8 Jul 2002 15:33:19 -0400 Subject: Hahn KL, Faulkner LA "Evaluative usage-based metrics for the selection of e-journals" College & Research Libraries 63(3):215-227, May 2002 Message-ID: Karla L. Hahn : kh86 at umail.umd.edu Lila A. Faulkner : lf71 at umail.umd.edu Title Evaluative usage-based metrics for the selection of e-journals Author Hahn KL, Faulkner LA Source COLLEGE & RESEARCH LIBRARIES 63 (3): 215-227 MAY 2002 Document type: Article Language: English Cited References: 15 Times Cited: 0 Abstract: To measure the value of print journals, librarians have gathered a range of statistics and developed a variety of metrics. Similar work to assess the value of e-journals has just begun. This article explores the usefulness of available e-journal usage statistics and develops three metrics and three benchmarks based on those metrics. The proposed metrics build on earlier work that assesses the value of print journals, although the earlier work is modified extensively to fit the e- journal arena. The e-journal statistics and metrics are further transformed to address a completely new area of application: the evaluation of potential purchases. Statistics and metrics are used to build three benchmark measures for assessing e-journal candidates for purchase. A comparison of Science and Nature site licenses illustrates the utility of the assessment benchmarks. The benchmarks, metrics, and statistics developed here provide a reliable framework for assessing both current collections and candidate collections of e-journals. Implications for standards development are clear; content measures are desperately needed for the development of an effective suite of e-journal statistics. Addresses: Hahn KL, Univ Maryland Lib, Baltimore, MD USA Univ Maryland Lib, Baltimore, MD USA Publisher: ASSOC COLL RESEARCH LIBRARIES, CHICAGO IDS Number: 554DV ISSN: 0010-0870 From garfield at CODEX.CIS.UPENN.EDU Mon Jul 8 15:47:39 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Mon, 8 Jul 2002 15:47:39 -0400 Subject: Chen JCH, Chong PP, Chen YS "Decision criteria consolidation: A theoretical foundation of Pareto Principle to Porter's Competitive Forces" JOURNAL OF ORGANIZATIONAL COMPUTING AND ELECTRONIC COMMERCE11 (1): 1-14 2001 Message-ID: JCH C hen : chen at gonzaga.edu Title Decision criteria consolidation: A theoretical foundation of Pareto Principle to Porter's Competitive Forces Author Chen JCH, Chong PP, Chen YS Journal JOURNAL OF ORGANIZATIONAL COMPUTING AND ELECTRONIC COMMERCE 11 (1): 1-14 2001 Document type: Article Language: English Cited References: 15 Times Cited: 0 Abstract: Also known as the 80/20 rule, the Pareto Principle separates a class of significant few from the trivial many. With this classification, Pareto Principle has managerial and strategic implications in many disciplines. A recent mathematical model of the Pareto Principle identifies several important factors that cause such separation; the most important 2 are the probability of new entry (can be viewed as "entry barrier") and the recentness of usage. Because the probability of new entry determines the upper bound of the usage concentration, it is deemed to be the most important factor. Observing that Porter's [1] five competitive forces are all closely related to the barrier of entry, it is apparent that the theoretical model of Pareto Principle can be used as the theoretical foundation for Porter's Five Competitive Forces. We further argue that, similar to what has been described in microeconomics, the barrier of entry is the most important factor that determines the market structure-be it monopoly or pure competition. Thus, the decision criteria in strategic planning can be greatly simplified to its effect on the barrier of entry. Furthermore, we suggest that the recentness of usage (i.e., a product not recently in use may be forgotten by customers, thus reducing the probability of its future usage), though not emphasized in Porter's theory, should also be part of the strategy formation. Author Keywords: usage concentration, usage modeling, Pareto Principle, Porter's competitive forces, market structure, entry barrier, strategy Addresses: Chen JCH, Gonzaga Univ, Sch Business Adm, Spokane, WA 99258 USA Gonzaga Univ, Sch Business Adm, Spokane, WA 99258 USA Louisiana State Univ, Dept Informat Syst & Decis Sci, Ourso Coll Business, Baton Rouge, LA 70803 USA Publisher: LAWRENCE ERLBAUM ASSOC INC, MAHWAH IDS Number: 561VQ ISSN: 1091-9392 From garfield at CODEX.CIS.UPENN.EDU Mon Jul 8 15:54:37 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Mon, 8 Jul 2002 15:54:37 -0400 Subject: Jesenak K, Kuchta L, Hlavaty V "Clay science from the publication and citation analysis perspective" GEOLOGICA CARPATHICA 53 (2): 133-136 APR 2002 Message-ID: Karol Jesenak : jesenak at fns.uniba.sk Title Clay science from the publication and citation analysis perspective Author Jesenak K, Kuchta L, Hlavaty V Journal GEOLOGICA CARPATHICA 53 (2): 133-136 APR 2002 Document type: Article Language: English Cited References: 22 Times Cited: 0 Abstract: The publication production of clay minerals is analysed on the basis of the works registered in the SCI database in 1980-2001. A continuous increase of the annual number of works in this period is registered while the proportion of the number of works devoted to individual clay minerals remains almost unchanged throughout the whole period. The subject of publication production is substantially dependent on the type of mineral followed; material research oriented papers, catalysis and organo/clay interactions research prevail among the papers with a chemical character. The average citation response to the set of analysed papers is about 10-15 citations/paper and uncited papers represent 9-35% of the total number of papers. The most cited papers (in individual years) are cited on average 109-times annually and half-time of the citations count per paper exceeds 20 years. The average time between appearing and the greatest citation response call he estimated at 5 years. Author Keywords: citation analysis, publication production, clay minerals KeyWords Plus: ELECTRON-SPIN RESONANCE, IRON-OXIDE, MONTMORILLONITE, ADSORPTION, INTERCALATION, PILLARS, FILMS Addresses: Jesenak K, Comenius Univ, Fac Sci, Dept Inorgan Chem, Bratislava 84215, Slovakia Comenius Univ, Fac Sci, Dept Inorgan Chem, Bratislava 84215, Slovakia Publisher: SLOVAK ACADEMIC PRESS LTD, BRATISLAVA IDS Number: 556HJ ISSN: 1335-0552 From garfield at CODEX.CIS.UPENN.EDU Mon Jul 8 17:22:55 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Mon, 8 Jul 2002 17:22:55 -0400 Subject: Giannakakis IA, Haidich AB, et al "Citation of randomized evidence in support of guidelines of therapeutic and preventive interventions" JOURNAL OF CLINICAL EPIDEMIOLOGY 55 (6): 545-555 JUN 2002 Message-ID: John P.A. Ioannidis : jioannid at cc.uoi.gr Title Citation of randomized evidence in support of guidelines of therapeutic and preventive interventions Author Giannakakis IA, Haidich AB, Contopoulos-Ioannidis DG, Papanikolaou GN, Baltogianni MS, Ioannidis JPA Journal JOURNAL OF CLINICAL EPIDEMIOLOGY 55 (6): 545-555 JUN 2002 Document type: Article Language: English Cited References: 29 Times Cited: 0 Abstract: Guideline statements may be supported by evidence obtained from various study designs, but randomized trials are usually considered most important for making recommendations about therapeutic and preventive interventions. This study evaluated the extent to which randomized trials are cited in guidelines published in major journals. The references of 191 guidelines of therapeutic and/or preventive interventions published in Annals of Internal Medicine, BMJ, JAMA, Lancet, NEJM and Pediatrics in 1979, 1984, 1989, 1994, and 1999, were analyzed. The percentage of guidelines not citing any randomized controlled trials (RCTs) decreased gradually from 95% in 1979 to 53% in 1999. Among 4,853 references of the guidelines, there were 393 RCTs (8.1% of total), 19 systematic reviews (0.4%), and 23 meta-analyses of RCTs (0.5%). Among 19 guidelines Published in 1999 or 1994 with <2 RCTs cited, in eight cases additional pertinent RCTs were identified that had not been cited by the guideline. There is a clear increase in the use of randomized evidence by guidelines overtime. However, several guidelines in major journals still cite few or no RCTs. (C) 2002 Elsevier Science. Inc. All rights reserved. Author Keywords: practice guidelines, randomized controlled trial, evidence, citation KeyWords Plus: CLINICAL-PRACTICE GUIDELINES, EVIDENCE-BASED MEDICINE, CONTROLLED TRIALS, NEED, QUALITY, CARE Addresses: Ioannidis JPA, Univ Ioannina, Sch Med, Dept Hyg & Epidemiol, Clin Trials & Evidence Based Med Unit, GR-45110 Ioannina, Greece Univ Ioannina, Sch Med, Dept Hyg & Epidemiol, Clin Trials & Evidence Based Med Unit, GR-45110 Ioannina, Greece George Washington Univ, Sch Med & Hlth Sci, Dept Pediat, Washington, DC 20052 USA Tufts Univ, Sch Med, Dept Med, Boston, MA 02111 USA Publisher: PERGAMON-ELSEVIER SCIENCE LTD, OXFORD IDS Number: 558GU ISSN: 0895-4356 From PI at DB.DK Tue Jul 9 10:51:35 2002 From: PI at DB.DK (Ingwersen Peter) Date: Tue, 9 Jul 2002 16:51:35 +0200 Subject: SV: [SIGMETRICS] Web citation issues Message-ID: Dear colleagues, as you may be well aware of our department was one of the first to engage into webometric analyses, in particular of web impact by means of inlinks. Several others around have done deep analyses of webometric nature to see if, for instance, there exists a correlation between citation impact and web impact/no. of inlinks (Bar Ilan) or between other indicators of recognition (e.g. RAE in the UK) and web impact (Thelwall). Sometimes there exist such correlations, but the major problem is that the web acts differently than scientific communication vehicles (no real conventions of linking etc.). Also: one may not equalize a web page with a scientific article. So Tom Wilson?s no. of hits (to web pages) does not necessarily correspond at all to "scientific items citing other scientific items" as in conventional citation analyses. Only the reading lists found by Wilson may act like such "reference lists". Further: Different search engines commonly perform differently on the same search profile, resulting in biased counts; several large quality studies have been done on "scientific" web page search results to observe the actual proportion of scientific output (see e.g. Allen et al in Science in 1999.) Results are appalling and pauvre - and highly dependent on the domain in question. For instance, in politically hot scientific topics (like in the environmental sc.-) there is a chaotic mix of scientific, semi-scientific, pseudo, popular and, foremost, political opinion papers. Should all the "published" pages count or only the peer reviewed ones - e.g. those published by scientific institutions or referring to peer reviewed journals or published in peer reviewed e-journals? Additionally, there are several possible web impacts: by inlink counts; by inlink counts and outlink counts; by web-based traditional references/citations on all the open web - or only in e-journals - with or without peer review. Tom will of course also run into the problem similar to that of ISI: in the citation databases no citations from books and non-ISI journals are counted; on the web only the open weblinks (and citations/references) are possible to count - not links/citations provided by pages/items on the hidden web (e.g. all the Dialog or ISI databases or the journals in publisher archives or in Digital Libraries. Finally, on the web the nature of obsolescence of information is quite different and not yet well understood - see e.g. Ronald Rousseau?s articles in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. A recent review on some of the issues touched upon above is: Bjorneborn, L. & Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): 65-82. Many regards - Peter Ingwersen ******************************************** Peter Ingwersen, Professor, Ph.D. Department of Information Studies Royal School of Library and Information Science, Birketinget 6, DK 2300 Copenhagen S - Denmark Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 http://www.db.dk/pi/ - e-mail: pi at db.dk Visiting Professor (Docent), Dept. of Information Studies ?bo University Akademi - Finland ******************************************** -----Oprindelig meddelelse----- Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] Sendt: 21. juni 2002 18:11 Til: SIGMETRICS at LISTSERV.UTK.EDU Emne: Re: [SIGMETRICS] Web citation (fwd) I am wholly in support of the SIGMETRICS site being one for discussion and so was interested in Tom's original submission and now Gene's response. Here comes my two penn'orth (Eng., coll., obs.?) Tom's observations are interesting - to his comment on token citations I would add (many cases of) self-citation - but I go along with Gene's uneasiness on the current haphazard coverage of the web being adequate to replace formal citation bases. Gene's final remark that the "ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended" surely requires some response. (i)I guess that "control" was a hasty first attempt and that "information" is more in line with the intended meaning. (ii) I would really like to see the phrase "freely available" inserted somewhere in the remark. At the moment, unless you are the member of a subscribing institution you don't have free access to this bibliographic information, either to "boost your ego" or to measure your impact.Citation analysis - like any othe form of data analysis - requires access to the data. Anyone else willing to chip in a cent or a yen or a euro or a ... ? Quentin Burrell -----Original Message----- From: ASIS Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene Sent: 19 June 2002 18:27 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Web citation (fwd) It is almost six weeks since Tom Wilson posted this message. Many others forwarded copies to me expecting me to respond to his challenge. It is always pleasant to learn that one's work has been mentioned on a particular web site or that it is discussed in various courses. But while they are newsworthy they havoc little real bearing on the use of citation indexes to measure the impact of one's research. When you are quite young anything helps boost the ego, but the bottom line for the researcher is whether anyone has used his or her basic ideas in ongoing research. Until that day of Nirvana arrives when everything will be searchable on the web I am afraid web searching just won't be an adequate substitute. If you are working in the life sciences you can find many relevant citation connections through such full text resources as HighWire Press, but that is not yet complete nor is it presented in a form that is easily used for citation analysis. That day may come. Steve Lawrence's project at NEC which provides citation indexing in context for the computer science literature illustrate what happens when you have only partial coverage. The ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended. Gene Garfield When responding, please attach my original message __________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org -----Original Message----- From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] Sent: Monday, May 06, 2002 10:10 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] Web citation (fwd) ---------- Forwarded message ---------- Date: Mon, 06 May 2002 12:25:22 +0100 From: Prof. Tom Wilson To: JESSE at LISTSERV.UTK.EDU Subject: Web citation There have been a few mentions of Web citation searching possibly replacing citation indexing in time and I wondered how many people are now, as a matter of course, using counts of Web mentions in their cases for appointment, tenure or promotion. I looked at a couple of my own papers and counted the SSCI citations and then searched for mentions of the papers on the Web - the results left me wondering whether the reliance on citation indexing as a measure of performance is now past its sell by date. My most cited paper is "On user studies and information needs" (1981) - a Web search (using Google) revealed 118 pages that listed the title. The pages were reading lists, free electronic journals, and documents that would never be covered by SSCI, such as reports from various agencies. SSCI revealed, if I recall aright, 79 citations of the paper. The question is: is the Web revealing impact more effectively than SSCI? Citation in scholarly papers takes a variety of forms and much citation is of a token variety - x is cited because x is always cited. On the other hand citation on reading lists implies some positive recommendation of the text, and mention in policy documents and the like, implies (at least in some cases) that some benefit has been found in the cited document. It may also be that the use of Web citation would provide a more complete measure - I discovered, much to my surprise, that a 1971 text of mine on 'chain indexing' is cited on one reading list and in the bibliography of a document in German on classification. Greater international coverage is a further benefit of using Web citation. It strikes me that a move towards using Web citation as the measure of performance would be rather more useful than the use of citation indexes. No doubt others have looked at this issue - is any consensus emerging? Tom Wilson ----------------------------------- Professor T.D. Wilson, PhD Publisher/Editor in Chief Information Research University of Sheffield Sheffield S10 2TN United Kingdom Tel: +44-114-222-2642 E-mail: t.d.wilson at shef.ac.uk Web site: http://InformationR.net/ ----------------------------------- From garfield at CODEX.CIS.UPENN.EDU Tue Jul 9 11:51:25 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Tue, 9 Jul 2002 11:51:25 -0400 Subject: Egghe, L. Rousseau, R. "A proposal to define a core of a scientific subject: A definition using concentration and fuzzy sets" SCIENTOMETRICS 54(1):51-62, April 2002 Message-ID: Leo Egghe : leo.egghe at luc.ac.be AU Egghe, L Rousseau, R TI A proposal to define a core of a scientific subject: A definition using concentration and fuzzy sets SO SCIENTOMETRICS LA English DT Article NR 47 SN 0138-9130 PU KLUWER ACADEMIC PUBL C1 Limburgs Univ Ctr, Univ Campus, B-3590 Diepenbeek, Belgium Limburgs Univ Ctr, B-3590 Diepenbeek, Belgium UIA, IBW, Wilrijk, Belgium KHBO, Ind Sci & Technol, Oostende, Belgium ID LOTKAS LAW; INFORMATION-SCIENCE; JOURNALS; BRADFORD; GROWTH AB Determining the core of a field's literature, i.e. its 'most important' sources, has been and still is an important problem in bibliometrics. In this article an exact definition of a core of a bibliography or a conglomerate is presented. The main ingredients for this definition are: fuzzy set theory, Lorenz curves and concentration measures. If one prefers a strict delineation, the fuzzy core can easily be defuzzified. The method we propose does not depend on the subjective notion of 'importance'. It is, moreover, completely reproducible. The method and the resulting core is also independent of the mathematical function (Lotka, Zipf, Bradford, etc.) that may be used to describe the relation between the set of sources and that of items. CR ARORA J, 1995, JISSI INT J SCIENTOM, V1, P83 BONITZ M, 1999, SCIENTOMETRICS, V44, P361 BRADFORD SC, 1934, ENGINEERING-LONDON, V137, P85 BROOKES BC, 1984, J DOC, V40, P120 BROOKES BC, 1969, NATURE, V224, P953 BROOKS TA, 1989, COMMUN RES, V16, P682 CHU CM, 1991, CAN J INFORM SCI, V16, P12 DRESDEN A, 1922, AM MATH SOC B, V28, P303 EGGHE L, 2001, IN PRESS J AM SOC IN EGGHE L, 2001, IN PRESS MATH COMPUT EGGHE L, 1990, INTRO INFORMETRICS EGGHE L, 2000, J AM SOC INFORM SCI, V51, P1004 EGGHE L, 1990, J AM SOC INFORM SCI, V41, P469 EGGHE L, 1998, MATH COMPUT MODEL, V28, P11 EGGHE L, 2001, SCIENTOMETRICS, V52, P261 JACOB P, 1989, CAHIERS CTR ETUDES R, V31, P3 JIN BH, 2002, SCIENTOMETRICS, V54, P145 JOSWICK KE, 1997, COLL RES LIBR, V58, P48 KENDALL MG, 1960, OPERATIONAL RESEARCH, V11, P31 KINNUCAN MT, 1987, ANN REV INFORMATION, V22, P147 MCCAIN KW, 1997, ADV SERIAL, V6, P105 MCCAIN KW, 1995, J AM SOC INFORM SCI, V46, P306 MURPHY LJ, 1973, J AM SOC INFORM SCI, V24, P461 NIEUWENHUYSEN P, 1988, ELECT LIB, V6, P264 NIJSSEN D, 1998, COENOSES, V13, P33 PAO ML, 1979, COLLECTION MANAGEMEN, V3, P97 PENROSE R, 1990, EMPERORS NEW MIND PERITZ BC, 1984, LIBRI, V34, P233 POPE A, 1975, J AM SOC INFORM SCI, V26, P207 PRATHER RE, 1988, COMPUT J, V31, P248 RADHAKRISHNAN T, 1979, J AM SOC INFORM SCI, V30, P51 RAO IKR, 1990, INFORMETRICS 89 90, P251 RICE RE, 1989, SCIENTOMETRICS, V15, P257 ROUSSEAU R, 2000, 2 INT S QUANT EV RES ROUSSEAU R, 1997, CYBERMETRICS, V1 ROUSSEAU R, 1993, IASLIC B, V38, P49 ROUSSEAU R, 1993, IASLIC B, V38, PA166 ROUSSEAU R, 1994, INFORM PROCESS MANAG, V30, P267 ROUSSEAU R, 1987, J DOC, V43, P322 ROUSSEAU R, 1992, THESIS U ANTWERP SCHORR AE, 1975, J AM SOC INFORM SCI, V26, P189 SELEY H, 1968, MAST CELLS SHUKLA MC, 1996, HDB LIB ARCH INFORMA, V13, P309 SLATER BM, 1994, B MED LIB ASS, V82, P70 WHITE HD, 1989, ANNU REV INFORM SCI, V24, P119 ZADEH LA, 1965, INFORM CONTR, V8, P353 ZHANG O, 1992, IAALD Q B, V37, P151 TC 0 BP 51 EP 62 PG 12 JI Scientometrics PY 2002 PD APR VL 54 IS 1 GA 557HJ PI DORDRECHT RP Egghe L Limburgs Univ Ctr, Univ Campus, B-3590 Diepenbeek, Belgium J9 SCIENTOMETRICS PA VAN GODEWIJCKSTRAAT 30, 3311 GZ DORDRECHT, NETHERLANDS UT ISI:000175902800003 ER From garfield at CODEX.CIS.UPENN.EDU Tue Jul 9 12:21:21 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Tue, 9 Jul 2002 12:21:21 -0400 Subject: Mendonca EA, Cimino JJ, Automated knowledge extraction from Medline citations, J. Am Med. Informatics Assn.Suppl. p.575-579, 2000 Message-ID: E.A. Mendonca : Email: mendonca at dmi.columbia.edu Full text of article available at : http://www.amia.org/pubs/symposia/D200362.PDF FN ISI Export Format VR 1.0 PT Journal AU Mendonca, EA Cimino, JJ TI Automated knowledge extraction from MEDLINE citations SO JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION LA English DT Article NR 19 SN 1067-5027 PU HANLEY & BELFUS INC C1 Columbia Univ, Dept Med Informat, New York, NY USA Columbia Univ, Dept Med Informat, New York, NY USA ID CLINICAL QUESTIONS; INFORMATION; PHYSICIANS; NEEDS AB As part of preliminary studies for the development of a digital library, we have studied the possibility of using the co- occurrence of MeSH terms in MEDLINE citations associated with the search strategies optimal for evidence-based medicine to automate construction of a knowledge base. We use the: UMLS semantic types in order to analyze search results to determine which semantic types are most relevant for different types of questions (etiology, diagnosis, therapy, and prognosis). The automated process generated;a large amount of information. Seven to eight percent of the semantic pairs generated in each clinical task group co-occur significantly more often than can be accounted for by chance. A pilot study showed good specificity and sensitivity for the intended purposes of this project in all groups. CR 1982, JAMA, V247, P1707 *NAT LIB MED, 1999, UMLS KNOWL SOURC ALLEN VG, 1998, INT J MED INFORM, V51, P91 BARNETT GO, 1987, JAMA-J AM MED ASSOC, V258, P67 CIMINO JJ, 1993, METHOD INFORM MED, V32, P120 COVELL DG, 1985, ANN INTERN MED, V103, P596 FRIEDLAND DJ, 1998, EVIDENCE BASED MED F GORMAN PN, 1995, MED DECIS MAKING, V15, P113 HAYNES RB, 1994, J AM MED INFORM ASSN, V1, P447 HUNT DL, 1998, ANN ONCOL, V9, P377 PAO ML, 1989, CONCEPTS INFORMATION POLLACK I, 1964, PSYCHON SCI, V1, P125 POWSNER SM, 1989, COMPUT BIOMED RES, V22, P552 SACKETT DL, 1996, BRIT MED J, V312, P71 SACKETT DL, 1997, EVIDENCE BASED MED P SHELSTAD KR, 1996, B MED LIBR ASSOC, V84, P490 SILBERG WM, 1997, JAMA-J AM MED ASSOC, V277, P1244 TIMPKA T, 1989, SCAND J PRIM HEALTH, V7, P105 ZENG Q, 1998, P AMIA S, P568 TC 0 BP 575 EP 579 PG 5 JI J. Am. Med. Inf. Assoc. PY 2000 SU S GA 458RC PI PHILADELPHIA RP Mendonca EA Columbia Univ, Dept Med Informat, New York, NY USA J9 J AMER MED INFORM ASSOC PA 210 S 13TH ST, PHILADELPHIA, PA 19107 USA UT ISI:000170207500118 From bernies at UILLINOIS.EDU Tue Jul 9 13:44:25 2002 From: bernies at UILLINOIS.EDU (Sloan, Bernie) Date: Tue, 9 Jul 2002 12:44:25 -0500 Subject: SV: [SIGMETRICS] Web citation issues Message-ID: Peter, For the past two years or so I have been dabbling in the collection of citations and inlinks to several papers of mine. I use your definition of "inlinks": "links pointing to web pages" (Bjorneborn & Ingwersen). I've been using both publicly available Web search engines (Google and AllTheWeb), as well as some commercial subscription-only databases from providers (e.g., ISI, the Gale Group, and EBSCO). I tried to be somewhat selective and did some brief analysis of the items I retrieved, e.g., I did not count inlinks from personal bookmark lists, or references to the papers from discussion group archives. I don't pretend that my papers are scientific papers, or that the citations and inlinks I have discovered are for "scientific items citing other scientific items." I did my best to eliminate any marginal entries, although "marginal" is definitely in the eye of the beholder here. I like to think of what I am doing as using the Web to discover the "influence of ideas". The exercise started with the Web of Science, and then broadened out to include the resources mentioned in the preceding paragraph. I don't think of the exercise as something that replaces ISI databases such as SCI, SSI, etc., but rather something that supplements the information obtained from ISI. One of the most interesting findings is that this exercise uncovered an international influence that I would not have been aware of using only the ISI databases. More than 40% of the citations/inlinks were from non-US sources. Of the citations/inlinks from non-US sources, fully 60% were associated with countries with a primary language other than English. Right now I am working on putting together a paper reporting on my findings, discoveries and questions in more detail, sort of a report on a work-in-progress. The biggest question I am grappling with is "So what?" I have a detailed listing of citations/inlinks for several of my papers. Beyond satisfying personal and academic curiosity, what can these "personal citation indices" be used for? Using them for evaluation springs to mind, but of course "evaluation" requires comparison against some standard or control group. I'm not aware of too many people who have conducted this exercise at a personal level. I have something that seems impressive to me, in a relative sense (i.e., a more comprehensive overview of the influence of ideas than I might obtain from a citation index like SSI). But what can I use it for? Bernie Sloan -----Original Message----- From: Ingwersen Peter [mailto:PI at DB.DK] Sent: Tuesday, July 09, 2002 9:52 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues Dear colleagues, as you may be well aware of our department was one of the first to engage into webometric analyses, in particular of web impact by means of inlinks. Several others around have done deep analyses of webometric nature to see if, for instance, there exists a correlation between citation impact and web impact/no. of inlinks (Bar Ilan) or between other indicators of recognition (e.g. RAE in the UK) and web impact (Thelwall). Sometimes there exist such correlations, but the major problem is that the web acts differently than scientific communication vehicles (no real conventions of linking etc.). Also: one may not equalize a web page with a scientific article. So Tom Wilson?s no. of hits (to web pages) does not necessarily correspond at all to "scientific items citing other scientific items" as in conventional citation analyses. Only the reading lists found by Wilson may act like such "reference lists". Further: Different search engines commonly perform differently on the same search profile, resulting in biased counts; several large quality studies have been done on "scientific" web page search results to observe the actual proportion of scientific output (see e.g. Allen et al in Science in 1999.) Results are appalling and pauvre - and highly dependent on the domain in question. For instance, in politically hot scientific topics (like in the environmental sc.-) there is a chaotic mix of scientific, semi-scientific, pseudo, popular and, foremost, political opinion papers. Should all the "published" pages count or only the peer reviewed ones - e.g. those published by scientific institutions or referring to peer reviewed journals or published in peer reviewed e-journals? Additionally, there are several possible web impacts: by inlink counts; by inlink counts and outlink counts; by web-based traditional references/citations on all the open web - or only in e-journals - with or without peer review. Tom will of course also run into the problem similar to that of ISI: in the citation databases no citations from books and non-ISI journals are counted; on the web only the open weblinks (and citations/references) are possible to count - not links/citations provided by pages/items on the hidden web (e.g. all the Dialog or ISI databases or the journals in publisher archives or in Digital Libraries. Finally, on the web the nature of obsolescence of information is quite different and not yet well understood - see e.g. Ronald Rousseau?s articles in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. A recent review on some of the issues touched upon above is: Bjorneborn, L. & Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): 65-82. Many regards - Peter Ingwersen ******************************************** Peter Ingwersen, Professor, Ph.D. Department of Information Studies Royal School of Library and Information Science, Birketinget 6, DK 2300 Copenhagen S - Denmark Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 http://www.db.dk/pi/ - e-mail: pi at db.dk Visiting Professor (Docent), Dept. of Information Studies ?bo University Akademi - Finland ******************************************** -----Oprindelig meddelelse----- Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] Sendt: 21. juni 2002 18:11 Til: SIGMETRICS at LISTSERV.UTK.EDU Emne: Re: [SIGMETRICS] Web citation (fwd) I am wholly in support of the SIGMETRICS site being one for discussion and so was interested in Tom's original submission and now Gene's response. Here comes my two penn'orth (Eng., coll., obs.?) Tom's observations are interesting - to his comment on token citations I would add (many cases of) self-citation - but I go along with Gene's uneasiness on the current haphazard coverage of the web being adequate to replace formal citation bases. Gene's final remark that the "ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended" surely requires some response. (i)I guess that "control" was a hasty first attempt and that "information" is more in line with the intended meaning. (ii) I would really like to see the phrase "freely available" inserted somewhere in the remark. At the moment, unless you are the member of a subscribing institution you don't have free access to this bibliographic information, either to "boost your ego" or to measure your impact.Citation analysis - like any othe form of data analysis - requires access to the data. Anyone else willing to chip in a cent or a yen or a euro or a ... ? Quentin Burrell -----Original Message----- From: ASIS Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene Sent: 19 June 2002 18:27 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Web citation (fwd) It is almost six weeks since Tom Wilson posted this message. Many others forwarded copies to me expecting me to respond to his challenge. It is always pleasant to learn that one's work has been mentioned on a particular web site or that it is discussed in various courses. But while they are newsworthy they havoc little real bearing on the use of citation indexes to measure the impact of one's research. When you are quite young anything helps boost the ego, but the bottom line for the researcher is whether anyone has used his or her basic ideas in ongoing research. Until that day of Nirvana arrives when everything will be searchable on the web I am afraid web searching just won't be an adequate substitute. If you are working in the life sciences you can find many relevant citation connections through such full text resources as HighWire Press, but that is not yet complete nor is it presented in a form that is easily used for citation analysis. That day may come. Steve Lawrence's project at NEC which provides citation indexing in context for the computer science literature illustrate what happens when you have only partial coverage. The ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended. Gene Garfield When responding, please attach my original message __________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org -----Original Message----- From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] Sent: Monday, May 06, 2002 10:10 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] Web citation (fwd) ---------- Forwarded message ---------- Date: Mon, 06 May 2002 12:25:22 +0100 From: Prof. Tom Wilson To: JESSE at LISTSERV.UTK.EDU Subject: Web citation There have been a few mentions of Web citation searching possibly replacing citation indexing in time and I wondered how many people are now, as a matter of course, using counts of Web mentions in their cases for appointment, tenure or promotion. I looked at a couple of my own papers and counted the SSCI citations and then searched for mentions of the papers on the Web - the results left me wondering whether the reliance on citation indexing as a measure of performance is now past its sell by date. My most cited paper is "On user studies and information needs" (1981) - a Web search (using Google) revealed 118 pages that listed the title. The pages were reading lists, free electronic journals, and documents that would never be covered by SSCI, such as reports from various agencies. SSCI revealed, if I recall aright, 79 citations of the paper. The question is: is the Web revealing impact more effectively than SSCI? Citation in scholarly papers takes a variety of forms and much citation is of a token variety - x is cited because x is always cited. On the other hand citation on reading lists implies some positive recommendation of the text, and mention in policy documents and the like, implies (at least in some cases) that some benefit has been found in the cited document. It may also be that the use of Web citation would provide a more complete measure - I discovered, much to my surprise, that a 1971 text of mine on 'chain indexing' is cited on one reading list and in the bibliography of a document in German on classification. Greater international coverage is a further benefit of using Web citation. It strikes me that a move towards using Web citation as the measure of performance would be rather more useful than the use of citation indexes. No doubt others have looked at this issue - is any consensus emerging? Tom Wilson ----------------------------------- Professor T.D. Wilson, PhD Publisher/Editor in Chief Information Research University of Sheffield Sheffield S10 2TN United Kingdom Tel: +44-114-222-2642 E-mail: t.d.wilson at shef.ac.uk Web site: http://InformationR.net/ ----------------------------------- From willieezi at YAHOO.COM Tue Jul 9 13:53:05 2002 From: willieezi at YAHOO.COM (Williams Nwagwu) Date: Tue, 9 Jul 2002 10:53:05 -0700 Subject: BOOK ASSISTANCE Message-ID: Dear Colleagues, I am a doctrate degree student f informetrics at the university of ibada, Nigeria. I just wish I can have access to the materials listed belw to enable me conclude wrk on my thesis Williams LIST OF RELEVANT BOOKS 1. LEO EGGHE 2000 INTRODUCTION TO INFORMETRICS BY LEO EGGHE AND ROUSEAU, R. ELSEVIER, . 2. ORR, R.,AND LEEDS A. BIOMEDICAL LITERATURE, VOLUME GROWTH AND OTHER CHARACTERISTICS. FEDERATION PROCEEDINGS 23, 1310-1331. 3. MENARD H.W. (1971). SCIENCE GROWTH AND CHANGE, HARVARD UNIVERSITY 4. PRESS 4. HARWOOD J. 1993. STYLES OF SCIENTIFIC THOUGHT: THE GERMAN GENETIC COMMUNITY. 1900-1933. CHICAGO: UNIVERSITY OF CHICAGO PRESS. 5. LATOUR B. AND WOOLGER, S: THE SOCIAL CONSTRUCTION OF SCIENTIFIC FACTS. LONDON: SAGE. 6. MERTON R.K THE SOCIOLOGY OF SCIENCE:THEORETICAL AND EMPIRICAL INVETSIGATIONS. 7. METZ, P. (1983). THE LANDSCAPE OF LITERATURES. CHICAGO IL.: AMERICAN LIBRARY ASSOCIATION. 8. BECHER T. (1989). ACADEMIC TRIBES AND TERRITORIES :INTELLECTUAL ENQUIRY AND THEIR CULTURES OF DISCIPLINES. SCHOLARLY COMMUNICATION AND BIBLIOMETRICS.NEWBURY PART CA: SAGE. 9. KNOR-CRETINA K. (1981). THE MANUFACTURE OF KNOWLEDGE OXFORD :PERGAMON PRESS. 10. INFORMETRICS: AN EMERGING SUB-DISCIPLINE IN INFORMATION SCIENCE BY WORMELL, I. ASIAN LIB. 1998 11. B. CRONIN (1984). THE CITATION PROCESS: THE ROLE AND SIGNIFICANCE OF CITATION IN SCIENTIFIC COMMUNICATION, LONDON: TAYLOR GRAHAM. 12. CRANE D.(1969) SOCIAL STRUCTURE IN A GROUP OF SCIENTISTS: A TEST OF THE ?INVISIBLE COLLEGE? HYPOTHESIS. AMERICAN SOCIOLOGICAL REVIEW32, 335-352. 13. TRAWEEK S (1992). BEATIMES AND LIFETIMES: THE WORLD OF HIGH ENERGY PHYSICS. CAMBRIDGE MA: HARVARD UNIVERSITY PRESS. 14. D.J. PRICE DE SOLA (1963): LITTLE SCIENCE BIG SCIENCE NY: COLUMBIA UNIVERSITY PRESS. 15. KNIGHT. D., 1976. THE NATURE OF SCIENCE: THE HISTORY OF SCIENCE IN WESTERN CULTURE SINCE 1600 16. MERTON R.K: THE SOCIOLOGY OF SCIENCE 17. BRODKEY L (1987). ACADEMIC WRITING AS SOCIAL PRACTICE PHILADELPHIA PA. TEMPLE UNIVERSITY PRESS. 18. ANY GOOD BOOKS ON CITATION ANALYSIS 19. ANY GOOD BOOKS ON RESEARCH EVALUATION 20. ANY GOOD BOOKS ON INFORMETRIC LAWS. 21. ANY GOOD BOOKS ON GROWTH AND OBSOLESCENCE OF THE LITERATURE __________________________________________________ Do You Yahoo!? Sign up for SBC Yahoo! Dial - First Month Free http://sbc.yahoo.com From garfield at CODEX.CIS.UPENN.EDU Tue Jul 9 14:22:47 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Tue, 9 Jul 2002 14:22:47 -0400 Subject: WEIBULL W, A STATISTICAL DISTRIBUTION FUNCTION OF WIDE APPLICABILITY, JOURNAL OF APPLIED MECHANICS-TRANSACTIONS OF THE ASME 18 (3): 293-297 1951 Message-ID: Dear Colleagues: I thought some of you would be interested to learn about a Citation Classic in the September 1951 issue of the Journal of Applied Mechanics. TITLE A STATISTICAL DISTRIBUTION FUNCTION OF WIDE APPLICABILITY AUTHOR WEIBULL W jOURNAL JOURNAL OF APPLIED MECHANICS-TRANSACTIONS OF THE ASME 18 (3): 293-297 1951 Document type: Article Language: English Cited References: 7 Times Cited: 1439 Publisher: ASME-AMER SOC MECHANICAL ENG, NEW YORK IDS Number: UX955 ISSN: 0021-8936 Cited Author Cited Work Volume Page Year CHARLIER CVL GRUNDLAGEN MATH STAT 73 1920 CRAMER H MATH METHODS STATIST 440 1945 DALLAVALLE JM MICROMERITICS 57 1948 KOSHAL RS J TEXT I 21 325 1930 MULLERSTOCK H MITTEILUNGEN KOHLE E 1938 WEIBULL W NATURE 164 1047 1949 YULE GU INTRO THEORY STATIST 94 1937 From garfield at CODEX.CIS.UPENN.EDU Tue Jul 9 14:35:36 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Tue, 9 Jul 2002 14:35:36 -0400 Subject: Ligon J, Thyer B "Academic affiliations of social work journals authors: A productivity analysis from 1994-1998" Journal of Social Service Research 28(2):69-81 2001 Message-ID: Bruce Thyer : Bthyer at uga.cc.uga.edu Jan Ligon : jligon at gsu.edu Title Academic affiliations of social work journals authors: A productivity analysis from 1994-1998 Author Ligon J, Thyer B JOURNAL JOURNAL OF SOCIAL SERVICE RESEARCH 28 (2): 69-81 2001 Document type: Article Language: English Cited References: 52 Times Cited: 0 Abstract: The academic affiliations of the authors of all articles published in six social work journals between 1994 and 1998 were reviewed and tabulated to produce a ranking of the colleges and universities whose faculty made the most substantive contributions to the social work literature. The results of this analysis are compared with findings of three identical, previously published studies, which cover the five-year periods of 1979-1983, 1984-1988, and 1989-1993. (C) 2001 by The Haworth Press, Inc. All rights reserved. Author Keywords: institutional rankings, scholarly productivity, journal publication rankings, faculty productivity KeyWords Plus: CRIMINAL-JUSTICE JOURNALS, EDITORIAL-BOARD MEMBERS, PUBLICATION PRODUCTIVITY, CITATION ANALYSIS, SCHOLARLY PRODUCTIVITY, INSTITUTIONAL PRODUCTIVITY, COUNSELING-PSYCHOLOGY, DOCTORAL PROGRAMS, FACULTY, SCHOOLS Addresses: Ligon J, Georgia State Univ, Sch Social Work, Univ Plaza, Atlanta, GA 30303 USA Georgia State Univ, Sch Social Work, Atlanta, GA 30303 USA Univ Georgia, Sch Social Work, Athens, GA 30602 USA Univ Georgia, Dept Psychol, Athens, GA 30602 USA Med Coll Georgia, Dept Psychiat & Hlth Behav, Augusta, GA 30912 USA Univ Huddersfield, Sch Human & Hlth Sci, Huddersfield HD1 3DH, W Yorkshire, England Publisher: HAWORTH PRESS INC, BINGHAMTON IDS Number: 555EN ISSN: 0148-8376 Cited Author Cited Work Volume Page Year US NEWS WORLD REPORT 130 65 2001 *AM PSYCH ASS PUBL MAN AM PSYCH AS 1994 *COUNC SOC WORK ED HDB ACCR STAND PROC 1994 BAKER DR J SOC WORK EDUC 28 204 1992 BAKER DR SOC WORK RES ABSTR 26 3 1990 BLOOM M J SOC WORK EDUC 31 377 1995 BUSH IR SOC WORK RES 21 45 1997 CARLTON TO HLTH SOCIAL WORK 13 85 1988 CHEUNG KM SOCIAL WORK RES ABST 26 23 1992 COHN EG J CRIM JUST 26 99 1998 CORCORAN K J SOC WORK EDUC 26 310 1990 FABIANIC D J CRIM JUST 29 119 2001 GARFIELD E SCIENCE 178 471 1972 GREEN RG J SOC WORK EDUC 31 388 1995 GREEN RG SOC SERV REV 66 441 1992 GREEN RG SOC WORK 29 405 1994 GREEN RG SOC WORK RES 20 31 1996 GRINNELL RM J SOCIAL SERVICE RES 6 147 1983 HOWARD GS AM PSYCHOL 42 975 1987 HOWARD GS J COUNS PSYCHOL 30 600 1983 HULL GH J SOCIAL WORK ED 30 54 1994 JOHNSON HW J SOC WORK EDUC 31 358 1995 KIRK SA J SOC WORK EDUC 31 408 1995 KIRK SA J SOCIAL SERVICE RES 7 59 1984 KROLL HW ARETE 4 121 1976 KRUEGER LW J SOCIAL WORK ED 296 251 1993 KRUEGER LW J SOCIAL WORK ED 29 240 1993 LIGON J J SOC WORK EDUC 31 369 1995 MARLIN JW J ECON EDUC 24 171 1993 MARTINEZBRAWLEY EE BRIT J SOC WORK 28 197 1998 MEINERT R J SOCIAL WORK ED 29 245 1993 NIEMI AW REV BUSINESS EC RES 23 1 1988 NOBLE JH EVALUATION REV 16 288 1992 PAGEADAMS D J SOC WORK EDUC 31 402 1995 PARDECK JT PSYCHOL REP 68 523 1991 PARDECK JT RES SOCIAL WORK PRAC 5 223 1995 PARDECK JT RES SOCIAL WORK PRAC 2 487 1992 PEREZ RM J COUNS PSYCHOL 47 223 2000 PINCUS HA AM J PSYCHIAT 150 135 1993 ROBINS RW AM PSYCHOL 54 117 1999 SCHIELE JH J SOC WORK EDUC 27 125 1991 SCHRAMM RM DELTA PI EPSILON J 34 1 1992 SORENSEN JR J CRIM JUST 22 535 1994 TAGGART WA J CRIM JUST 19 549 1991 THYER BA J APPLIED SOCIAL SCI 17 111 1992 THYER BA J SOC SERV RES 18 153 1994 THYER BA J SOC WORK EDUC 22 67 1986 THYER BA SUCCESSFUL PUBLISHIN 1994 WEBSTER RE PSYCHOL SCHOOLS 30 136 1993 WILLIAMS LF SOC WORK 32 373 1987 WITKIN SL SOC WORK 45 5 2000 WODARSKI JS RES SOCIAL WORK PRAC 1 278 1991 From isidro at CINDOC.CSIC.ES Wed Jul 10 07:46:27 2002 From: isidro at CINDOC.CSIC.ES (Isidro F. Aguillo) Date: Wed, 10 Jul 2002 13:46:27 +0200 Subject: Web citation issues Message-ID: Dear all: I arrive a bit late to this debate, but I think an important point is missing in several of the messages. Most of them focus on the comparision between links and citations and the reasons to cite and the objects to be cited. Certainly both wordls are different and printed literature and bibliographic references are superior for bibliometric analysis. But our traditional approach has several shortcommings as several authours have already pointed. From the evaluation and policy purposes point of view, one of the most important is that there are no enough readily available information for a real sciencetechnoeconometrics. The interlinked nature of the Web offer the possibility to discover hidden relationships among different websites, including not only the bonds that binds academic communities but those showing economic, industrial, social or cultural relationships. And this is not easy with traditional quantitative methods. Going to the personal aspects, the presence on the Web of research groups, professors or postgraduate students reflects a wider range of activities than formal publication in refereed journals, such as unpublished material, general public contributions, drafts for future papers or book chapters, slides used in conference or seminar presentations, support material for courses or even raw data. The picture you can obtain from a researcher is therefore more complete. Finally, as tax-payer citizen supporting public research activities I request better access to the results obtained by scientists and in this sense the Web reaches a wider audience than the paper based publications like journals or books. In fact almost all the information published on the Web can be recover by any Internet user worldwide. Comments ... Sloan, Bernie wrote: > Peter, > > For the past two years or so I have been dabbling in the collection of > citations and inlinks to several papers of mine. I use your definition of > "inlinks": "links pointing to web pages" (Bjorneborn & Ingwersen). I've been > using both publicly available Web search engines (Google and AllTheWeb), as > well as some commercial subscription-only databases from providers (e.g., > ISI, the Gale Group, and EBSCO). I tried to be somewhat selective and did > some brief analysis of the items I retrieved, e.g., I did not count inlinks > from personal bookmark lists, or references to the papers from discussion > group archives. > > I don't pretend that my papers are scientific papers, or that the citations > and inlinks I have discovered are for "scientific items citing other > scientific items." I did my best to eliminate any marginal entries, although > "marginal" is definitely in the eye of the beholder here. I like to think of > what I am doing as using the Web to discover the "influence of ideas". The > exercise started with the Web of Science, and then broadened out to include > the resources mentioned in the preceding paragraph. I don't think of the > exercise as something that replaces ISI databases such as SCI, SSI, etc., > but rather something that supplements the information obtained from ISI. > > One of the most interesting findings is that this exercise uncovered an > international influence that I would not have been aware of using only the > ISI databases. More than 40% of the citations/inlinks were from non-US > sources. Of the citations/inlinks from non-US sources, fully 60% were > associated with countries with a primary language other than English. > > Right now I am working on putting together a paper reporting on my findings, > discoveries and questions in more detail, sort of a report on a > work-in-progress. The biggest question I am grappling with is "So what?" I > have a detailed listing of citations/inlinks for several of my papers. > Beyond satisfying personal and academic curiosity, what can these "personal > citation indices" be used for? Using them for evaluation springs to mind, > but of course "evaluation" requires comparison against some standard or > control group. I'm not aware of too many people who have conducted this > exercise at a personal level. I have something that seems impressive to me, > in a relative sense (i.e., a more comprehensive overview of the influence of > ideas than I might obtain from a citation index like SSI). But what can I > use it for? > > Bernie Sloan > > -----Original Message----- > From: Ingwersen Peter [mailto:PI at DB.DK] > Sent: Tuesday, July 09, 2002 9:52 AM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues > > Dear colleagues, as you may be well aware of our department was one of the > first to engage into webometric analyses, in particular of web impact by > means of inlinks. Several others around have done deep analyses of > webometric nature to see if, for instance, there exists a correlation > between citation impact and web impact/no. of inlinks (Bar Ilan) or between > other indicators of recognition (e.g. RAE in the UK) and web impact > (Thelwall). Sometimes there exist such correlations, but the major problem > is that the web acts differently than scientific communication vehicles (no > real conventions of linking etc.). Also: one may not equalize a web page > with a scientific article. So Tom Wilson?s no. of hits (to web pages) does > not necessarily correspond at all to "scientific items citing other > scientific items" as in conventional citation analyses. Only the reading > lists found by Wilson may act like such "reference lists". Further: > Different search engines commonly perform differently on the same search > profile, resulting in biased counts; several large quality studies have been > done on "scientific" web page search results to observe the actual > proportion of scientific output (see e.g. Allen et al in Science in 1999.) > Results are appalling and pauvre - and highly dependent on the domain in > question. For instance, in politically hot scientific topics (like in the > environmental sc.-) there is a chaotic mix of scientific, semi-scientific, > pseudo, popular and, foremost, political opinion papers. Should all the > "published" pages count or only the peer reviewed ones - e.g. those > published by scientific institutions or referring to peer reviewed journals > or published in peer reviewed e-journals? > Additionally, there are several possible web impacts: by inlink counts; by > inlink counts and outlink counts; by web-based traditional > references/citations on all the open web - or only in e-journals - with or > without peer review. > Tom will of course also run into the problem similar to that of ISI: in the > citation databases no citations from books and non-ISI journals are counted; > on the web only the open weblinks (and citations/references) are possible to > count - not links/citations provided by pages/items on the hidden web (e.g. > all the Dialog or ISI databases or the journals in publisher archives or in > Digital Libraries. > Finally, on the web the nature of obsolescence of information is quite > different and not yet well understood - see e.g. Ronald Rousseau?s articles > in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. > A recent review on some of the issues touched upon above is: Bjorneborn, L. > & Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): 65-82. > > Many regards - Peter Ingwersen > ******************************************** > Peter Ingwersen, Professor, Ph.D. > Department of Information Studies > Royal School of Library and Information Science, > Birketinget 6, DK 2300 Copenhagen S - Denmark > Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 > http://www.db.dk/pi/ - e-mail: pi at db.dk > Visiting Professor (Docent), Dept. of Information Studies > ?bo University Akademi - Finland > ******************************************** > > > -----Oprindelig meddelelse----- > Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] > Sendt: 21. juni 2002 18:11 > Til: SIGMETRICS at LISTSERV.UTK.EDU > Emne: Re: [SIGMETRICS] Web citation (fwd) > > > I am wholly in support of the SIGMETRICS site being one for discussion and > so was interested in Tom's original submission and now Gene's response. Here > comes my two penn'orth (Eng., coll., obs.?) > > Tom's observations are interesting - to his comment on token citations I > would add (many cases of) self-citation - but I go along with Gene's > uneasiness on the current haphazard coverage of the web being adequate to > replace formal citation bases. > > Gene's final remark that the "ultimate objective of universal > bibliographical control is to find it all in one place, displayed in a > fashion that is easily and quickly comprehended" surely requires some > response. > > (i)I guess that "control" was a hasty first attempt and that "information" > is more in line with the intended meaning. > > (ii) I would really like to see the phrase "freely available" inserted > somewhere in the remark. At the moment, unless you are the member of a > subscribing institution you don't have free access to this bibliographic > information, either to "boost your ego" or to measure your impact.Citation > analysis - like any othe form of data analysis - requires access to the > data. > > Anyone else willing to chip in a cent or a yen or a euro or a ... ? > > Quentin Burrell > > > -----Original Message----- > From: ASIS Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene > Sent: 19 June 2002 18:27 > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: Re: [SIGMETRICS] Web citation (fwd) > > > It is almost six weeks since Tom Wilson posted this message. Many others > forwarded copies to me expecting me to respond to his challenge. > > It is always pleasant to learn that one's work has been mentioned on a > particular web site or that it is discussed in various courses. But while > they are newsworthy they havoc little real bearing on the use of citation > indexes to measure the impact of one's research. > > When you are quite young anything helps boost the ego, but the bottom line > for the researcher is whether anyone has used his or her basic ideas in > ongoing research. Until that day of Nirvana arrives when everything will be > searchable on the web I am afraid web searching just won't be an adequate > substitute. > > If you are working in the life sciences you can find many relevant citation > connections through such full text resources as HighWire Press, but that is > not yet complete nor is it presented in a form that is easily used for > citation analysis. That day may come. Steve Lawrence's project at NEC which > provides citation indexing in context for the computer science literature > illustrate what happens when you have only partial coverage. > > The ultimate objective of universal bibliographical control is to find it > all in one place, displayed in a fashion that is easily and quickly > comprehended. Gene Garfield > > When responding, please attach my original message > __________________________________________________ > Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu > home page: www.eugenegarfield.org > Tel: 215-243-2205 Fax 215-387-1266 > President, The Scientist LLC. www.the-scientist.com > Chairman Emeritus, ISI www.isinet.com > Past President, American Society for Information Science and Technology > (ASIS&T) www.asis.org > > > > > > > -----Original Message----- > From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] > Sent: Monday, May 06, 2002 10:10 AM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: [SIGMETRICS] Web citation (fwd) > > > ---------- Forwarded message ---------- > Date: Mon, 06 May 2002 12:25:22 +0100 > From: Prof. Tom Wilson > To: JESSE at LISTSERV.UTK.EDU > Subject: Web citation > > There have been a few mentions of Web citation searching possibly replacing > citation indexing in time and I wondered how many people are now, as a > matter of course, using counts of Web mentions in their cases for > appointment, tenure or promotion. > > I looked at a couple of my own papers and counted the SSCI citations and > then searched for mentions of the papers on the Web - the results left me > wondering whether the reliance on citation indexing as a measure of > performance is now past its sell by date. > > My most cited paper is "On user studies and information needs" (1981) - a > Web search (using Google) revealed 118 pages that listed the title. The > pages were reading lists, free electronic journals, and documents that would > never be covered by SSCI, such as reports from various agencies. SSCI > revealed, if I recall aright, 79 citations of the paper. The question is: is > the Web revealing impact more effectively than SSCI? Citation in scholarly > papers takes a variety of forms and much citation is of a token variety - x > is cited because x is always cited. On the other hand citation on reading > lists implies some positive recommendation of the text, and mention in > policy documents and the like, implies (at least in some cases) that some > benefit has been found in the cited document. > > It may also be that the use of Web citation would provide a more complete > measure - I discovered, much to my surprise, that a 1971 text of mine on > 'chain indexing' is cited on one reading list and in the bibliography of a > document in German on classification. Greater international coverage is a > further benefit of using Web citation. > > It strikes me that a move towards using Web citation as the measure of > performance would be rather more useful than the use of citation indexes. > > No doubt others have looked at this issue - is any consensus emerging? > > Tom Wilson > > ----------------------------------- > Professor T.D. Wilson, PhD > Publisher/Editor in Chief > Information Research > University of Sheffield > Sheffield S10 2TN > United Kingdom > Tel: +44-114-222-2642 > E-mail: t.d.wilson at shef.ac.uk > Web site: http://InformationR.net/ > ----------------------------------- > > -- -------------------------------------------------------- Isidro F. Aguillo isidro at cindoc.csic.es Laboratorio de Internet. CINDOC-CSIC Joaquin Costa, 22 Ph. +34-91-5635482 ext. 313 28002 Madrid Mb. +34-630-858997 ESPA?A-SPAIN Fx. +34-91-5642644 Editor Cybermetrics www.cindoc.csic.es/cybermetrics -------------------------------------------------------- From loet at LEYDESDORFF.NET Wed Jul 10 08:41:40 2002 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Wed, 10 Jul 2002 14:41:40 +0200 Subject: Web citation issues In-Reply-To: <3D2C1E93.4010000@cindoc.csic.es> Message-ID: Dear Isidro, Bernie, Peter; dear colleagues, It seems to me that in addition to looking at the similiraties and dissimilarities between web-based indicators and citations as science indicators, we can also look at the different meanings of these indicators. Patent citations, for example, are very different from science citations in function. The citation windows between patent and scientific literature are asymmetrical because two different systems of communication are operating. Whereas patents relate to inventions, science can be assumed to relate to scientific novelty and its codification. Web-based indicators may enable us to extend in the domain of science-based innovations because the users can also be traced back. In addition to the USPTO other government agencies (e.g., the FDA) and their role in the innovation process (production and diffusion of novelty) can be made visible. Andrea Scharnhorst (Netherl. Institute of Scientific Information/ Royal Academy) and I recently wrote a report for the German Ministry of Education and Research (BMBF) entitled "Measuring the Knowledge Base: A Program of Innovation Studies". A copy is available from my webpage at http://www.leydesdorff.net/bmbf02/indicators.pdf . We try to elaborate on the complexity that is generated by extending the interactions of science and technology into the domain of innovations. With kind regards, Loet ****************************************************** Loet Leydesdorff Science & Technology Dynamics, University of Amsterdam Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam Tel: +31-20-525 6598; Fax: +31-20-525 3681 http://www.leydesdorff.net/ http://www.upublish.com/books/leydesdorff.htm From PI at DB.DK Wed Jul 10 08:51:25 2002 From: PI at DB.DK (Ingwersen Peter) Date: Wed, 10 Jul 2002 14:51:25 +0200 Subject: Web citation issues Message-ID: Hi Bernie and other interested parties, I quite like the approach Bernie has taken. I appreciate that some of our suggestions on link structures are useful to people. But most important, Bernie?s approach emphasizes that the traditional (scientific) citation analyses of incoming citations (not references) are of different nature compared to web-citation/inlink analyses, since the latter probably demonstrate a much wider dimensionality of "use" or recognition by others of some work or manifestation published on the web. His conceptions of "influence of ideas" is highly appropriate in that sense. Since you Bernie has started up with some web publications well-known to you (your own!) the observed inlinks pointing to them ought to be categorized if possible by you Bernie and the results af that categorisation published. That might be a starting point for providing better hypotheses about why people/things on the web obtain inlinks, i.e forming a sort of inlink theory. This is NOT the same as an outlink theory about why people generate links. This phenomenon is similar to the difference between a reference theory on why scientists make references (also often called a "citation theory" unfortunately, and quite difficult to achive, according to Cronin & others) and a proper citation theory, i.e., a theory on why people or objects receive citations. It is commonly the latter (received citations or received inlinks) that are counted in our analyses. As stated by van Raan in the citation theory discussions in Scientometrics some years back, citation analyses are about measuring impact of some sort, regardless why the references were given in the first place. So Bernie (and others) just keep going. Aside from the probably categories you may find in your personal case, I predict that other categories may also appear, due to differences in subject matter, scientific/professional/cultural field, type of web site/object, etc. under analysis for inlinks. A future goal might then be to operate with several "impact indicators" on the web: from strict scientific (citation) impact (similar to that from ISI) over citation/inlink impact on/from scientific web-based material to all kinds of inlinks, provided that such "kinds" are known and understood. Thats your contribution. So long for a while due to holidays and conference participation - yours Peter Ingwersen ******************************************** Peter Ingwersen, Professor, Ph.D. Department of Information Studies Royal School of Library and Information Science, Birketinget 6, DK 2300 Copenhagen S - Denmark Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 http://www.db.dk/pi/ - e-mail: pi at db.dk Visiting Professor (Docent), Dept. of Information Studies ?bo University Akademi - Finland ******************************************** -----Oprindelig meddelelse----- Fra: Sloan, Bernie [mailto:bernies at UILLINOIS.EDU] Sendt: 9. juli 2002 19:44 Til: SIGMETRICS at LISTSERV.UTK.EDU Emne: Re: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues Peter, For the past two years or so I have been dabbling in the collection of citations and inlinks to several papers of mine. I use your definition of "inlinks": "links pointing to web pages" (Bjorneborn & Ingwersen). I've been using both publicly available Web search engines (Google and AllTheWeb), as well as some commercial subscription-only databases from providers (e.g., ISI, the Gale Group, and EBSCO). I tried to be somewhat selective and did some brief analysis of the items I retrieved, e.g., I did not count inlinks from personal bookmark lists, or references to the papers from discussion group archives. I don't pretend that my papers are scientific papers, or that the citations and inlinks I have discovered are for "scientific items citing other scientific items." I did my best to eliminate any marginal entries, although "marginal" is definitely in the eye of the beholder here. I like to think of what I am doing as using the Web to discover the "influence of ideas". The exercise started with the Web of Science, and then broadened out to include the resources mentioned in the preceding paragraph. I don't think of the exercise as something that replaces ISI databases such as SCI, SSI, etc., but rather something that supplements the information obtained from ISI. One of the most interesting findings is that this exercise uncovered an international influence that I would not have been aware of using only the ISI databases. More than 40% of the citations/inlinks were from non-US sources. Of the citations/inlinks from non-US sources, fully 60% were associated with countries with a primary language other than English. Right now I am working on putting together a paper reporting on my findings, discoveries and questions in more detail, sort of a report on a work-in-progress. The biggest question I am grappling with is "So what?" I have a detailed listing of citations/inlinks for several of my papers. Beyond satisfying personal and academic curiosity, what can these "personal citation indices" be used for? Using them for evaluation springs to mind, but of course "evaluation" requires comparison against some standard or control group. I'm not aware of too many people who have conducted this exercise at a personal level. I have something that seems impressive to me, in a relative sense (i.e., a more comprehensive overview of the influence of ideas than I might obtain from a citation index like SSI). But what can I use it for? Bernie Sloan -----Original Message----- From: Ingwersen Peter [mailto:PI at DB.DK] Sent: Tuesday, July 09, 2002 9:52 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues Dear colleagues, as you may be well aware of our department was one of the first to engage into webometric analyses, in particular of web impact by means of inlinks. Several others around have done deep analyses of webometric nature to see if, for instance, there exists a correlation between citation impact and web impact/no. of inlinks (Bar Ilan) or between other indicators of recognition (e.g. RAE in the UK) and web impact (Thelwall). Sometimes there exist such correlations, but the major problem is that the web acts differently than scientific communication vehicles (no real conventions of linking etc.). Also: one may not equalize a web page with a scientific article. So Tom Wilson?s no. of hits (to web pages) does not necessarily correspond at all to "scientific items citing other scientific items" as in conventional citation analyses. Only the reading lists found by Wilson may act like such "reference lists". Further: Different search engines commonly perform differently on the same search profile, resulting in biased counts; several large quality studies have been done on "scientific" web page search results to observe the actual proportion of scientific output (see e.g. Allen et al in Science in 1999.) Results are appalling and pauvre - and highly dependent on the domain in question. For instance, in politically hot scientific topics (like in the environmental sc.-) there is a chaotic mix of scientific, semi-scientific, pseudo, popular and, foremost, political opinion papers. Should all the "published" pages count or only the peer reviewed ones - e.g. those published by scientific institutions or referring to peer reviewed journals or published in peer reviewed e-journals? Additionally, there are several possible web impacts: by inlink counts; by inlink counts and outlink counts; by web-based traditional references/citations on all the open web - or only in e-journals - with or without peer review. Tom will of course also run into the problem similar to that of ISI: in the citation databases no citations from books and non-ISI journals are counted; on the web only the open weblinks (and citations/references) are possible to count - not links/citations provided by pages/items on the hidden web (e.g. all the Dialog or ISI databases or the journals in publisher archives or in Digital Libraries. Finally, on the web the nature of obsolescence of information is quite different and not yet well understood - see e.g. Ronald Rousseau?s articles in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. A recent review on some of the issues touched upon above is: Bjorneborn, L. & Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): 65-82. Many regards - Peter Ingwersen ******************************************** Peter Ingwersen, Professor, Ph.D. Department of Information Studies Royal School of Library and Information Science, Birketinget 6, DK 2300 Copenhagen S - Denmark Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 http://www.db.dk/pi/ - e-mail: pi at db.dk Visiting Professor (Docent), Dept. of Information Studies ?bo University Akademi - Finland ******************************************** -----Oprindelig meddelelse----- Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] Sendt: 21. juni 2002 18:11 Til: SIGMETRICS at LISTSERV.UTK.EDU Emne: Re: [SIGMETRICS] Web citation (fwd) I am wholly in support of the SIGMETRICS site being one for discussion and so was interested in Tom's original submission and now Gene's response. Here comes my two penn'orth (Eng., coll., obs.?) Tom's observations are interesting - to his comment on token citations I would add (many cases of) self-citation - but I go along with Gene's uneasiness on the current haphazard coverage of the web being adequate to replace formal citation bases. Gene's final remark that the "ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended" surely requires some response. (i)I guess that "control" was a hasty first attempt and that "information" is more in line with the intended meaning. (ii) I would really like to see the phrase "freely available" inserted somewhere in the remark. At the moment, unless you are the member of a subscribing institution you don't have free access to this bibliographic information, either to "boost your ego" or to measure your impact.Citation analysis - like any othe form of data analysis - requires access to the data. Anyone else willing to chip in a cent or a yen or a euro or a ... ? Quentin Burrell -----Original Message----- From: ASIS Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene Sent: 19 June 2002 18:27 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Web citation (fwd) It is almost six weeks since Tom Wilson posted this message. Many others forwarded copies to me expecting me to respond to his challenge. It is always pleasant to learn that one's work has been mentioned on a particular web site or that it is discussed in various courses. But while they are newsworthy they havoc little real bearing on the use of citation indexes to measure the impact of one's research. When you are quite young anything helps boost the ego, but the bottom line for the researcher is whether anyone has used his or her basic ideas in ongoing research. Until that day of Nirvana arrives when everything will be searchable on the web I am afraid web searching just won't be an adequate substitute. If you are working in the life sciences you can find many relevant citation connections through such full text resources as HighWire Press, but that is not yet complete nor is it presented in a form that is easily used for citation analysis. That day may come. Steve Lawrence's project at NEC which provides citation indexing in context for the computer science literature illustrate what happens when you have only partial coverage. The ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended. Gene Garfield When responding, please attach my original message __________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org -----Original Message----- From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] Sent: Monday, May 06, 2002 10:10 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] Web citation (fwd) ---------- Forwarded message ---------- Date: Mon, 06 May 2002 12:25:22 +0100 From: Prof. Tom Wilson To: JESSE at LISTSERV.UTK.EDU Subject: Web citation There have been a few mentions of Web citation searching possibly replacing citation indexing in time and I wondered how many people are now, as a matter of course, using counts of Web mentions in their cases for appointment, tenure or promotion. I looked at a couple of my own papers and counted the SSCI citations and then searched for mentions of the papers on the Web - the results left me wondering whether the reliance on citation indexing as a measure of performance is now past its sell by date. My most cited paper is "On user studies and information needs" (1981) - a Web search (using Google) revealed 118 pages that listed the title. The pages were reading lists, free electronic journals, and documents that would never be covered by SSCI, such as reports from various agencies. SSCI revealed, if I recall aright, 79 citations of the paper. The question is: is the Web revealing impact more effectively than SSCI? Citation in scholarly papers takes a variety of forms and much citation is of a token variety - x is cited because x is always cited. On the other hand citation on reading lists implies some positive recommendation of the text, and mention in policy documents and the like, implies (at least in some cases) that some benefit has been found in the cited document. It may also be that the use of Web citation would provide a more complete measure - I discovered, much to my surprise, that a 1971 text of mine on 'chain indexing' is cited on one reading list and in the bibliography of a document in German on classification. Greater international coverage is a further benefit of using Web citation. It strikes me that a move towards using Web citation as the measure of performance would be rather more useful than the use of citation indexes. No doubt others have looked at this issue - is any consensus emerging? Tom Wilson ----------------------------------- Professor T.D. Wilson, PhD Publisher/Editor in Chief Information Research University of Sheffield Sheffield S10 2TN United Kingdom Tel: +44-114-222-2642 E-mail: t.d.wilson at shef.ac.uk Web site: http://InformationR.net/ ----------------------------------- From PI at DB.DK Wed Jul 10 09:10:39 2002 From: PI at DB.DK (Ingwersen Peter) Date: Wed, 10 Jul 2002 15:10:39 +0200 Subject: SV: [SIGMETRICS] Web citation issues Message-ID: Dear Loet et al. and further out into knowledge space, the functionality Loet so appropriately points to is the underlying reason for attempting to approach the categorisation issue and the understanding the functionality of such categories in connexion to inlink analyses. - thanks - yours Peter ******************************************** Peter Ingwersen, Professor, Ph.D. Department of Information Studies Royal School of Library and Information Science, Birketinget 6, DK 2300 Copenhagen S - Denmark Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 http://www.db.dk/pi/ - e-mail: pi at db.dk Visiting Professor (Docent), Dept. of Information Studies ?bo University Akademi - Finland ******************************************** -----Oprindelig meddelelse----- Fra: Loet Leydesdorff [mailto:loet at LEYDESDORFF.NET] Sendt: 10. juli 2002 14:42 Til: SIGMETRICS at LISTSERV.UTK.EDU Emne: Re: [SIGMETRICS] Web citation issues Dear Isidro, Bernie, Peter; dear colleagues, It seems to me that in addition to looking at the similiraties and dissimilarities between web-based indicators and citations as science indicators, we can also look at the different meanings of these indicators. Patent citations, for example, are very different from science citations in function. The citation windows between patent and scientific literature are asymmetrical because two different systems of communication are operating. Whereas patents relate to inventions, science can be assumed to relate to scientific novelty and its codification. Web-based indicators may enable us to extend in the domain of science-based innovations because the users can also be traced back. In addition to the USPTO other government agencies (e.g., the FDA) and their role in the innovation process (production and diffusion of novelty) can be made visible. Andrea Scharnhorst (Netherl. Institute of Scientific Information/ Royal Academy) and I recently wrote a report for the German Ministry of Education and Research (BMBF) entitled "Measuring the Knowledge Base: A Program of Innovation Studies". A copy is available from my webpage at http://www.leydesdorff.net/bmbf02/indicators.pdf . We try to elaborate on the complexity that is generated by extending the interactions of science and technology into the domain of innovations. With kind regards, Loet ****************************************************** Loet Leydesdorff Science & Technology Dynamics, University of Amsterdam Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam Tel: +31-20-525 6598; Fax: +31-20-525 3681 http://www.leydesdorff.net/ http://www.upublish.com/books/leydesdorff.htm From harnad at ECS.SOTON.AC.UK Wed Jul 10 11:17:33 2002 From: harnad at ECS.SOTON.AC.UK (Stevan Harnad) Date: Wed, 10 Jul 2002 16:17:33 +0100 Subject: Citebase: measuring impact for EPrints archives Message-ID: We would be grateful for feedback from citation analysts concerning Citebase, a citation-ranked search service. At the moment Citebase harvests data and references only from papers in the largest OAI archives (the Phsyics ArXiv and CogPrints), but in future it will also be harvesting institutional repositories such as EPrints archives. A Web form provides a short exercise for testing Citebase's principal features: http://citebase.eprints.org/survey/ The overall purpose of citation-ranking is described in: http://www.ecs.soton.ac.uk/~harnad/Tp/thes1.html http://www.ariadne.ac.uk/issue31/eprint-archives/ http://oaister.umdl.umich.edu/viewcolls.html Citebase, like EPrints http://www.eprints.org/ has been developed as part of the Open Citation project http://opcit.eprints.org/ funded by the Joint NSF - JISC International Digital Libraries Research Programme http://www.dli2.nsf.gov/ -------------------------------------------------------------------- Stevan Harnad harnad at cogsci.soton.ac.uk Professor of Cognitive Science harnad at princeton.edu Department of Electronics and phone: +44 23-80 592-582 Computer Science fax: +44 23-80 592-865 University of Southampton http://www.cogsci.soton.ac.uk/~harnad/ Highfield, Southampton http://www.princeton.edu/~harnad/ SO17 1BJ UNITED KINGDOM From Garfield at CODEX.CIS.UPENN.EDU Wed Jul 10 12:55:13 2002 From: Garfield at CODEX.CIS.UPENN.EDU (Garfield, Eugene) Date: Wed, 10 Jul 2002 12:55:13 -0400 Subject: [bibliometrics literature coverage of literature and the web Message-ID: Isidro's recent email message to SIGMETRICS reminded me that I have not heard from anyone at ISSI concerning the further use and expansion of the SIGMETRICS archive. I think someone had asked whether the SIGMET information could be used by ISSI. To make things quite clear I would be delighted for any of my postings to SIGMET to be sent to the ISSI listserv. But perhaps it is important to ask how much overlap there is in the two lists. I have not seen few contributions of the kind that I have been posting. If there are significant items outside the literature covered by ISI, as e.g. postings to web sites, why haven't SIGMET members or ISSI members been posting them to SIGMET? SIGMET is open and free to everyone. So if as Sloane and others have been suggesting, there is a significant amount of relevant information that is not revealed from the ISI databases, then why hasn't it been reported, at least for the field of bibliometrics,etc. in SIGMET? When I first began this note to Isidro I did not think it relevant for the entire SIGMET readership but I see now that is clearly is a matter that all members of SIGMET and ISSI should take to heart. If we are to provide truly comprehensive coverage of the field then it is the duty of all members to create suitable postings for all to share. Best wishes. Eugene Garfield When responding, please attach my original message __________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org -----Original Message----- From: Isidro F. Aguillo [mailto:isidro at CINDOC.CSIC.ES] Sent: Wednesday, July 10, 2002 7:46 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] Web citation issues Dear all: I arrive a bit late to this debate, but I think an important point is missing in several of the messages. Most of them focus on the comparision between links and citations and the reasons to cite and the objects to be cited. Certainly both wordls are different and printed literature and bibliographic references are superior for bibliometric analysis. But our traditional approach has several shortcommings as several authours have already pointed. From the evaluation and policy purposes point of view, one of the most important is that there are no enough readily available information for a real sciencetechnoeconometrics. The interlinked nature of the Web offer the possibility to discover hidden relationships among different websites, including not only the bonds that binds academic communities but those showing economic, industrial, social or cultural relationships. And this is not easy with traditional quantitative methods. Going to the personal aspects, the presence on the Web of research groups, professors or postgraduate students reflects a wider range of activities than formal publication in refereed journals, such as unpublished material, general public contributions, drafts for future papers or book chapters, slides used in conference or seminar presentations, support material for courses or even raw data. The picture you can obtain from a researcher is therefore more complete. Finally, as tax-payer citizen supporting public research activities I request better access to the results obtained by scientists and in this sense the Web reaches a wider audience than the paper based publications like journals or books. In fact almost all the information published on the Web can be recover by any Internet user worldwide. Comments ... Sloan, Bernie wrote: > Peter, > > For the past two years or so I have been dabbling in the collection of > citations and inlinks to several papers of mine. I use your definition of > "inlinks": "links pointing to web pages" (Bjorneborn & Ingwersen). I've been > using both publicly available Web search engines (Google and AllTheWeb), as > well as some commercial subscription-only databases from providers (e.g., > ISI, the Gale Group, and EBSCO). I tried to be somewhat selective and did > some brief analysis of the items I retrieved, e.g., I did not count inlinks > from personal bookmark lists, or references to the papers from discussion > group archives. > > I don't pretend that my papers are scientific papers, or that the citations > and inlinks I have discovered are for "scientific items citing other > scientific items." I did my best to eliminate any marginal entries, although > "marginal" is definitely in the eye of the beholder here. I like to think of > what I am doing as using the Web to discover the "influence of ideas". The > exercise started with the Web of Science, and then broadened out to include > the resources mentioned in the preceding paragraph. I don't think of the > exercise as something that replaces ISI databases such as SCI, SSI, etc., > but rather something that supplements the information obtained from ISI. > > One of the most interesting findings is that this exercise uncovered an > international influence that I would not have been aware of using only the > ISI databases. More than 40% of the citations/inlinks were from non-US > sources. Of the citations/inlinks from non-US sources, fully 60% were > associated with countries with a primary language other than English. > > Right now I am working on putting together a paper reporting on my findings, > discoveries and questions in more detail, sort of a report on a > work-in-progress. The biggest question I am grappling with is "So what?" I > have a detailed listing of citations/inlinks for several of my papers. > Beyond satisfying personal and academic curiosity, what can these "personal > citation indices" be used for? Using them for evaluation springs to mind, > but of course "evaluation" requires comparison against some standard or > control group. I'm not aware of too many people who have conducted this > exercise at a personal level. I have something that seems impressive to me, > in a relative sense (i.e., a more comprehensive overview of the influence of > ideas than I might obtain from a citation index like SSI). But what can I > use it for? > > Bernie Sloan > > -----Original Message----- > From: Ingwersen Peter [mailto:PI at DB.DK] > Sent: Tuesday, July 09, 2002 9:52 AM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues > > Dear colleagues, as you may be well aware of our department was one of the > first to engage into webometric analyses, in particular of web impact by > means of inlinks. Several others around have done deep analyses of > webometric nature to see if, for instance, there exists a correlation > between citation impact and web impact/no. of inlinks (Bar Ilan) or between > other indicators of recognition (e.g. RAE in the UK) and web impact > (Thelwall). Sometimes there exist such correlations, but the major problem > is that the web acts differently than scientific communication vehicles (no > real conventions of linking etc.). Also: one may not equalize a web page > with a scientific article. So Tom Wilson?s no. of hits (to web pages) does > not necessarily correspond at all to "scientific items citing other > scientific items" as in conventional citation analyses. Only the reading > lists found by Wilson may act like such "reference lists". Further: > Different search engines commonly perform differently on the same search > profile, resulting in biased counts; several large quality studies have been > done on "scientific" web page search results to observe the actual > proportion of scientific output (see e.g. Allen et al in Science in 1999.) > Results are appalling and pauvre - and highly dependent on the domain in > question. For instance, in politically hot scientific topics (like in the > environmental sc.-) there is a chaotic mix of scientific, semi-scientific, > pseudo, popular and, foremost, political opinion papers. Should all the > "published" pages count or only the peer reviewed ones - e.g. those > published by scientific institutions or referring to peer reviewed journals > or published in peer reviewed e-journals? > Additionally, there are several possible web impacts: by inlink counts; by > inlink counts and outlink counts; by web-based traditional > references/citations on all the open web - or only in e-journals - with or > without peer review. > Tom will of course also run into the problem similar to that of ISI: in the > citation databases no citations from books and non-ISI journals are counted; > on the web only the open weblinks (and citations/references) are possible to > count - not links/citations provided by pages/items on the hidden web (e.g. > all the Dialog or ISI databases or the journals in publisher archives or in > Digital Libraries. > Finally, on the web the nature of obsolescence of information is quite > different and not yet well understood - see e.g. Ronald Rousseau?s articles > in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. > A recent review on some of the issues touched upon above is: Bjorneborn, L. > & Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): 65-82. > > Many regards - Peter Ingwersen > ******************************************** > Peter Ingwersen, Professor, Ph.D. > Department of Information Studies > Royal School of Library and Information Science, > Birketinget 6, DK 2300 Copenhagen S - Denmark > Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 > http://www.db.dk/pi/ - e-mail: pi at db.dk > Visiting Professor (Docent), Dept. of Information Studies > ?bo University Akademi - Finland > ******************************************** > > > -----Oprindelig meddelelse----- > Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] > Sendt: 21. juni 2002 18:11 > Til: SIGMETRICS at LISTSERV.UTK.EDU > Emne: Re: [SIGMETRICS] Web citation (fwd) > > > I am wholly in support of the SIGMETRICS site being one for discussion and > so was interested in Tom's original submission and now Gene's response. Here > comes my two penn'orth (Eng., coll., obs.?) > > Tom's observations are interesting - to his comment on token citations I > would add (many cases of) self-citation - but I go along with Gene's > uneasiness on the current haphazard coverage of the web being adequate to > replace formal citation bases. > > Gene's final remark that the "ultimate objective of universal > bibliographical control is to find it all in one place, displayed in a > fashion that is easily and quickly comprehended" surely requires some > response. > > (i)I guess that "control" was a hasty first attempt and that "information" > is more in line with the intended meaning. > > (ii) I would really like to see the phrase "freely available" inserted > somewhere in the remark. At the moment, unless you are the member of a > subscribing institution you don't have free access to this bibliographic > information, either to "boost your ego" or to measure your impact.Citation > analysis - like any othe form of data analysis - requires access to the > data. > > Anyone else willing to chip in a cent or a yen or a euro or a ... ? > > Quentin Burrell > > > -----Original Message----- > From: ASIS Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene > Sent: 19 June 2002 18:27 > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: Re: [SIGMETRICS] Web citation (fwd) > > > It is almost six weeks since Tom Wilson posted this message. Many others > forwarded copies to me expecting me to respond to his challenge. > > It is always pleasant to learn that one's work has been mentioned on a > particular web site or that it is discussed in various courses. But while > they are newsworthy they havoc little real bearing on the use of citation > indexes to measure the impact of one's research. > > When you are quite young anything helps boost the ego, but the bottom line > for the researcher is whether anyone has used his or her basic ideas in > ongoing research. Until that day of Nirvana arrives when everything will be > searchable on the web I am afraid web searching just won't be an adequate > substitute. > > If you are working in the life sciences you can find many relevant citation > connections through such full text resources as HighWire Press, but that is > not yet complete nor is it presented in a form that is easily used for > citation analysis. That day may come. Steve Lawrence's project at NEC which > provides citation indexing in context for the computer science literature > illustrate what happens when you have only partial coverage. > > The ultimate objective of universal bibliographical control is to find it > all in one place, displayed in a fashion that is easily and quickly > comprehended. Gene Garfield > > When responding, please attach my original message > __________________________________________________ > Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu > home page: www.eugenegarfield.org > Tel: 215-243-2205 Fax 215-387-1266 > President, The Scientist LLC. www.the-scientist.com > Chairman Emeritus, ISI www.isinet.com > Past President, American Society for Information Science and Technology > (ASIS&T) www.asis.org > > > > > > > -----Original Message----- > From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] > Sent: Monday, May 06, 2002 10:10 AM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: [SIGMETRICS] Web citation (fwd) > > > ---------- Forwarded message ---------- > Date: Mon, 06 May 2002 12:25:22 +0100 > From: Prof. Tom Wilson > To: JESSE at LISTSERV.UTK.EDU > Subject: Web citation > > There have been a few mentions of Web citation searching possibly replacing > citation indexing in time and I wondered how many people are now, as a > matter of course, using counts of Web mentions in their cases for > appointment, tenure or promotion. > > I looked at a couple of my own papers and counted the SSCI citations and > then searched for mentions of the papers on the Web - the results left me > wondering whether the reliance on citation indexing as a measure of > performance is now past its sell by date. > > My most cited paper is "On user studies and information needs" (1981) - a > Web search (using Google) revealed 118 pages that listed the title. The > pages were reading lists, free electronic journals, and documents that would > never be covered by SSCI, such as reports from various agencies. SSCI > revealed, if I recall aright, 79 citations of the paper. The question is: is > the Web revealing impact more effectively than SSCI? Citation in scholarly > papers takes a variety of forms and much citation is of a token variety - x > is cited because x is always cited. On the other hand citation on reading > lists implies some positive recommendation of the text, and mention in > policy documents and the like, implies (at least in some cases) that some > benefit has been found in the cited document. > > It may also be that the use of Web citation would provide a more complete > measure - I discovered, much to my surprise, that a 1971 text of mine on > 'chain indexing' is cited on one reading list and in the bibliography of a > document in German on classification. Greater international coverage is a > further benefit of using Web citation. > > It strikes me that a move towards using Web citation as the measure of > performance would be rather more useful than the use of citation indexes. > > No doubt others have looked at this issue - is any consensus emerging? > > Tom Wilson > > ----------------------------------- > Professor T.D. Wilson, PhD > Publisher/Editor in Chief > Information Research > University of Sheffield > Sheffield S10 2TN > United Kingdom > Tel: +44-114-222-2642 > E-mail: t.d.wilson at shef.ac.uk > Web site: http://InformationR.net/ > ----------------------------------- > > -- -------------------------------------------------------- Isidro F. Aguillo isidro at cindoc.csic.es Laboratorio de Internet. CINDOC-CSIC Joaquin Costa, 22 Ph. +34-91-5635482 ext. 313 28002 Madrid Mb. +34-630-858997 ESPA?A-SPAIN Fx. +34-91-5642644 Editor Cybermetrics www.cindoc.csic.es/cybermetrics -------------------------------------------------------- From Garfield at CODEX.CIS.UPENN.EDU Wed Jul 10 13:18:35 2002 From: Garfield at CODEX.CIS.UPENN.EDU (Garfield, Eugene) Date: Wed, 10 Jul 2002 13:18:35 -0400 Subject: Person Citation Indexes unlimited!!! Message-ID: Bernie Sloan: I suppose that it is to be expected that after 35 years personal citation reports should be rediscovered. I suppose that through your eyes Personal Citation Indexes represent a kind of epiphany. And I will be grateful if your new look at personal awareness produces greater attention to this potential of citation indexes and the web. And as Peter Ingwerson suggests, it may cause even further and deeper understanding of the meanings of one's impact. When Bernie Sloan writes this all up I hope that he will be aware that there have been thousands of individuals who have been compiling personal citation reports for decades. Adding the new dimension of the web is an excellent embellishment, but whether it has any significance for research, rather than social interaction, is something to be seen. Many people other than researchers have social impacts. As Blaise Cronin has been trying to emphasize it would be nice to codify acknowledgements of all kinds and if the web can call some of these to one's attention that is all to the good. Teachers ought to be accorded the recognition that web links provide by citing their courses. And if they can convert that into useful information for tenure evaluation all the better. I have written a great deal about personalized information services. Perhaps the internet age will produce a more egocentric view of things and we can get researchers to compile personal citation indexes. But long years of experience demonstrates that it is difficult to get researchers to be that systematic. Fewer of them today feel self-conscious about compiling such reports. In the past it was wrongly interpreted as being vainglorious to look up one's citation record. This unfortunately goes back to the early days when citation indexes were still considered unwelcome by those who were not cited very often--and this happens to be a significant part of the academic population. There isn't a week that goes by that I don't provide a personal citation index to a researcher who has been active for decades. All that I have done is to enter his or her name in the Web of Science to first identify their published output and then to see how often and where they are cited. This often produces an overwhelming feeling because after a lifetime of research the information comes almost too late. It would have been much easier to absorb the information in weekly chunks by using a personal citation alert, but now they have to deal with dozens of papers never encountered before. But then there is hope--for those who want to look back on the impact of their work this personal report provides the basis for a lot of interpretation and often the results are quite surprising. It is the overwhelming nature of the information that has led me to pursue in more recent times my interest in providing researchers with a tool that takes this information and presents the personal citation report in a form that is amenable to digestion. I hope these ad hoc comments are what you are looking for. I hope you will pursue your ideas on the personal citation index with vigor and inculcate in students the importance of doing this on a regular and continuing basis. With best wishes. Gene Garfield When responding, please attach my original message __________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org -----Original Message----- From: Sloan, Bernie [mailto:bernies at UILLINOIS.EDU] Sent: Tuesday, July 09, 2002 1:44 PM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues Peter, For the past two years or so I have been dabbling in the collection of citations and inlinks to several papers of mine. I use your definition of "inlinks": "links pointing to web pages" (Bjorneborn & Ingwersen). I've been using both publicly available Web search engines (Google and AllTheWeb), as well as some commercial subscription-only databases from providers (e.g., ISI, the Gale Group, and EBSCO). I tried to be somewhat selective and did some brief analysis of the items I retrieved, e.g., I did not count inlinks from personal bookmark lists, or references to the papers from discussion group archives. I don't pretend that my papers are scientific papers, or that the citations and inlinks I have discovered are for "scientific items citing other scientific items." I did my best to eliminate any marginal entries, although "marginal" is definitely in the eye of the beholder here. I like to think of what I am doing as using the Web to discover the "influence of ideas". The exercise started with the Web of Science, and then broadened out to include the resources mentioned in the preceding paragraph. I don't think of the exercise as something that replaces ISI databases such as SCI, SSI, etc., but rather something that supplements the information obtained from ISI. One of the most interesting findings is that this exercise uncovered an international influence that I would not have been aware of using only the ISI databases. More than 40% of the citations/inlinks were from non-US sources. Of the citations/inlinks from non-US sources, fully 60% were associated with countries with a primary language other than English. Right now I am working on putting together a paper reporting on my findings, discoveries and questions in more detail, sort of a report on a work-in-progress. The biggest question I am grappling with is "So what?" I have a detailed listing of citations/inlinks for several of my papers. Beyond satisfying personal and academic curiosity, what can these "personal citation indices" be used for? Using them for evaluation springs to mind, but of course "evaluation" requires comparison against some standard or control group. I'm not aware of too many people who have conducted this exercise at a personal level. I have something that seems impressive to me, in a relative sense (i.e., a more comprehensive overview of the influence of ideas than I might obtain from a citation index like SSI). But what can I use it for? Bernie Sloan -----Original Message----- From: Ingwersen Peter [mailto:PI at DB.DK] Sent: Tuesday, July 09, 2002 9:52 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues Dear colleagues, as you may be well aware of our department was one of the first to engage into webometric analyses, in particular of web impact by means of inlinks. Several others around have done deep analyses of webometric nature to see if, for instance, there exists a correlation between citation impact and web impact/no. of inlinks (Bar Ilan) or between other indicators of recognition (e.g. RAE in the UK) and web impact (Thelwall). Sometimes there exist such correlations, but the major problem is that the web acts differently than scientific communication vehicles (no real conventions of linking etc.). Also: one may not equalize a web page with a scientific article. So Tom Wilson?s no. of hits (to web pages) does not necessarily correspond at all to "scientific items citing other scientific items" as in conventional citation analyses. Only the reading lists found by Wilson may act like such "reference lists". Further: Different search engines commonly perform differently on the same search profile, resulting in biased counts; several large quality studies have been done on "scientific" web page search results to observe the actual proportion of scientific output (see e.g. Allen et al in Science in 1999.) Results are appalling and pauvre - and highly dependent on the domain in question. For instance, in politically hot scientific topics (like in the environmental sc.-) there is a chaotic mix of scientific, semi-scientific, pseudo, popular and, foremost, political opinion papers. Should all the "published" pages count or only the peer reviewed ones - e.g. those published by scientific institutions or referring to peer reviewed journals or published in peer reviewed e-journals? Additionally, there are several possible web impacts: by inlink counts; by inlink counts and outlink counts; by web-based traditional references/citations on all the open web - or only in e-journals - with or without peer review. Tom will of course also run into the problem similar to that of ISI: in the citation databases no citations from books and non-ISI journals are counted; on the web only the open weblinks (and citations/references) are possible to count - not links/citations provided by pages/items on the hidden web (e.g. all the Dialog or ISI databases or the journals in publisher archives or in Digital Libraries. Finally, on the web the nature of obsolescence of information is quite different and not yet well understood - see e.g. Ronald Rousseau?s articles in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. A recent review on some of the issues touched upon above is: Bjorneborn, L. & Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): 65-82. Many regards - Peter Ingwersen ******************************************** Peter Ingwersen, Professor, Ph.D. Department of Information Studies Royal School of Library and Information Science, Birketinget 6, DK 2300 Copenhagen S - Denmark Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 http://www.db.dk/pi/ - e-mail: pi at db.dk Visiting Professor (Docent), Dept. of Information Studies ?bo University Akademi - Finland ******************************************** -----Oprindelig meddelelse----- Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] Sendt: 21. juni 2002 18:11 Til: SIGMETRICS at LISTSERV.UTK.EDU Emne: Re: [SIGMETRICS] Web citation (fwd) I am wholly in support of the SIGMETRICS site being one for discussion and so was interested in Tom's original submission and now Gene's response. Here comes my two penn'orth (Eng., coll., obs.?) Tom's observations are interesting - to his comment on token citations I would add (many cases of) self-citation - but I go along with Gene's uneasiness on the current haphazard coverage of the web being adequate to replace formal citation bases. Gene's final remark that the "ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended" surely requires some response. (i)I guess that "control" was a hasty first attempt and that "information" is more in line with the intended meaning. (ii) I would really like to see the phrase "freely available" inserted somewhere in the remark. At the moment, unless you are the member of a subscribing institution you don't have free access to this bibliographic information, either to "boost your ego" or to measure your impact.Citation analysis - like any othe form of data analysis - requires access to the data. Anyone else willing to chip in a cent or a yen or a euro or a ... ? Quentin Burrell -----Original Message----- From: ASIS Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene Sent: 19 June 2002 18:27 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] Web citation (fwd) It is almost six weeks since Tom Wilson posted this message. Many others forwarded copies to me expecting me to respond to his challenge. It is always pleasant to learn that one's work has been mentioned on a particular web site or that it is discussed in various courses. But while they are newsworthy they havoc little real bearing on the use of citation indexes to measure the impact of one's research. When you are quite young anything helps boost the ego, but the bottom line for the researcher is whether anyone has used his or her basic ideas in ongoing research. Until that day of Nirvana arrives when everything will be searchable on the web I am afraid web searching just won't be an adequate substitute. If you are working in the life sciences you can find many relevant citation connections through such full text resources as HighWire Press, but that is not yet complete nor is it presented in a form that is easily used for citation analysis. That day may come. Steve Lawrence's project at NEC which provides citation indexing in context for the computer science literature illustrate what happens when you have only partial coverage. The ultimate objective of universal bibliographical control is to find it all in one place, displayed in a fashion that is easily and quickly comprehended. Gene Garfield When responding, please attach my original message __________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org -----Original Message----- From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] Sent: Monday, May 06, 2002 10:10 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] Web citation (fwd) ---------- Forwarded message ---------- Date: Mon, 06 May 2002 12:25:22 +0100 From: Prof. Tom Wilson To: JESSE at LISTSERV.UTK.EDU Subject: Web citation There have been a few mentions of Web citation searching possibly replacing citation indexing in time and I wondered how many people are now, as a matter of course, using counts of Web mentions in their cases for appointment, tenure or promotion. I looked at a couple of my own papers and counted the SSCI citations and then searched for mentions of the papers on the Web - the results left me wondering whether the reliance on citation indexing as a measure of performance is now past its sell by date. My most cited paper is "On user studies and information needs" (1981) - a Web search (using Google) revealed 118 pages that listed the title. The pages were reading lists, free electronic journals, and documents that would never be covered by SSCI, such as reports from various agencies. SSCI revealed, if I recall aright, 79 citations of the paper. The question is: is the Web revealing impact more effectively than SSCI? Citation in scholarly papers takes a variety of forms and much citation is of a token variety - x is cited because x is always cited. On the other hand citation on reading lists implies some positive recommendation of the text, and mention in policy documents and the like, implies (at least in some cases) that some benefit has been found in the cited document. It may also be that the use of Web citation would provide a more complete measure - I discovered, much to my surprise, that a 1971 text of mine on 'chain indexing' is cited on one reading list and in the bibliography of a document in German on classification. Greater international coverage is a further benefit of using Web citation. It strikes me that a move towards using Web citation as the measure of performance would be rather more useful than the use of citation indexes. No doubt others have looked at this issue - is any consensus emerging? Tom Wilson ----------------------------------- Professor T.D. Wilson, PhD Publisher/Editor in Chief Information Research University of Sheffield Sheffield S10 2TN United Kingdom Tel: +44-114-222-2642 E-mail: t.d.wilson at shef.ac.uk Web site: http://InformationR.net/ ----------------------------------- From garfield at CODEX.CIS.UPENN.EDU Wed Jul 10 14:38:54 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Wed, 10 Jul 2002 14:38:54 -0400 Subject: White W. "The contribution of Bibliometric methods to a theory of scientific communication" ASIST 2001: PROCEEDINGS OF THE 64TH ASIST ANNUAL MEETING, VOL 38, 2001 PROCEEDINGS OF THE ASIST ANNUAL MEETING 38: 498-505 2001 Message-ID: William White : whitew at scils.rutgers.edu Title The contribution of Bibliometric methods to a theory of scientific communication Author White W Journal ASIST 2001: PROCEEDINGS OF THE 64TH ASIST ANNUAL MEETING, VOL 38, 2001 PROCEEDINGS OF THE ASIST ANNUAL MEETING 38: 498-505 2001 Document type: Article Language: English Cited References: 32 Times Cited: 0 Abstract: Some theoretical models of scientific communication suggest that science may be fruitfully understood as a heterogeneous network of social actors and ideational elements. The argument offered in this paper is that bibliometric methods-in brief, the analysis of textual properties of the artifacts of scholarly communication-provide the means for the empirical application of this perspective to investigations of the formal communication system in science. This paper emphasizes the conceptual-operational links between key words as a measure of ideation and citations as a measure of disciplinary affiliation. It argues that such links may be used to operationalize the discursive positions occupied by scholarly articles, which may be considered to be instantiations of the heterogeneous network of scientists and their ideas. An important implication of this linkage is the potential for a more satisfying theory of citations. KeyWords Plus: CITATION Addresses: White W, Rutgers State Univ, New Brunswick, NJ 08903 USA Rutgers State Univ, New Brunswick, NJ 08903 USA Publisher: INFORMATION TODAY INC, MEDFORD IDS Number: BU37V Cited Author Cited Work Volume Page Year BORGATTI SP UCINET 5 WINDOWS SOF 1999 BROOKS TA J AM SOC INFORM SCI 36 223 1985 CALLON M MAPPING DYNAMICS SCI 3 1986 CANO V J AM SOC INFORM SCI 40 284 1989 CARLEY K SOCIOL METHODOL 23 75 1993 CHUBIN DE SOC STUD SCI 5 423 1975 COLLINS AM COGNITION LEARNING M 117 1972 COLLINS R SOCIOLOGY PHILOS GLO 1998 COZZENS SE SCIENTOMETRICS 15 437 1989 CRONIN B CITATION PROCESS ROL 1984 DANOWSKI JA ANN M INT COMM ASS C 1986 DANOWSKI JA HUMAN COMMUNICATION 6 299 1980 DANOWSKI JA NETWORK ANAL MESSAGE 1994 DOERFEL ML HUM COMMUN RES 25 589 1999 EDGE D HIST SCI 17 102 1979 GARFIELD E METRIC SCI ADVENT SC 1978 GILBERT GN SOC STUD SCI 7 113 1977 GLANZEL W INFORM PROCESS MANAG 35 31 1999 LATOUR B SCI ACTION FOLLOW SC 1987 LEYDESDORFF L SCIENTOMETRICS 43 5 1998 LORRAIN F J MATH SOCIOL 1 49 1971 MALRIEU JP QUAL QUANT 28 55 1994 MONGE PR HDB ORG COMMUNICATIO 304 1987 MULKAY M PHILOS SOC SCI 11 163 1981 MULLINS NC MINERVA 10 51 1972 POLANYI M PERSONAL KNOWLEDGE P 1958 RICE RE 49 ANN C INT COMM AS 1999 SHADISH WR SOC STUD SCI 25 477 1995 SMALL HG SOC STUD SCI 8 327 1978 WHITE HD SCHOLARLY COMMUNICAT 84 1990 WHITE WJ IN PRESS COMMUNICATI 11 ZUCKERMAN H SCIENTOMETRICS 12 327 1987 From garfield at CODEX.CIS.UPENN.EDU Wed Jul 10 15:17:33 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Wed, 10 Jul 2002 15:17:33 -0400 Subject: Morris TA "Structural relationships within medical informatics" JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION : 590-594 Suppl. S 2000 Message-ID: Theodore Allan Morris : tamorris at kent.edu TITLE Structural relationships within medical informatics AUTHOR Morris TA JOURNAL JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION : 590-594 Suppl. S 2000 Document type: Article Language: English Cited References: 18 Times Cited: 0 Abstract: This study seeks to increase our understanding of the structure of Medical Informatics. In particular, it focuses on the relationships between information science and information technology on the one hand, and biomedical research, clinical practice, and medical education on the other, that have defined "medical informatics." Using indexing terms and MeSH tree structures assigned to medical informatics literature covered by MEDLINE, co-occurrence analysis provides a "map" of the field. Major research and application focuses arrayed within the map elucidate a finer structure than reported previously. Dimensions "Techniques vs. Systems" and "Signs & Symptoms vs. Processes" form the two axes of the map and relate to the relationships underlying the indexing assignments given to the literature studied. Related studies underway using the INSPEC database will provide a complementary perspective on the structure of medical informatics as a field. KeyWords Plus: CITATION ANALYSIS, SCIENCE, SERIALS, RANKING, FIELD, SET Addresses: Morris TA, Univ Cincinnati, Med Ctr, Cincinnati, OH 45267 USA Univ Cincinnati, Med Ctr, Cincinnati, OH 45267 USA Publisher: HANLEY & BELFUS INC, PHILADELPHIA IDS Number: 458RC ISSN: 1067-5027 Cited Author Cited Work Volume Page Year S03 S08 VAR LAB ASS BECK JR MED DECIS MAKING 4 449 1984 BRAAM RR J AM SOC INFORM SCI 42 233 1991 GREENES RA P 11 ANN S COMP APPL 411 1987 MCCAIN KW J AM SOC INFORM SCI 40 110 1989 MILLER MD J MED EDUC 5 797 1982 MORRIS TA J AM MED INFORM ASSN 5 448 1998 MORRIS TA THESIS DREXEL U PYLE KI MED DECIS MAKING 8 155 1988 ROGERS LA SCIENTOMETRICS 28 61 1993 SITTIG DF B MED LIBR ASSOC 87 43 1999 SITTIG DF B MED LIBR ASSOC 84 200 1996 SITTIG DF MEDINFO 95 1452 1995 SITTIG DF METHOD INFORM MED 34 397 1995 TIJSSEN RJW EVALUATION REV 18 98 1994 TIJSSEN RJW SCIENTOMETRICS 28 111 1993 VISHWANATHAM R B MED LIBR ASSOC 86 518 1998 WHITE HD ANNU REV INFORM SCI 32 99 1997 From loet at LEYDESDORFF.NET Wed Jul 10 15:45:50 2002 From: loet at LEYDESDORFF.NET (Loet Leydesdorff) Date: Wed, 10 Jul 2002 21:45:50 +0200 Subject: Web citation issues In-Reply-To: <991DCD1CCB9CD3118B38009027AA429E752A21@LOEN> Message-ID: Dear colleagues, Some of you may experience accessing the report using the previously indicated address (because of interface problems between IE and Adobe Acrobat when using pointers). The "physical address" should provide you with direct access in these cases at http://users.fmg.uva.nl/lleydesdorff/bmbf02/indicators.pdf Apologies for the inconvenience. With kind regards, Loet ************************************************************* Loet Leydesdorff Science & Technology Dynamics, University of Amsterdam Amsterdam School of Communications Research (ASCoR) Kloveniersburgwal 48, 1012 CX Amsterdam Tel.: +31-20-525 6598; fax: +31-20-525 3681 http://www.leydesdorff.net/ ; loet at leydesdorff.net http://www.upublish.com/books/leydesdorff.htm From quentinburrell at MANX.NET Wed Jul 10 16:09:06 2002 From: quentinburrell at MANX.NET (Quentin L. Burrell) Date: Wed, 10 Jul 2002 21:09:06 +0100 Subject: White W. "The contribution of Bibliometric methods to a theory of scientific communication" ASIST 2001: PROCEEDINGS OF THE 64TH ASIST ANNUAL MEETING, VOL 38, 2001 PROCEEDINGS OF THE ASIS In-Reply-To: <200207101839.g6AIOXGW017062@panther.mail.utk.edu> Message-ID: I am not in a position to comment on the quality of William White's article, but I do wonder whether words like "ideation" and "instantiation" add anything to the language, whether English or American. (Please do not take offence, that was not my intentionality!) Quentin -----Original Message----- From: ASIS Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Eugene Garfield Sent: 10 July 2002 19:39 To: SIGMETRICS at LISTSERV.UTK.EDU Subject: [SIGMETRICS] White W. "The contribution of Bibliometric methods to a theory of scientific communication" ASIST 2001: PROCEEDINGS OF THE 64TH ASIST ANNUAL MEETING, VOL 38, 2001 PROCEEDINGS OF THE ASIST AN William White : whitew at scils.rutgers.edu Title The contribution of Bibliometric methods to a theory of scientific communication Author White W Journal ASIST 2001: PROCEEDINGS OF THE 64TH ASIST ANNUAL MEETING, VOL 38, 2001 PROCEEDINGS OF THE ASIST ANNUAL MEETING 38: 498-505 2001 Document type: Article Language: English Cited References: 32 Times Cited: 0 Abstract: Some theoretical models of scientific communication suggest that science may be fruitfully understood as a heterogeneous network of social actors and ideational elements. The argument offered in this paper is that bibliometric methods-in brief, the analysis of textual properties of the artifacts of scholarly communication-provide the means for the empirical application of this perspective to investigations of the formal communication system in science. This paper emphasizes the conceptual-operational links between key words as a measure of ideation and citations as a measure of disciplinary affiliation. It argues that such links may be used to operationalize the discursive positions occupied by scholarly articles, which may be considered to be instantiations of the heterogeneous network of scientists and their ideas. An important implication of this linkage is the potential for a more satisfying theory of citations. KeyWords Plus: CITATION Addresses: White W, Rutgers State Univ, New Brunswick, NJ 08903 USA Rutgers State Univ, New Brunswick, NJ 08903 USA Publisher: INFORMATION TODAY INC, MEDFORD IDS Number: BU37V Cited Author Cited Work Volume Page Year BORGATTI SP UCINET 5 WINDOWS SOF 1999 BROOKS TA J AM SOC INFORM SCI 36 223 1985 CALLON M MAPPING DYNAMICS SCI 3 1986 CANO V J AM SOC INFORM SCI 40 284 1989 CARLEY K SOCIOL METHODOL 23 75 1993 CHUBIN DE SOC STUD SCI 5 423 1975 COLLINS AM COGNITION LEARNING M 117 1972 COLLINS R SOCIOLOGY PHILOS GLO 1998 COZZENS SE SCIENTOMETRICS 15 437 1989 CRONIN B CITATION PROCESS ROL 1984 DANOWSKI JA ANN M INT COMM ASS C 1986 DANOWSKI JA HUMAN COMMUNICATION 6 299 1980 DANOWSKI JA NETWORK ANAL MESSAGE 1994 DOERFEL ML HUM COMMUN RES 25 589 1999 EDGE D HIST SCI 17 102 1979 GARFIELD E METRIC SCI ADVENT SC 1978 GILBERT GN SOC STUD SCI 7 113 1977 GLANZEL W INFORM PROCESS MANAG 35 31 1999 LATOUR B SCI ACTION FOLLOW SC 1987 LEYDESDORFF L SCIENTOMETRICS 43 5 1998 LORRAIN F J MATH SOCIOL 1 49 1971 MALRIEU JP QUAL QUANT 28 55 1994 MONGE PR HDB ORG COMMUNICATIO 304 1987 MULKAY M PHILOS SOC SCI 11 163 1981 MULLINS NC MINERVA 10 51 1972 POLANYI M PERSONAL KNOWLEDGE P 1958 RICE RE 49 ANN C INT COMM AS 1999 SHADISH WR SOC STUD SCI 25 477 1995 SMALL HG SOC STUD SCI 8 327 1978 WHITE HD SCHOLARLY COMMUNICAT 84 1990 WHITE WJ IN PRESS COMMUNICATI 11 ZUCKERMAN H SCIENTOMETRICS 12 327 1987 From garfield at CODEX.CIS.UPENN.EDU Wed Jul 10 16:43:32 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Wed, 10 Jul 2002 16:43:32 -0400 Subject: Joyce J, Rabe-Hesketh S, Wessely S "Reviewing the reviews - The example of chronic fatigue syndrome" JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 280 (3): 264-266 JUL 15 1998 Message-ID: Simon Wessely : e-mail: sphascw at iop.bpmf.ac.uk TITLE Reviewing the reviews - The example of chronic fatigue syndrome AUTHOR Joyce J, Rabe-Hesketh S, Wessely S JOURNAL JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 280 (3): 264-266 JUL 15 1998 Document type: Article Language: English Cited References: 13 Times Cited: 14 Abstract: Objective;-To test the hypothesis that the selection of literature in review articles is unsystematic and is influenced by the authors' discipline and country of residence. Data Sources.-Reviews in English published between 1980 and March 1996 in MEDLINE, EMBASE (BIDS), PSYCHLIT, and Current Contents were searched. Study Selection.-Reviews of chronic fatigue syndrome (CFS) were selected. Articles explicitly concerned with a specialty aspect of CFS and unattributed, unreferenced, or insufficiently referenced articles were discarded. Data Extraction.-Record of data sources in each review was noted as was the departmental specialty of the first author and his or her country of residence. The references cited in each index paper were tabulated by assigning them to 6 specialty categories, by article title, and by assigning them to 8 categories, by country of journal publication. Data Synthesis.-Of 89 reviews, 3 (3.4%) reported on literature search and described search method. Authors from laboratory-based disciplines preferentially cited laboratory references, while psychiatry-based disciplines preferentially cited psychiatric literature (P =.01). A total of 71.6% of references cited by US authors were from US journals, while 54.9% of references cited by United Kingdom authors were published in United Kingdom journals (P =.001). Conclusion.-Citation of the literature is influenced by review authors' discipline and nationality. KeyWords Plus: PUBLICATION, TRIALS, BIAS Addresses: Wessely S, Univ London Kings Coll Hosp, Dept Psychol Med, Denmark Hill, London SE5 9RS, England Univ London Kings Coll Hosp, Dept Psychol Med, London SE5 9RS, England Univ London Kings Coll, Sch Med, Inst Psychiat, London SE5 9PJ, England Maudsley Hosp, London SE5 8AZ, England Publisher: AMER MEDICAL ASSOC, CHICAGO IDS Number: ZZ204 ISSN: 0098-7484 Cited Author Cited Work Volume Page Year CAMPBELL F B MED LIB ASS 78 376 1996 CHALMERS TC JAMA-J AM MED ASSOC 263 1392 1990 DAWSON NV J GEN INTERN MED 2 183 1987 EGGER M LANCET 350 326 1997 GOER JC BIPLOTS 1996 GOTZSCHE PC BRIT MED J 295 654 1987 GREGOIRE G J CLIN EPIDEMIOL 48 159 1996 INGELFINGER FJ AM J MED 56 686 1974 JADAD AR J CLIN EPIDEMIOL 2 235 1996 MOHER D LANCET 347 363 1996 MULROW CD ANN INTERN MED 106 485 1987 OXMAN AD ANN NY ACAD SCI 703 125 1992 OXMAN AD J CLIN EPIDEMIOL 44 92 1991 From davisc at INDIANA.EDU Wed Jul 10 18:29:27 2002 From: davisc at INDIANA.EDU (Charles H. Davis) Date: Wed, 10 Jul 2002 17:29:27 -0500 Subject: White W. =?iso-8859-1?q?=22The?= contribution of Bibliometric methods to a theory of scientific =?iso-8859-1?q?communication=22?= ASIST 2001: PROCEEDINGS OF THE 64TH ASIST ANNUAL MEETING, VOL 38, 2001 PROCEEDINGS OF THE ASIS In-Reply-To: Message-ID: Dear Quentin: Ouch... you are one wicked dude! :-) Cordially, Charles =========================== Charles H. Davis, Ph.D. Senior Fellow, SLIS; Informatics Indiana University at Bloomington (812) 331-1322 Fax: (812) 855-6166 http://php.indiana.edu/~davisc/ ------------------- > I am not in a position to comment on the quality of William White's article, > but I do wonder whether words like "ideation" and "instantiation" add > anything to the language, whether English or American. > > (Please do not take offence, that was not my intentionality!) > > Quentin > > -----Original Message----- > From: ASIS Special Interest Group on Metrics > [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Eugene Garfield > Sent: 10 July 2002 19:39 > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: [SIGMETRICS] White W. "The contribution of Bibliometric methods > to a theory of scientific communication" ASIST 2001: PROCEEDINGS OF THE > 64TH ASIST ANNUAL MEETING, VOL 38, 2001 PROCEEDINGS OF THE ASIST AN > > > William White : whitew at scils.rutgers.edu > > > Title The contribution of Bibliometric methods to a theory of > scientific communication > Author White W > Journal ASIST 2001: PROCEEDINGS OF THE 64TH ASIST ANNUAL MEETING, > VOL 38, 2001 PROCEEDINGS OF THE ASIST ANNUAL MEETING > 38: 498-505 2001 > > Document type: Article Language: English > Cited References: 32 Times Cited: 0 > > > Abstract: > Some theoretical models of scientific communication suggest that science may > be fruitfully understood as a heterogeneous network of social actors and > ideational elements. The argument offered in this paper is that bibliometric > methods-in brief, the analysis of textual properties of the artifacts of > scholarly communication-provide the means for the empirical application of > this perspective to investigations of the formal communication system in > science. This paper emphasizes the conceptual-operational links between key > words as a measure of ideation and citations as a measure of disciplinary > affiliation. It argues that such links may be used to operationalize the > discursive positions occupied by scholarly articles, which may be considered > to be instantiations of the heterogeneous network of scientists and their > ideas. An important implication of this linkage is the potential for a more > satisfying theory of citations. > > KeyWords Plus: > CITATION > > Addresses: > White W, Rutgers State Univ, New Brunswick, NJ 08903 USA > Rutgers State Univ, New Brunswick, NJ 08903 USA > > Publisher: > INFORMATION TODAY INC, MEDFORD > > IDS Number: > BU37V > > > Cited Author Cited Work Volume Page > Year > > BORGATTI SP UCINET 5 WINDOWS SOF 1999 > BROOKS TA J AM SOC INFORM SCI 36 223 1985 > CALLON M MAPPING DYNAMICS SCI 3 1986 > CANO V J AM SOC INFORM SCI 40 284 1989 > CARLEY K SOCIOL METHODOL 23 75 1993 > CHUBIN DE SOC STUD SCI 5 423 1975 > COLLINS AM COGNITION LEARNING M 117 1972 > COLLINS R SOCIOLOGY PHILOS GLO 1998 > COZZENS SE SCIENTOMETRICS 15 437 1989 > CRONIN B CITATION PROCESS ROL 1984 > DANOWSKI JA ANN M INT COMM ASS C 1986 > DANOWSKI JA HUMAN COMMUNICATION 6 299 1980 > DANOWSKI JA NETWORK ANAL MESSAGE 1994 > DOERFEL ML HUM COMMUN RES 25 589 1999 > EDGE D HIST SCI 17 102 1979 > GARFIELD E METRIC SCI ADVENT SC 1978 > GILBERT GN SOC STUD SCI 7 113 1977 > GLANZEL W INFORM PROCESS MANAG 35 31 1999 > LATOUR B SCI ACTION FOLLOW SC 1987 > LEYDESDORFF L SCIENTOMETRICS 43 5 1998 > LORRAIN F J MATH SOCIOL 1 49 1971 > MALRIEU JP QUAL QUANT 28 55 1994 > MONGE PR HDB ORG COMMUNICATIO 304 1987 > MULKAY M PHILOS SOC SCI 11 163 1981 > MULLINS NC MINERVA 10 51 1972 > POLANYI M PERSONAL KNOWLEDGE P 1958 > RICE RE 49 ANN C INT COMM AS 1999 > SHADISH WR SOC STUD SCI 25 477 1995 > SMALL HG SOC STUD SCI 8 327 1978 > WHITE HD SCHOLARLY COMMUNICAT 84 1990 > WHITE WJ IN PRESS COMMUNICATI 11 > ZUCKERMAN H SCIENTOMETRICS 12 327 1987 > From isidro at CINDOC.CSIC.ES Thu Jul 11 08:37:14 2002 From: isidro at CINDOC.CSIC.ES (Isidro F. Aguillo) Date: Thu, 11 Jul 2002 14:37:14 +0200 Subject: [bibliometrics literature coverage of literature and the web Message-ID: Dear all: I agree with Eugene about making public his message because part of my answer is closely linked with the interesting debate about web citations. The request to use SIGMET messages was done for the future ISSI website in order to offer a "good" coverage of the recent literature and some summaries about debates and other topics covered by SIGMET. The aim was to reserve cybermetric/webometric references for the Cybermetrics ejournal directory and use new ISSI website to cover "SI" citations. From my previous Cybermetrics experience it can be very useful to have this kind of information "repositories" in the Web, consisting not only of paper citations but considering other resources too: Directories of personal pages, lists of unpublished presentations, links to databases and software providers, access to databases or other raw data. The compilation task can be really hard, but extending Eugene's invitation, all of us can benefit if the lists are used to distribute data about papers, web resources or new software. Then this information will be uploaded to the websites for universal availability. As I previously stated this effort is not going to increase our IF but clearly the visibility will be greater. Garfield, Eugene wrote: > Isidro's recent email message to SIGMETRICS reminded me that I have not > heard from anyone at ISSI concerning the further use and expansion of the > SIGMETRICS archive. I think someone had asked whether the SIGMET > information could be used by ISSI. To make things quite clear I would be > delighted for any of my postings to SIGMET to be sent to the ISSI listserv. > But perhaps it is important to ask how much overlap there is in the two > lists. > > I have not seen few contributions of the kind that I have been posting. If > there are significant items outside the literature covered by ISI, as e.g. > postings to web sites, why haven't SIGMET members or ISSI members been > posting them to SIGMET? > > SIGMET is open and free to everyone. So if as Sloane and others have been > suggesting, there is a significant amount of relevant information that is > not revealed from the ISI databases, then why hasn't it been reported, at > least for the field of bibliometrics,etc. in SIGMET? > > When I first began this note to Isidro I did not think it relevant for the > entire SIGMET readership but I see now that is clearly is a matter that all > members of SIGMET and ISSI should take to heart. If we are to provide truly > comprehensive coverage of the field then it is the duty of all members to > create suitable postings for all to share. Best wishes. Eugene Garfield > > > When responding, please attach my original message > __________________________________________________ > Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu > home page: www.eugenegarfield.org > Tel: 215-243-2205 Fax 215-387-1266 > President, The Scientist LLC. www.the-scientist.com > Chairman Emeritus, ISI www.isinet.com > Past President, American Society for Information Science and Technology > (ASIS&T) www.asis.org > > > > > > > -----Original Message----- > From: Isidro F. Aguillo [mailto:isidro at CINDOC.CSIC.ES] > Sent: Wednesday, July 10, 2002 7:46 AM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: [SIGMETRICS] Web citation issues > > > Dear all: > > I arrive a bit late to this debate, but I think an important point is > missing in several of the messages. Most of them focus on the > comparision between links and citations and the reasons to cite and the > objects to be cited. Certainly both wordls are different and printed > literature and bibliographic references are superior for bibliometric > analysis. > > But our traditional approach has several shortcommings as several > authours have already pointed. From the evaluation and policy purposes > point of view, one of the most important is that there are no enough > readily available information for a real sciencetechnoeconometrics. The > interlinked nature of the Web offer the possibility to discover hidden > relationships among different websites, including not only the bonds > that binds academic communities but those showing economic, industrial, > social or cultural relationships. And this is not easy with traditional > quantitative methods. > > Going to the personal aspects, the presence on the Web of research > groups, professors or postgraduate students reflects a wider range of > activities than formal publication in refereed journals, such as > unpublished material, general public contributions, drafts for future > papers or book chapters, slides used in conference or seminar > presentations, support material for courses or even raw data. The > picture you can obtain from a researcher is therefore more complete. > > Finally, as tax-payer citizen supporting public research activities I > request better access to the results obtained by scientists and in this > sense the Web reaches a wider audience than the paper based publications > like journals or books. In fact almost all the information published on > the Web can be recover by any Internet user worldwide. > > Comments ... > > Sloan, Bernie wrote: > > >>Peter, >> >>For the past two years or so I have been dabbling in the collection of >>citations and inlinks to several papers of mine. I use your definition of >>"inlinks": "links pointing to web pages" (Bjorneborn & Ingwersen). I've >> > been > >>using both publicly available Web search engines (Google and AllTheWeb), >> > as > >>well as some commercial subscription-only databases from providers (e.g., >>ISI, the Gale Group, and EBSCO). I tried to be somewhat selective and did >>some brief analysis of the items I retrieved, e.g., I did not count >> > inlinks > >>from personal bookmark lists, or references to the papers from discussion >>group archives. >> >>I don't pretend that my papers are scientific papers, or that the >> > citations > >>and inlinks I have discovered are for "scientific items citing other >>scientific items." I did my best to eliminate any marginal entries, >> > although > >>"marginal" is definitely in the eye of the beholder here. I like to think >> > of > >>what I am doing as using the Web to discover the "influence of ideas". The >>exercise started with the Web of Science, and then broadened out to >> > include > >>the resources mentioned in the preceding paragraph. I don't think of the >>exercise as something that replaces ISI databases such as SCI, SSI, etc., >>but rather something that supplements the information obtained from ISI. >> >>One of the most interesting findings is that this exercise uncovered an >>international influence that I would not have been aware of using only the >>ISI databases. More than 40% of the citations/inlinks were from non-US >>sources. Of the citations/inlinks from non-US sources, fully 60% were >>associated with countries with a primary language other than English. >> >>Right now I am working on putting together a paper reporting on my >> > findings, > >>discoveries and questions in more detail, sort of a report on a >>work-in-progress. The biggest question I am grappling with is "So what?" I >>have a detailed listing of citations/inlinks for several of my papers. >>Beyond satisfying personal and academic curiosity, what can these >> > "personal > >>citation indices" be used for? Using them for evaluation springs to mind, >>but of course "evaluation" requires comparison against some standard or >>control group. I'm not aware of too many people who have conducted this >>exercise at a personal level. I have something that seems impressive to >> > me, > >>in a relative sense (i.e., a more comprehensive overview of the influence >> > of > >>ideas than I might obtain from a citation index like SSI). But what can I >>use it for? >> >>Bernie Sloan >> >>-----Original Message----- >>From: Ingwersen Peter [mailto:PI at DB.DK] >>Sent: Tuesday, July 09, 2002 9:52 AM >>To: SIGMETRICS at LISTSERV.UTK.EDU >>Subject: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues >> >>Dear colleagues, as you may be well aware of our department was one of the >>first to engage into webometric analyses, in particular of web impact by >>means of inlinks. Several others around have done deep analyses of >>webometric nature to see if, for instance, there exists a correlation >>between citation impact and web impact/no. of inlinks (Bar Ilan) or >> > between > >>other indicators of recognition (e.g. RAE in the UK) and web impact >>(Thelwall). Sometimes there exist such correlations, but the major problem >>is that the web acts differently than scientific communication vehicles >> > (no > >>real conventions of linking etc.). Also: one may not equalize a web page >>with a scientific article. So Tom Wilson?s no. of hits (to web pages) does >>not necessarily correspond at all to "scientific items citing other >>scientific items" as in conventional citation analyses. Only the reading >>lists found by Wilson may act like such "reference lists". Further: >>Different search engines commonly perform differently on the same search >>profile, resulting in biased counts; several large quality studies have >> > been > >>done on "scientific" web page search results to observe the actual >>proportion of scientific output (see e.g. Allen et al in Science in 1999.) >>Results are appalling and pauvre - and highly dependent on the domain in >>question. For instance, in politically hot scientific topics (like in the >>environmental sc.-) there is a chaotic mix of scientific, semi-scientific, >>pseudo, popular and, foremost, political opinion papers. Should all the >>"published" pages count or only the peer reviewed ones - e.g. those >>published by scientific institutions or referring to peer reviewed >> > journals > >>or published in peer reviewed e-journals? >>Additionally, there are several possible web impacts: by inlink counts; by >>inlink counts and outlink counts; by web-based traditional >>references/citations on all the open web - or only in e-journals - with or >>without peer review. >>Tom will of course also run into the problem similar to that of ISI: in >> > the > >>citation databases no citations from books and non-ISI journals are >> > counted; > >>on the web only the open weblinks (and citations/references) are possible >> > to > >>count - not links/citations provided by pages/items on the hidden web >> > (e.g. > >>all the Dialog or ISI databases or the journals in publisher archives or >> > in > >>Digital Libraries. >>Finally, on the web the nature of obsolescence of information is quite >>different and not yet well understood - see e.g. Ronald Rousseau?s >> > articles > >>in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. >>A recent review on some of the issues touched upon above is: Bjorneborn, >> > L. > >>& Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): >> > 65-82. > >>Many regards - Peter Ingwersen >>******************************************** >>Peter Ingwersen, Professor, Ph.D. >>Department of Information Studies >>Royal School of Library and Information Science, >>Birketinget 6, DK 2300 Copenhagen S - Denmark >>Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 >>http://www.db.dk/pi/ - e-mail: pi at db.dk >>Visiting Professor (Docent), Dept. of Information Studies >>?bo University Akademi - Finland >>******************************************** >> >> >>-----Oprindelig meddelelse----- >>Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] >>Sendt: 21. juni 2002 18:11 >>Til: SIGMETRICS at LISTSERV.UTK.EDU >>Emne: Re: [SIGMETRICS] Web citation (fwd) >> >> >>I am wholly in support of the SIGMETRICS site being one for discussion and >>so was interested in Tom's original submission and now Gene's response. >> > Here > >>comes my two penn'orth (Eng., coll., obs.?) >> >>Tom's observations are interesting - to his comment on token citations I >>would add (many cases of) self-citation - but I go along with Gene's >>uneasiness on the current haphazard coverage of the web being adequate to >>replace formal citation bases. >> >>Gene's final remark that the "ultimate objective of universal >>bibliographical control is to find it all in one place, displayed in a >>fashion that is easily and quickly comprehended" surely requires some >>response. >> >>(i)I guess that "control" was a hasty first attempt and that "information" >>is more in line with the intended meaning. >> >>(ii) I would really like to see the phrase "freely available" inserted >>somewhere in the remark. At the moment, unless you are the member of a >>subscribing institution you don't have free access to this bibliographic >>information, either to "boost your ego" or to measure your impact.Citation >>analysis - like any othe form of data analysis - requires access to the >>data. >> >>Anyone else willing to chip in a cent or a yen or a euro or a ... ? >> >>Quentin Burrell >> >> >>-----Original Message----- >>From: ASIS Special Interest Group on Metrics >>[mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene >>Sent: 19 June 2002 18:27 >>To: SIGMETRICS at LISTSERV.UTK.EDU >>Subject: Re: [SIGMETRICS] Web citation (fwd) >> >> >>It is almost six weeks since Tom Wilson posted this message. Many others >>forwarded copies to me expecting me to respond to his challenge. >> >>It is always pleasant to learn that one's work has been mentioned on a >>particular web site or that it is discussed in various courses. But while >>they are newsworthy they havoc little real bearing on the use of citation >>indexes to measure the impact of one's research. >> >>When you are quite young anything helps boost the ego, but the bottom line >>for the researcher is whether anyone has used his or her basic ideas in >>ongoing research. Until that day of Nirvana arrives when everything will >> > be > >>searchable on the web I am afraid web searching just won't be an adequate >>substitute. >> >>If you are working in the life sciences you can find many relevant >> > citation > >>connections through such full text resources as HighWire Press, but that >> > is > >>not yet complete nor is it presented in a form that is easily used for >>citation analysis. That day may come. Steve Lawrence's project at NEC >> > which > >>provides citation indexing in context for the computer science literature >>illustrate what happens when you have only partial coverage. >> >>The ultimate objective of universal bibliographical control is to find it >>all in one place, displayed in a fashion that is easily and quickly >>comprehended. Gene Garfield >> >>When responding, please attach my original message >>__________________________________________________ >>Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu >>home page: www.eugenegarfield.org >>Tel: 215-243-2205 Fax 215-387-1266 >>President, The Scientist LLC. www.the-scientist.com >>Chairman Emeritus, ISI www.isinet.com >>Past President, American Society for Information Science and Technology >>(ASIS&T) www.asis.org >> >> >> >> >> >> >>-----Original Message----- >>From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] >>Sent: Monday, May 06, 2002 10:10 AM >>To: SIGMETRICS at LISTSERV.UTK.EDU >>Subject: [SIGMETRICS] Web citation (fwd) >> >> >>---------- Forwarded message ---------- >>Date: Mon, 06 May 2002 12:25:22 +0100 >>From: Prof. Tom Wilson >>To: JESSE at LISTSERV.UTK.EDU >>Subject: Web citation >> >>There have been a few mentions of Web citation searching possibly >> > replacing > >>citation indexing in time and I wondered how many people are now, as a >>matter of course, using counts of Web mentions in their cases for >>appointment, tenure or promotion. >> >>I looked at a couple of my own papers and counted the SSCI citations and >>then searched for mentions of the papers on the Web - the results left me >>wondering whether the reliance on citation indexing as a measure of >>performance is now past its sell by date. >> >>My most cited paper is "On user studies and information needs" (1981) - a >>Web search (using Google) revealed 118 pages that listed the title. The >>pages were reading lists, free electronic journals, and documents that >> > would > >>never be covered by SSCI, such as reports from various agencies. SSCI >>revealed, if I recall aright, 79 citations of the paper. The question is: >> > is > >>the Web revealing impact more effectively than SSCI? Citation in >> > scholarly > >>papers takes a variety of forms and much citation is of a token variety - >> > x > >>is cited because x is always cited. On the other hand citation on reading >>lists implies some positive recommendation of the text, and mention in >>policy documents and the like, implies (at least in some cases) that some >>benefit has been found in the cited document. >> >>It may also be that the use of Web citation would provide a more complete >>measure - I discovered, much to my surprise, that a 1971 text of mine on >>'chain indexing' is cited on one reading list and in the bibliography of a >>document in German on classification. Greater international coverage is a >>further benefit of using Web citation. >> >>It strikes me that a move towards using Web citation as the measure of >>performance would be rather more useful than the use of citation indexes. >> >>No doubt others have looked at this issue - is any consensus emerging? >> >>Tom Wilson >> >>----------------------------------- >>Professor T.D. Wilson, PhD >>Publisher/Editor in Chief >>Information Research >>University of Sheffield >>Sheffield S10 2TN >>United Kingdom >>Tel: +44-114-222-2642 >>E-mail: t.d.wilson at shef.ac.uk >>Web site: http://InformationR.net/ >>----------------------------------- >> >> >> > > > -- > -------------------------------------------------------- > Isidro F. Aguillo isidro at cindoc.csic.es > Laboratorio de Internet. CINDOC-CSIC > Joaquin Costa, 22 Ph. +34-91-5635482 ext. 313 > 28002 Madrid Mb. +34-630-858997 > ESPA?A-SPAIN > Fx. +34-91-5642644 > Editor Cybermetrics www.cindoc.csic.es/cybermetrics > -------------------------------------------------------- > > -- -------------------------------------------------------- Isidro F. Aguillo isidro at cindoc.csic.es Laboratorio de Internet. CINDOC-CSIC Joaquin Costa, 22 Ph. +34-91-5635482 ext. 313 28002 Madrid Mb. +34-630-858997 ESPA?A-SPAIN Fx. +34-91-5642644 Editor Cybermetrics www.cindoc.csic.es/cybermetrics -------------------------------------------------------- From jni at DB.DK Tue Jul 16 09:21:55 2002 From: jni at DB.DK (Nicolaisen Jeppe) Date: Tue, 16 Jul 2002 15:21:55 +0200 Subject: The J-shaped distribution of citedness Message-ID: Dear members of SIGMETRICS, My recent article ("The J-shaped distribution of citedness", Journal of Documentation, Vol. 58 No. 4, pp. 383-395) provides a new technique for investigating the correlation between research quality and citation counts. This technique is applied to a case study of the relationship between peer evaluations reflected in scholarly book reviews and the citation frequencies of reviewed books. Results of my study designate a J-shaped distribution between the considered variables, presumably caused by a skewed allocation of negative citations. This finding contradicts the common assumption of a linear relationship between research quality and citation frequency. The case study is, however, restricted to a sample of sociological monographs, which restricts the generalizability of the results. I therefore strongly encourage others to test the generalizability of my results in other areas. Perhaps we are dealing with a (new) bibliometric law!? The article is available as a pdf-file at my homepage: http://www.db.dk/jni/#publications _ ________________________________________ Jeppe Nicolaisen, PhD Candidate Department of Information Studies Royal School of Library & Information Science Birketinget 6, DK-2300 Copenhagen S., Denmark Tel. +45 32 58 60 66, Fax. +45 32 84 02 01 E-mail: jni at db.dk Homepage: http://www.db.dk/jni ________________________________________ _ From garfield at CODEX.CIS.UPENN.EDU Wed Jul 17 15:07:26 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Wed, 17 Jul 2002 15:07:26 -0400 Subject: Library Trends: Current Theory in Library and Information Science [50(3):309-574 Winter 2002] Message-ID: The Winter 2002 issue of Library Trends [50(3):309-574 Winter 2002] has a sub-title ... "Current Theory in Library and Information Science". This issue is well worth scanning. The editor is William E. McGrath. The Introduction, Contents Page and Abstracts are available at : http://alexia.lis.uiuc.edu/puboff/catalog/trends/50_3.html _______________________________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org _______________________________________________________________________ From lismcgr at MA.ULTRANET.COM Fri Jul 19 11:41:28 2002 From: lismcgr at MA.ULTRANET.COM (Bill McGrath) Date: Fri, 19 Jul 2002 11:41:28 -0400 Subject: Bill McGrath's email address Message-ID: Hi Every one and Every all, My email address has changed. It is now lismcgr at rcn.com. If your messages bounce back on you, use my old address for awhile. Messages will be forwarded to my new address for about thirty days from now. Bill -- Bill McGrath P.O.Box 534 Westford, MA 01886 voice: 978 692-3174 FAX: 978 589-0975 From garfield at CODEX.CIS.UPENN.EDU Fri Jul 19 15:14:32 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Fri, 19 Jul 2002 15:14:32 -0400 Subject: M. Thelwall "Conceptualizing documentation on the different heuristic based models for a university website" Message-ID: E-mail: Mike Thelwall : M.Thelwell at wlv.ac.uk Preprint of article available at : http://www.scit.wlv.ac.uk/~cm1993/papers/2002_Conceptualising_documentation_ on_the_Web.pdf Title: Conceptualizing documentation on the different heuristic based models for a university website Author: M. Thelwall Address: School of Computing and Information Technology, Wolverhampton, U.K. Source: To be published in JASIS&T in 2002 or 2003 When responding, please attach my original message _______________________________________________________________________ Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu home page: www.eugenegarfield.org Tel: 215-243-2205 Fax 215-387-1266 President, The Scientist LLC. www.the-scientist.com Chairman Emeritus, ISI www.isinet.com Past President, American Society for Information Science and Technology (ASIS&T) www.asis.org _______________________________________________________________________ From Sybille.Hinze at ISI.FHG.DE Tue Jul 23 07:13:42 2002 From: Sybille.Hinze at ISI.FHG.DE (Hinze, Sybille) Date: Tue, 23 Jul 2002 13:13:42 +0200 Subject: 7th International S&T Indicators Conference, 25-28 September 2002 , Karlsruhe, Germany Message-ID: Dear colleagues, the program for the 7th International Science&Technology Indicators Conference, which will be held from 25-28 September 2002 in Karlsruhe, Germany, is now available . It can be found on the conference homepage: www.indicators-conference.isi.fhg.de Here you will also find the information how to register for the conference. Dr Sybille Hinze For the organizing committee email: indicators-conference at isi.fhg.de From garfield at CODEX.CIS.UPENN.EDU Tue Jul 23 10:22:09 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Tue, 23 Jul 2002 10:22:09 -0400 Subject: Pechenik JA, Reed JM, Russ M "Should auld acquaintance be forgot: Possible influence of computer databases on citation patterns in the biological " BIOSCIENCE 51 (7): 583-588 JUL 2001 Message-ID: Jan Pechenik : jan.pechenik at tufts.edu FULL TEXT ARTICLE AVAILABLE AT : http: //ase.tufts.edu/biology/faculty/bios/pechenik_docs/July_2001_should_aud.pdf TITLE Should auld acquaintance be forgot: Possible influence of computer databases on citation patterns in the biological literature AUTHOR Pechenik JA, Reed JM, Russ M JOURNAL BIOSCIENCE 51 (7): 583-588 JUL 2001 Document type: Editorial Material Language: English Cited References: 10 Times Cited: 0 Addresses: Pechenik JA, Tufts Univ, Writing Across Curriculum Program, Medford, MA 02155 USA Tufts Univ, Writing Across Curriculum Program, Medford, MA 02155 USA Publisher: AMER INST BIOLOGICAL SCI, WASHINGTON IDS Number: 460TH ISSN: 0006-3568 From bracke at EMAIL.ARIZONA.EDU Tue Jul 23 15:10:43 2002 From: bracke at EMAIL.ARIZONA.EDU (Paul Bracke) Date: Tue, 23 Jul 2002 12:10:43 -0700 Subject: [bibliometrics literature coverage of literature and the web In-Reply-To: <3D2D7BFA.6080607@cindoc.csic.es> Message-ID: We are setting up DLIST (http://dlist.sir.arizona.edu), Digital Library of Information Science & Technology, initially an interdisciplinary LIS-focused repository of both published and unpublished materials. To do this, we are extending the traditional eprints definition and including almost all the formats Bernie Sloan started this thread off with. I write to SIGMETRICS and ISSI now, because a priority collection development area is Informetrics and formats include both published and unpublished papers + datasets. To respond to Eugene, yes, scholars must share...but, academic scholars rarely have time to 'report' and I suspect that the *interdisciplinary* nature of our research also makes any reporting difficult. Another part of the problem with standard databases is that they do not publish the datasets (I did see one social science journal announce the other day that have started doing this) that underlie the research reported. Whether we like it or not personal collections are the future; so many information-seeking behaviors studies have shown this that we shouldn't be surprised! Anyway, we hope that DLIST (as it grows) will provide such many personal collection tools too. ISSI and SIGMETRICS folks are encouraged to register as users on DLIST and deposit their published/unpublished papers and datasets. This model of central deposits and decentralized management is also (in our view) another feature of the information landscape. As part of DLIST, we offered to harvest or mirror Cybermetrics and sent Isidro full details of DLIST in April. We hope that Isidro and the rest of the community will respond to this initiative enthusiastically. Best wishes, Paul -- Paul J. Bracke Project Manager, DLIST(http://dlist.sir.arizona.edu) Head of Systems and Networking Arizona Health Sciences Library 1501 N. Campbell Ave. P.O. Box 245079 Tucson, AZ 85724-5079 Phone: 520-626-1004 Fax: 520-626-2922 Email: paul at ahsl.arizona.edu -----Original Message----- From: ASIS Special Interest Group on Metrics [mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Isidro F. Aguillo Sent: Thursday, July 11, 2002 5:37 AM To: SIGMETRICS at LISTSERV.UTK.EDU Subject: Re: [SIGMETRICS] [bibliometrics literature coverage of literature and the web Dear all: I agree with Eugene about making public his message because part of my answer is closely linked with the interesting debate about web citations. The request to use SIGMET messages was done for the future ISSI website in order to offer a "good" coverage of the recent literature and some summaries about debates and other topics covered by SIGMET. The aim was to reserve cybermetric/webometric references for the Cybermetrics ejournal directory and use new ISSI website to cover "SI" citations. From my previous Cybermetrics experience it can be very useful to have this kind of information "repositories" in the Web, consisting not only of paper citations but considering other resources too: Directories of personal pages, lists of unpublished presentations, links to databases and software providers, access to databases or other raw data. The compilation task can be really hard, but extending Eugene's invitation, all of us can benefit if the lists are used to distribute data about papers, web resources or new software. Then this information will be uploaded to the websites for universal availability. As I previously stated this effort is not going to increase our IF but clearly the visibility will be greater. Garfield, Eugene wrote: > Isidro's recent email message to SIGMETRICS reminded me that I have not > heard from anyone at ISSI concerning the further use and expansion of the > SIGMETRICS archive. I think someone had asked whether the SIGMET > information could be used by ISSI. To make things quite clear I would be > delighted for any of my postings to SIGMET to be sent to the ISSI listserv. > But perhaps it is important to ask how much overlap there is in the two > lists. > > I have not seen few contributions of the kind that I have been posting. If > there are significant items outside the literature covered by ISI, as e.g. > postings to web sites, why haven't SIGMET members or ISSI members been > posting them to SIGMET? > > SIGMET is open and free to everyone. So if as Sloane and others have been > suggesting, there is a significant amount of relevant information that is > not revealed from the ISI databases, then why hasn't it been reported, at > least for the field of bibliometrics,etc. in SIGMET? > > When I first began this note to Isidro I did not think it relevant for the > entire SIGMET readership but I see now that is clearly is a matter that all > members of SIGMET and ISSI should take to heart. If we are to provide truly > comprehensive coverage of the field then it is the duty of all members to > create suitable postings for all to share. Best wishes. Eugene Garfield > > > When responding, please attach my original message > __________________________________________________ > Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu > home page: www.eugenegarfield.org > Tel: 215-243-2205 Fax 215-387-1266 > President, The Scientist LLC. www.the-scientist.com > Chairman Emeritus, ISI www.isinet.com > Past President, American Society for Information Science and Technology > (ASIS&T) www.asis.org > > > > > > > -----Original Message----- > From: Isidro F. Aguillo [mailto:isidro at CINDOC.CSIC.ES] > Sent: Wednesday, July 10, 2002 7:46 AM > To: SIGMETRICS at LISTSERV.UTK.EDU > Subject: [SIGMETRICS] Web citation issues > > > Dear all: > > I arrive a bit late to this debate, but I think an important point is > missing in several of the messages. Most of them focus on the > comparision between links and citations and the reasons to cite and the > objects to be cited. Certainly both wordls are different and printed > literature and bibliographic references are superior for bibliometric > analysis. > > But our traditional approach has several shortcommings as several > authours have already pointed. From the evaluation and policy purposes > point of view, one of the most important is that there are no enough > readily available information for a real sciencetechnoeconometrics. The > interlinked nature of the Web offer the possibility to discover hidden > relationships among different websites, including not only the bonds > that binds academic communities but those showing economic, industrial, > social or cultural relationships. And this is not easy with traditional > quantitative methods. > > Going to the personal aspects, the presence on the Web of research > groups, professors or postgraduate students reflects a wider range of > activities than formal publication in refereed journals, such as > unpublished material, general public contributions, drafts for future > papers or book chapters, slides used in conference or seminar > presentations, support material for courses or even raw data. The > picture you can obtain from a researcher is therefore more complete. > > Finally, as tax-payer citizen supporting public research activities I > request better access to the results obtained by scientists and in this > sense the Web reaches a wider audience than the paper based publications > like journals or books. In fact almost all the information published on > the Web can be recover by any Internet user worldwide. > > Comments ... > > Sloan, Bernie wrote: > > >>Peter, >> >>For the past two years or so I have been dabbling in the collection of >>citations and inlinks to several papers of mine. I use your definition of >>"inlinks": "links pointing to web pages" (Bjorneborn & Ingwersen). I've >> > been > >>using both publicly available Web search engines (Google and AllTheWeb), >> > as > >>well as some commercial subscription-only databases from providers (e.g., >>ISI, the Gale Group, and EBSCO). I tried to be somewhat selective and did >>some brief analysis of the items I retrieved, e.g., I did not count >> > inlinks > >>from personal bookmark lists, or references to the papers from discussion >>group archives. >> >>I don't pretend that my papers are scientific papers, or that the >> > citations > >>and inlinks I have discovered are for "scientific items citing other >>scientific items." I did my best to eliminate any marginal entries, >> > although > >>"marginal" is definitely in the eye of the beholder here. I like to think >> > of > >>what I am doing as using the Web to discover the "influence of ideas". The >>exercise started with the Web of Science, and then broadened out to >> > include > >>the resources mentioned in the preceding paragraph. I don't think of the >>exercise as something that replaces ISI databases such as SCI, SSI, etc., >>but rather something that supplements the information obtained from ISI. >> >>One of the most interesting findings is that this exercise uncovered an >>international influence that I would not have been aware of using only the >>ISI databases. More than 40% of the citations/inlinks were from non-US >>sources. Of the citations/inlinks from non-US sources, fully 60% were >>associated with countries with a primary language other than English. >> >>Right now I am working on putting together a paper reporting on my >> > findings, > >>discoveries and questions in more detail, sort of a report on a >>work-in-progress. The biggest question I am grappling with is "So what?" I >>have a detailed listing of citations/inlinks for several of my papers. >>Beyond satisfying personal and academic curiosity, what can these >> > "personal > >>citation indices" be used for? Using them for evaluation springs to mind, >>but of course "evaluation" requires comparison against some standard or >>control group. I'm not aware of too many people who have conducted this >>exercise at a personal level. I have something that seems impressive to >> > me, > >>in a relative sense (i.e., a more comprehensive overview of the influence >> > of > >>ideas than I might obtain from a citation index like SSI). But what can I >>use it for? >> >>Bernie Sloan >> >>-----Original Message----- >>From: Ingwersen Peter [mailto:PI at DB.DK] >>Sent: Tuesday, July 09, 2002 9:52 AM >>To: SIGMETRICS at LISTSERV.UTK.EDU >>Subject: [SIGMETRICS] SV: [SIGMETRICS] Web citation issues >> >>Dear colleagues, as you may be well aware of our department was one of the >>first to engage into webometric analyses, in particular of web impact by >>means of inlinks. Several others around have done deep analyses of >>webometric nature to see if, for instance, there exists a correlation >>between citation impact and web impact/no. of inlinks (Bar Ilan) or >> > between > >>other indicators of recognition (e.g. RAE in the UK) and web impact >>(Thelwall). Sometimes there exist such correlations, but the major problem >>is that the web acts differently than scientific communication vehicles >> > (no > >>real conventions of linking etc.). Also: one may not equalize a web page >>with a scientific article. So Tom Wilson?s no. of hits (to web pages) does >>not necessarily correspond at all to "scientific items citing other >>scientific items" as in conventional citation analyses. Only the reading >>lists found by Wilson may act like such "reference lists". Further: >>Different search engines commonly perform differently on the same search >>profile, resulting in biased counts; several large quality studies have >> > been > >>done on "scientific" web page search results to observe the actual >>proportion of scientific output (see e.g. Allen et al in Science in 1999.) >>Results are appalling and pauvre - and highly dependent on the domain in >>question. For instance, in politically hot scientific topics (like in the >>environmental sc.-) there is a chaotic mix of scientific, semi-scientific, >>pseudo, popular and, foremost, political opinion papers. Should all the >>"published" pages count or only the peer reviewed ones - e.g. those >>published by scientific institutions or referring to peer reviewed >> > journals > >>or published in peer reviewed e-journals? >>Additionally, there are several possible web impacts: by inlink counts; by >>inlink counts and outlink counts; by web-based traditional >>references/citations on all the open web - or only in e-journals - with or >>without peer review. >>Tom will of course also run into the problem similar to that of ISI: in >> > the > >>citation databases no citations from books and non-ISI journals are >> > counted; > >>on the web only the open weblinks (and citations/references) are possible >> > to > >>count - not links/citations provided by pages/items on the hidden web >> > (e.g. > >>all the Dialog or ISI databases or the journals in publisher archives or >> > in > >>Digital Libraries. >>Finally, on the web the nature of obsolescence of information is quite >>different and not yet well understood - see e.g. Ronald Rousseau?s >> > articles > >>in Cybermetrics or recent publications by Wolfgang Glanzel on the issue. >>A recent review on some of the issues touched upon above is: Bjorneborn, >> > L. > >>& Ingwersen, P.: Perspectives of webometrics. Scientometrics, 50(1): >> > 65-82. > >>Many regards - Peter Ingwersen >>******************************************** >>Peter Ingwersen, Professor, Ph.D. >>Department of Information Studies >>Royal School of Library and Information Science, >>Birketinget 6, DK 2300 Copenhagen S - Denmark >>Tel: +45 32 58 60 66; FAX: +45 32 84 02 01 >>http://www.db.dk/pi/ - e-mail: pi at db.dk >>Visiting Professor (Docent), Dept. of Information Studies >>?bo University Akademi - Finland >>******************************************** >> >> >>-----Oprindelig meddelelse----- >>Fra: Quentin L. Burrell [mailto:quentinburrell at MANX.NET] >>Sendt: 21. juni 2002 18:11 >>Til: SIGMETRICS at LISTSERV.UTK.EDU >>Emne: Re: [SIGMETRICS] Web citation (fwd) >> >> >>I am wholly in support of the SIGMETRICS site being one for discussion and >>so was interested in Tom's original submission and now Gene's response. >> > Here > >>comes my two penn'orth (Eng., coll., obs.?) >> >>Tom's observations are interesting - to his comment on token citations I >>would add (many cases of) self-citation - but I go along with Gene's >>uneasiness on the current haphazard coverage of the web being adequate to >>replace formal citation bases. >> >>Gene's final remark that the "ultimate objective of universal >>bibliographical control is to find it all in one place, displayed in a >>fashion that is easily and quickly comprehended" surely requires some >>response. >> >>(i)I guess that "control" was a hasty first attempt and that "information" >>is more in line with the intended meaning. >> >>(ii) I would really like to see the phrase "freely available" inserted >>somewhere in the remark. At the moment, unless you are the member of a >>subscribing institution you don't have free access to this bibliographic >>information, either to "boost your ego" or to measure your impact.Citation >>analysis - like any othe form of data analysis - requires access to the >>data. >> >>Anyone else willing to chip in a cent or a yen or a euro or a ... ? >> >>Quentin Burrell >> >> >>-----Original Message----- >>From: ASIS Special Interest Group on Metrics >>[mailto:SIGMETRICS at LISTSERV.UTK.EDU]On Behalf Of Garfield, Eugene >>Sent: 19 June 2002 18:27 >>To: SIGMETRICS at LISTSERV.UTK.EDU >>Subject: Re: [SIGMETRICS] Web citation (fwd) >> >> >>It is almost six weeks since Tom Wilson posted this message. Many others >>forwarded copies to me expecting me to respond to his challenge. >> >>It is always pleasant to learn that one's work has been mentioned on a >>particular web site or that it is discussed in various courses. But while >>they are newsworthy they havoc little real bearing on the use of citation >>indexes to measure the impact of one's research. >> >>When you are quite young anything helps boost the ego, but the bottom line >>for the researcher is whether anyone has used his or her basic ideas in >>ongoing research. Until that day of Nirvana arrives when everything will >> > be > >>searchable on the web I am afraid web searching just won't be an adequate >>substitute. >> >>If you are working in the life sciences you can find many relevant >> > citation > >>connections through such full text resources as HighWire Press, but that >> > is > >>not yet complete nor is it presented in a form that is easily used for >>citation analysis. That day may come. Steve Lawrence's project at NEC >> > which > >>provides citation indexing in context for the computer science literature >>illustrate what happens when you have only partial coverage. >> >>The ultimate objective of universal bibliographical control is to find it >>all in one place, displayed in a fashion that is easily and quickly >>comprehended. Gene Garfield >> >>When responding, please attach my original message >>__________________________________________________ >>Eugene Garfield, PhD. email: garfield at codex.cis.upenn.edu >>home page: www.eugenegarfield.org >>Tel: 215-243-2205 Fax 215-387-1266 >>President, The Scientist LLC. www.the-scientist.com >>Chairman Emeritus, ISI www.isinet.com >>Past President, American Society for Information Science and Technology >>(ASIS&T) www.asis.org >> >> >> >> >> >> >>-----Original Message----- >>From: Gretchen Whitney [mailto:gwhitney at UTK.EDU] >>Sent: Monday, May 06, 2002 10:10 AM >>To: SIGMETRICS at LISTSERV.UTK.EDU >>Subject: [SIGMETRICS] Web citation (fwd) >> >> >>---------- Forwarded message ---------- >>Date: Mon, 06 May 2002 12:25:22 +0100 >>From: Prof. Tom Wilson >>To: JESSE at LISTSERV.UTK.EDU >>Subject: Web citation >> >>There have been a few mentions of Web citation searching possibly >> > replacing > >>citation indexing in time and I wondered how many people are now, as a >>matter of course, using counts of Web mentions in their cases for >>appointment, tenure or promotion. >> >>I looked at a couple of my own papers and counted the SSCI citations and >>then searched for mentions of the papers on the Web - the results left me >>wondering whether the reliance on citation indexing as a measure of >>performance is now past its sell by date. >> >>My most cited paper is "On user studies and information needs" (1981) - a >>Web search (using Google) revealed 118 pages that listed the title. The >>pages were reading lists, free electronic journals, and documents that >> > would > >>never be covered by SSCI, such as reports from various agencies. SSCI >>revealed, if I recall aright, 79 citations of the paper. The question is: >> > is > >>the Web revealing impact more effectively than SSCI? Citation in >> > scholarly > >>papers takes a variety of forms and much citation is of a token variety - >> > x > >>is cited because x is always cited. On the other hand citation on reading >>lists implies some positive recommendation of the text, and mention in >>policy documents and the like, implies (at least in some cases) that some >>benefit has been found in the cited document. >> >>It may also be that the use of Web citation would provide a more complete >>measure - I discovered, much to my surprise, that a 1971 text of mine on >>'chain indexing' is cited on one reading list and in the bibliography of a >>document in German on classification. Greater international coverage is a >>further benefit of using Web citation. >> >>It strikes me that a move towards using Web citation as the measure of >>performance would be rather more useful than the use of citation indexes. >> >>No doubt others have looked at this issue - is any consensus emerging? >> >>Tom Wilson >> >>----------------------------------- >>Professor T.D. Wilson, PhD >>Publisher/Editor in Chief >>Information Research >>University of Sheffield >>Sheffield S10 2TN >>United Kingdom >>Tel: +44-114-222-2642 >>E-mail: t.d.wilson at shef.ac.uk >>Web site: http://InformationR.net/ >>----------------------------------- >> >> >> > > > -- > -------------------------------------------------------- > Isidro F. Aguillo isidro at cindoc.csic.es > Laboratorio de Internet. CINDOC-CSIC > Joaquin Costa, 22 Ph. +34-91-5635482 ext. 313 > 28002 Madrid Mb. +34-630-858997 > ESPA?A-SPAIN > Fx. +34-91-5642644 > Editor Cybermetrics www.cindoc.csic.es/cybermetrics > -------------------------------------------------------- > > -- -------------------------------------------------------- Isidro F. Aguillo isidro at cindoc.csic.es Laboratorio de Internet. CINDOC-CSIC Joaquin Costa, 22 Ph. +34-91-5635482 ext. 313 28002 Madrid Mb. +34-630-858997 ESPA?A-SPAIN Fx. +34-91-5642644 Editor Cybermetrics www.cindoc.csic.es/cybermetrics -------------------------------------------------------- From willieezi at YAHOO.COM Wed Jul 24 05:09:23 2002 From: willieezi at YAHOO.COM (Williams Nwagwu) Date: Wed, 24 Jul 2002 02:09:23 -0700 Subject: Fullbright Program on AIDS Message-ID: Dear Colleaugues, I wish to collaborate with any informetrist with America citizenship to carry out a study sponnsored by Fullbright Programme on AIDS in Africa. The condition for particpating in the program is that the investigator should be an American citizen who should collaborate with an African institution and scientist. I already have a proposal that could meet the Fullbright requirement. The deadline for the proposal submission is on the 31st of July 2002. Willie __________________________________________________ Do You Yahoo!? Yahoo! Health - Feel better, live better http://health.yahoo.com From garfield at CODEX.CIS.UPENN.EDU Wed Jul 31 10:24:55 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Wed, 31 Jul 2002 10:24:55 -0400 Subject: Uzun A. Library and information science research in developing countries and Eastern European countries: A brief bibliometric perspective. International Information & Library Review 34(1):21-33 March 2002 Message-ID: E-mail: Ali Uzun : azun at mctu.edu.tr Full Text Article at http://www.idealibrary.com/links/doi/10.1006/iilr.2002.0182/pdf Title Library and information science research in developing countries and Eastern European countries: A brief bibliometric perspective Author Uzun A Journal INTERNATIONAL INFORMATION & LIBRARY REVIEW 34 (1): 21-33 MAR 2002 Document type: Article Language: English Cited References: 20 Times Cited: 0 Abstract: We examined a set of 21 core journals in the field of library and information science (LIS) from 1980-1999 for articles with either principal or co-authors from developing countries (DCs) and the formerly, socialist Eastern European countries (EECs). We found that only 826 (7.9%) of a total of 10400 articles published in 21 journals are from DCs or EECs, The numbers of articles with authors Front China, Saudi Arabia, Turkey, Botswana, Ghana, Kuwait, and Taiwan considerably increased and those of India, Nigeria, Pakistan, Brazil, and Poland decreased. Using a bibliometric indicator we found that among the countries with declining trends in the numbers of articles, LIS research is receiving high priority in Nigeria and Pakistan whereas among the countries with increasing trends in articles, it is receiving low priority in China, Turkey and Taiwan. A 'co-word' analysis based on the key words and thematic noun- phrases in the titles and abstracts of a sample of 102 articles published in 1996 to 1999 indicated that bibliometrics is the most frequent topic in LIS research in major DCs and EECs. Information retrieval, information need and information use is among the topics of relatively high interest for the researchers working in DCs in Asia and Africa. (C) 2002 Published by Elsevier Science Ltd. KeyWords Plus: PHYSICS PUBLICATIONS, SOCIAL-SCIENCES, LATIN-AMERICA, COLLABORATION, ASTRONOMERS Addresses: Uzun A, Middle E Tech Univ, Dept Phys, TR-06531 Ankara, Turkey Middle E Tech Univ, Dept Phys, TR-06531 Ankara, Turkey Publisher: ACADEMIC PRESS LTD ELSEVIER SCIENCE LTD, LONDON IDS Number: 564VQ ISSN: 1057-2317 Cited Author Cited Work Volume Page Year BARRE R SCI TECHNOLOGY STUDI 5 32 1987 DHRUV R SCIENTOMETRICS 33 295 1995 FRAME JD INTERSCIENCIA 2 143 1977 GLANZEL W SCIENTOMETRICS 35 291 1996 GONG YT J INFORM SCI 22 462 1996 GUPTA BM SCIENTOMETRICS 18 341 1990 HILDRUN K SCIENTOMETRICS 43 455 1998 LOMINITZ L SOC STUD SCI 17 115 1987 MAJID S LIBR INFORM SCI RES 22 145 2000 MENG GJ LIBRI 46 52 1996 NARVAEZBERTHELE.N SCIENTOMETRICS 34 37 1995 PAO ML INFORM PROCESS MANAG 28 99 1992 PRUTHI S J SCI IND RES INDIA 53 840 1993 SCHUBERT A CZECH J PHYS 36 126 1986 UZUN A INT INF LIBR REV 30 169 1998 UZUN A REG WORLD REN EN C 1 385 2001 UZUN A SCIENTOMETRICS 37 159 1996 UZUN A SCIENTOMETRICS 36 259 1996 UZUN A SCIENTOMETRICS 28 79 1993 WHITE JC PUBL ASTRON SOC PAC 104 472 1992 From garfield at CODEX.CIS.UPENN.EDU Wed Jul 31 10:46:58 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Wed, 31 Jul 2002 10:46:58 -0400 Subject: Testa, P. Indicators of scientific production and research evaluation of higher education institutions in Venezuela Message-ID: E-mail : Pablo Testa : testap at camelot.rect.ucv.ve Full text at : http://netlab.lmcc.fju.edu.tw/3rd/FS/fs0205.htm TITLE: Indicators of scientific production and research evaluation of higher education institutions in Venezuela (Article, English) AUTHOR: Testa, P SOURCE: WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL 8, PROCEEDINGS. 1999. p.428-435 INT INST INFORMATICS & SYSTEMICS, ORLANDO SEARCH TERM(S): BIBLIOMETR* keyword KEYWORDS: scientific production; research evaluation; higher education; bibliometrics; S&T indicators; Venezuela ABSTRACT: The purpose of this work is to analyze conditions, possibilities and limitations that bibliometric methods offer for the analysis and evaluation of scientific research in Venezuela, particularly in the higher education institutions. The paper has three sections besides the introduction and conclusions. Their objectives are: to describe the international tendencies for evaluation of the universities, especially about their research activities, and the possible impact of these tendencies over higher education in Venezuela; to point some methodological problems of research evaluation when bibliometric methods are used, specifically the construction of indicators starting from the existing databases with their problems and biases: the dilemma of the relevancy in face of the availability of the information; to describe the current conditions for the production of science and technology indicators and their role in science policy; The more general results are: the use of bibliometric methods to evaluate the research activities is based, actually, in international databases that are completely detached of priorities that should be defined nationally. Therefore, it is imperious the construction of our own databases that respond to these priorities; the development of autonomous databases on scientific production will only be possible through the support of groups and institutions that work in the generation, analysis, diffusion and use of indicators of scientific production, as well as the elaboration of policy proposals and actions, in synthesis it is the constitution of this groups and institutions as social actors. AUTHOR ADDRESS: P Testa, UCV, CENDES, Caracas, Venezuela From garfield at CODEX.CIS.UPENN.EDU Wed Jul 31 11:10:20 2002 From: garfield at CODEX.CIS.UPENN.EDU (Eugene Garfield) Date: Wed, 31 Jul 2002 11:10:20 -0400 Subject: Rudy JT. Toward an assessment of 'Verbal Art as Performance, a Cross-Disciplinary Citation Study with Rhetorical Analysis'(Folklore studies)JOURNAL OF AMERICAN FOLKLORE 115 (455): 5-27 WIN 2002 Message-ID: Jill Terry Rudy : e-mail: jill_rudy at byu.edu Full text available at : http: //muse.jhu.edu/journals/journal_of_american_folklore/v115/115.455rudy.pdf Title Toward an assessment of 'Verbal Art as Performance, a Cross-Disciplinary Citation Study with Rhetorical Analysis' (Folklore studies) Author Rudy JT Journal JOURNAL OF AMERICAN FOLKLORE 115 (455): 5-27 WIN 2002 Document type: Article Language: English Cited References: 71 Times Cited: 0 Abstract: At the 20th anniversary of its publication in book form, Verbal Art as Performance merits reconsideration for its contribution to folklore studies and other scholarly fields. While many contemporary folklorists may clearly remember the intellectual and social milieu surrounding the production and reception of Verbal Art, the passage of time since then invites an examination of the diffusion of the text across scholarly disciplines and allows for the book to be assessed in terms of its impact on folklore studies. This article includes a citation study of journal references to the text and a rhetorical analysis of references in articles published by folklore journals. This study indicates that Verbal Art has played a central role in synthesizing earlier research on performance-centered theories in folklore; the book continues to disseminate these ideas to scholars in a variety of academic fields. The aspects of Verbal Art that threaten to undermine its connections with the field of folklore studies, including the widespread interest in performance concepts and the intentional reach to an nterdisciplinary audience, can also serve to invigorate the field and promote its interests to a significant number of scholars in other areas. KeyWords Plus: VERBAL-ART, PERFORMANCE, LITERACY, ETHNOGRAPHY, BOOKS, NAME Addresses: Rudy JT, Brigham Young Univ, Provo, UT 84602 USA Brigham Young Univ, Provo, UT 84602 USA Publisher: AMER FOLKLORE SOC, ARLINGTON IDS Number: 526DG ISSN: 0021-8715 Cited Author Cited Work Volume Page Year ABRAHAMS RD FRONTIERS FOLKLORE 79 1977 ABRAHAMS RD J AM FOLKLORE 81 143 1968 BABCOCK BA VERBAL ART PERFORMAN 61 1977 BASCOM W FRONTIERS FOLKLORE 1977 BAUMAN R AM ANTHROPOL 77 290 1975 BAUMAN R COMMUNICATIONS 1997 BAUMAN R NEW PERSPECTIVES FOL 1972 BENAMOS D NEW PERSPECTIVES FOL 1 1972 BENAMOS D W FOLKLORE 38 47 1979 BOWMAN MS COMMUN EDUC 41 287 1992 BRENNEIS D ASIAN FOLKLORE STUD 42 63 1983 BRIGGS CL J AM FOLKLORE 98 287 1985 BRINK JT J AM FOLKLORE 59 415 1982 BRONNER SJ FOLKLORE 95 57 1984 CADAVAL O J FOLKLORE RES 22 179 1985 CAMPANARIO JM SCI COMMUN 16 304 1995 CLEMENS ES AM J SOCIOL 101 433 1995 CRUMRINE NR FOLKLORE AM 41 5 1986 DEGH L AM FOLKLORE MASS MED 1994 DYSON AH WRIT COMMUN 9 3 1992 EDWARDS CL J AM FOLKLORE 96 151 1983 EVANS JD J FOLKLORE RES 22 85 1985 FARR M DISCOURSE PROCESS 19 7 1995 FARR M WRIT COMMUN 10 4 1993 FUOSS KW COMMUN EDUC 41 77 1992 GEORGES RA J AM FOLKLORE 82 313 1969 GEORGES RA J FOLKLORE RES 23 87 1986 GEORGES RA WESTERN FOLKLORE 45 1 1986 GOFFMAN E FRAME ANAL ESSAY ORG 1974 HANKS WF J AM FOLKLORE 97 131 1982 HERZFELD M SEMIOTICA 46 99 1983 HIRSCH E J FOLKLIRE INST 18 1 1981 HYMES D FOLKLORE PERFORMANCE 11 1975 HYMES D J AM FOLKLORE 88 345 1975 HYMES DH J AM FOLKLORE 84 42 1971 HYMES DH READINGS SOCIOLOGY L 99 1968 JONES S W FOLKLORE 38 42 1979 JOYNER C J AM FOLKLORE 88 254 1957 KAPFERER B SOCIAL ANAL 1 108 1979 KAUFER DS COMMUNICATION DISTAN 1993 KIRSHENBLATTGIM.B EXPLORATIONS ETHNOGR 283 1972 KONGASMARANDA E J AM FOLKLORE 89 127 1976 KRASNIEWICZ L NY FOLKLORE 12 51 1986 KROLLSMITH JS J SCI STUD RELIG 19 16 1980 LAIRD J SMITH COLL STUD SOC 64 263 1994 LAWLESS E J AM FOLKLORE 96 434 1983 LAWLESS E W FOLKLORE 44 77 1985 LEARY JP J FOLKLORE RES 21 29 1964 LEITH D LANG SOC 24 53 1995 LIMON JE J AM FOLKLORE 96 34 1983 LIMON JE J FOLKLORE I 19 141 1982 MCCARL RS J AM FOLKLORE 97 405 1984 MCDOWELL JH J FOLKLORE RES 19 119 1982 MECHLING J W FOLKLORE 44 301 1985 MILLER EK SO FOLKLORE Q 40 31 1976 NUSBAUM P NY FOLKLORE 12 69 1986 PAREDES A NEW PERSPECTIVES FOL 1972 PAUL D THESIS 1996 PELIAS RJ Q J SPEECH 37 219 1987 PEPICELLO WJ W FOLKLORE 39 1 1980 POLANYI L TELLING AM STORY STR 1985 PROSCHAN F SEMIOTICA 47 3 1983 RICE RE J BROADCAST ELECTRON 40 511 1996 RUDY JT COMMUNICATION 1031 1997 SAWIN P COMMUNICATION 1031 1997 STERN S W FOLKLORE 36 7 1977 TOELKEN B W FOLKLORE 45 128 1986 TUAMSSERNA J LAT AM MUSIC REV 13 139 1992 TURNER K SEMIOTICA 47 317 1983 WOLF SA READ TEACH 46 540 1993 YANKAH K J FOLKLORE RES 22 133 1985