Cohen, AM; Hersh, WR; Peterson, K; Yen, PY "Reducing workload in systematic review preparation using automated citation classification" Journal of the American Medical Informatics Association 13(2): 206-219, March-April 2006.
garfield at CODEX.CIS.UPENN.EDU
Fri Mar 31 13:32:21 EST 2006
Aaron Michael Cohen: E-mail: cohenaa at ohsu.edu
William R. Hersh : E-mail: hersh at ohsu.edu
FULL TEXT AVAILABLE AT : http://medir.ohsu.edu/~hersh/jamia-06-sysrev.pdf
TITLE: Reducing workload in systematic review preparation using
automated citation classification (Review, English)
AUTHOR: Cohen, AM; Hersh, WR; Peterson, K; Yen, PY
SOURCE: JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION
13 (2). MAR-APR 2006. p.206-219 ELSEVIER SCIENCE INC,
Objective: To determine whether automated classification
of document citations can be useful in reducing the time spent by experts
reviewing journal articles for inclusion in updating systematic reviews of
drug class efficacy for treatment of disease.
Design: A test collection was built using the annotated reference files
from 15 systematic drug class reviews. A voting perceptron-based automated
citation classification system was constructed to classify each article as
containing high-quality, drug class-specific evidence or not.
Cross-validation experiments were performed to evaluate performance.
Measurements: Precision, recall, and F-measure were evaluated at a range of
sample weightings. Work saved over sampling at 95% recall was used as the
measure of value to the review process.
Results: A reduction in the number of articles needing manual review was
found for 11 of the 15 drug review topics studied. For three of the topics,
the reduction was 50% or greater.
Conclusion: Automated document citation classification could be a useful
tool in maintaining systematic reviews of the efficacy of drug therapy.
Further work is needed to refine the classification system and determine
the best manner to integrate the system into the production of systematic
AUTHOR ADDRESS: AM Cohen, Oregon Hlth & Sci Univ, Sch Med, Dept Med
Informat & Clin Epidemiol, 3181 SW Sam Jackson Pk Rd,Mail
Code BICC, Portland, OR 97239 USA
More information about the SIGMETRICS