Paxton P, Bollen KA "Perceived quality and methodology in graduate department ratings: Sociology, political science, and economics" Sociology of Education 76(1):71-88 January 2003

[Eugene Garfield]

E-mail Address: paxton.36 at osu.edu

Author(s): Paxton, P; Bollen, KA

Title: Perceived quality and methodology in graduate department ratings:
       Sociology, political science, and economics

Source: SOCIOLOGY OF EDUCATION, 76 (1): 71-88 JAN 2003

Language: English

Document Type: Article

Abstract: Graduate department ratings help to shape the power and privilege
of a graduate department at its home university, as well as with respect to
other departments in its discipline. Ideally, such ratings would reflect the
perceived quality of a department. Yet frequent critiques suggest that the
ratings fall far short of this ideal. The authors analyzed subjective
ratings in three related disciplines-sociology, political science, and
economics-and from two rating sources: the National Research Council and
U.S. News and World Report. They hypothesized three major components to the
ratings: (1) perceived departmental quality, (2) systematic error owing to
the method of data collection, and (3) random measurement error. Using
structural equation modeling, they found that 20 percent to 30 percent of
the variation in ratings derives from systematic error, most of the rest
comes from perceived quality, and the smallest component is random
measurement error. The authors also found that variables, such as citations
per capita, departmental size, public/private status, and geographic
location, influence ratings through their impact on perceived quality and/or
the systematic errors that enter the ratings.
Addresses: Ohio State Univ, Dept Sociol, Columbus, OH 43210 USA; Univ N
Carolina, Dept Sociol, Howard W Odum Inst Res Social Sci, Chapel Hill, NC
27515 USA

Reprint Address: Paxton, P, Ohio State Univ, Dept Sociol, 300 Bricker
Hall,190 North Oval, Columbus, OH 43210 USA.

Cited References:
*AM COUNC ED, 1997, M U COLL.
ALLISON PD, 2002, MISSING DATA.
ARBUCKLE JL, 1996, ADV STRUCTURAL EQUAT, P243.
BALDI S, 1994, AM SOCIOL, V25, P28.
BALDI S, 1997, AM SOCIOL, V28, P89.
BENDER T, 1998, AM ACAD CULTURE TRAN, P17.
BLAU PM, 1967, AM OCCUPATIONAL STRU.
BOLLEN K, 1989, STRUCTURAL EQUATIONS.
BOLLEN KA, 1989, SOCIOL METHOD RES, V17, P303.
BOLLEN KA, 1998, AM SOCIOL REV, V63, P465.
CAMPBELL DT, 1959, PSYCHOL BULL, V56, P81.
CARTER AM, 1966, ASSESSMENT QUALITY G.
CRANE D, 1965, AM SOCIOL REV, V30, P699.
DOLAN W, 1976, RANKING GAME.
FAIRWEATHER JS, 1988, RES HIGH EDUC, V28, P345.
FEYERABEND P, 1993, AGAINST METHOD.
GALLANT J, 1972, SCIENCE, V175, P385.
GOLDBERGER ML, 1995, RES DOCTORATE PROGRA.
GRAHAM HD, 1999, CHRON HIGHER EDUC, B6.
HAGSTROM WO, 1971, SOCIOL EDUC, V44, P375.
HARGENS LL, 1982, SOCIOL EDUC, V55, P183.
JACOBS D, 1999, SOC SCI RES, V28, P228.
KEITH B, 1998, M AM SOC ASS SAN FRA.
KEITH B, 1998, SOC FORCES, V76, P1495.
KEITH B, 1999, AM EDUC RES J, V36, P409.
KEITH B, 2001, RES HIGH EDUC, V42, P493.
KING S, 1987, RES HIGH EDUC, V27, P99.
KUHN TS, 1962, STRUCTURE SCI REVOLU.
LAWRENCE JK, 1980, 5 AAHEERIC.
LONG JS, 1995, ANNU REV SOCIOL, V21, P45.
MCGUIRE JW, 1988, J HIGH EDUC, V59, P365.
MERTON RK, 1973, SOCIOLOGY SCI THEORE, P267.
SECHREST L, 2000, RES DESIGN D CAMPBEL, P63.
STEIGER JH, 1980, ANN M PSYCH SOC IOW.
TAN DL, 1986, RES HIGH EDUC, V24, P223.
TAYLOR J, 1995, SOCIOLOGY, V29, P513.
TOUTKOUSHIAN RK, 1998, REV HIGH EDUC, V21, P427.
VANDALEN HP, 2001, SCIENTOMETRICS, V50, P455.

Cited Reference Count: 38
Times Cited: 0

Publisher: AMER SOCIOLOGICAL ASSOC
Publisher Address: 1307 NEW YORK AVE NW #700, WASHINGTON, DC 20005-4712 USA
ISSN: 0038-0407
Source Item Page Count: 18
ISI Document Delivery No.: 829JM