Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Sign In to gain access to subscriptions and/or personal tools.
Written Communication
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by JOHNSON, R. L.
Right arrow Articles by GORDON, B.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Score Resolution and the Interrater Reliability of Holistic Scores in Rating Essays

ROBERT L. JOHNSON

University of South Carolina—Columbia

JAMES PENNY

Center for Creative Leadership

BELITA GORDON

University of Georgia

The assessment of students' writing skills through essays is a common practice in educational institutions. Scoring of essays requires considerable judgment on the part of those who rate the response. When raters assign different scores to an essay, testing practitioners must resolve the discrepancy before computing an operational score to report to the examinee. This study investigated five forms of score resolution that were reported in a national survey of state department of education-testing agencies. The study examined the effect that each form of resolution has on the reliability of the resulting operational scores. It is shown that some methods of resolution can be associated with higher interrater reliability than can others. It is also shown that the choice of resolution can affect the magnitude of the reported score as well as the final passing rate of an assessment.

Written Communication, Vol. 18, No. 2, 229-249 (2001)
DOI: 10.1177/0741088301018002003
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Am Educ Res JHome page
K. R. Harris, S. Graham, and L. H. Mason
Improving the Writing, Knowledge, and Motivation of Struggling Young Writers: Effects of Self-Regulated Strategy Development With and Without Peer Support
American Educational Research Journal, January 1, 2006; 43(2): 295 - 340.
[Abstract] [PDF]