Page 79 - BUKU SYNOPSIS
P. 79
student work. The rubric utilizes a pre-established set of criteria to
assess the performance of an individual or group of students in a
specific profession or task, hence providing further insights into their
grades. Accordingly, the use of a rubric assists the teacher in delivering
a more unbiased assessment of the educational accomplishments.
However, it is advisable to employ more than two raters to enhance the
reliability and validity of the measurement (Weigle, 2002).
In many cases, written essays or paragraphs are utilized to
document the language proficiency of the examinee. Examinees'
writing performance is evaluated by completing an essay in which
construct-response items are assigned rather than selecting the correct
answer from the options provided. They must create a response based
on the prompt provided. As previously indicated, errors in student
assessment outcomes can occur for various reasons, even if the
examiner uses a similar scoring procedure. Some (such as Chan et al.,
2015; Dunsmuir et al., 2015) claim that writing an essay is a subjective
test requiring using more than one rater. As a result, assessing writing
is "a rater-mediated assessment" (Eckes, 2019, p. 16), as it includes the
rater facet and other facets such as examinee, task, and criteria.
The raters play a significant role in the assessment results. Eckes
further emphasizes that the effects of raters, such as severity, are
generally viewed as sources of method variance that threaten the
validity of the assessment procedure. Thus Linacre (1994) recommends
74