Page 79 - BUKU SYNOPSIS
P. 79

student  work.  The  rubric  utilizes  a  pre-established  set  of  criteria  to


                                   assess  the  performance  of  an  individual  or  group  of  students  in  a

                                   specific profession or task, hence providing further insights into their

                                   grades. Accordingly, the use of a rubric assists the teacher in delivering


                                   a  more  unbiased  assessment  of  the  educational  accomplishments.


                                   However, it is advisable to employ more than two raters to enhance the

                                   reliability and validity of the measurement (Weigle, 2002).

                                             In  many  cases,  written  essays  or  paragraphs  are  utilized  to


                                   document  the  language  proficiency  of  the  examinee.  Examinees'

                                   writing  performance  is  evaluated  by  completing  an  essay  in  which


                                   construct-response items are assigned rather than selecting the correct

                                   answer from the options provided. They must create a response based


                                   on  the  prompt  provided.  As  previously  indicated,  errors  in  student

                                   assessment  outcomes  can  occur  for  various  reasons,  even  if  the

                                   examiner uses a similar scoring procedure. Some (such as Chan et al.,


                                   2015; Dunsmuir et al., 2015) claim that writing an essay is a subjective

                                   test requiring using more than one rater. As a result, assessing writing


                                   is "a rater-mediated assessment" (Eckes, 2019, p. 16), as it includes the

                                   rater facet and other facets such as examinee, task, and criteria.


                                             The raters play a significant role in the assessment results. Eckes

                                   further  emphasizes  that  the  effects  of  raters,  such  as  severity,  are


                                   generally  viewed  as  sources  of  method  variance  that  threaten  the

                                   validity of the assessment procedure. Thus Linacre (1994) recommends






                                                              74
   74   75   76   77   78   79   80   81   82   83   84