Page 182 - BUKU SYNOPSIS
P. 182

between >3% and <8%. The researcher also tested the consistency among


                                  raters by using interrater coefficient correlation (ICC) analysis through

                                  SPSS version 29. The analysis reveals that the Cronbach Alpha is .902

                                  (categorized “excellent”), and ICC is .802 (classified “very good”).





                             b)  Self- Assessment Instrument



                                      During the teaching-learning process, the students firstly assessed

                               their  text  followed  by  their  peer  assisted  guided  by  the  SA  and  PA


                               instruments. Both instruments have four scales representing the result of the

                               students’  text  based  on  their  reviews.  The  validity  and  reliability  of


                               persons/participants  and  items  from  self-assessment  instruments  are

                               examined utilizing three output data results from the Rasch Model using


                               Winstep software.


                                1)  Construct validity


                                      The Rasch model's item fit analyzes the quality of the instrument’s


                               items to the model. Item fit explains whether or not the instrument items

                               work properly. The requirement for declaring an item fit is that at least one


                               item is within the allowed limits, hence the item does not need to be removed

                               (Sumintono & Widhiarso, 2015; Yudiarso, 2023).













                                                              177
   177   178   179   180   181   182   183   184   185   186   187