Page 182 - BUKU SYNOPSIS
P. 182
between >3% and <8%. The researcher also tested the consistency among
raters by using interrater coefficient correlation (ICC) analysis through
SPSS version 29. The analysis reveals that the Cronbach Alpha is .902
(categorized “excellent”), and ICC is .802 (classified “very good”).
b) Self- Assessment Instrument
During the teaching-learning process, the students firstly assessed
their text followed by their peer assisted guided by the SA and PA
instruments. Both instruments have four scales representing the result of the
students’ text based on their reviews. The validity and reliability of
persons/participants and items from self-assessment instruments are
examined utilizing three output data results from the Rasch Model using
Winstep software.
1) Construct validity
The Rasch model's item fit analyzes the quality of the instrument’s
items to the model. Item fit explains whether or not the instrument items
work properly. The requirement for declaring an item fit is that at least one
item is within the allowed limits, hence the item does not need to be removed
(Sumintono & Widhiarso, 2015; Yudiarso, 2023).
177