Page 128 - BUKU SYNOPSIS

assert that a measure utilized for research would be suitable with an

ICC score of 0.70.

In addition, the researcher also used many facets of the Rasch

model to examine the consistency of scoring between raters. One

advantage of MFRM compared to the conventional approach in

analyzing rating data is its ability to comprehensively

examine similarities and differences in ratings, even when diverse

groups of examinees are involved. In the context of the classical

approach, the assessment of inter rater reliability is commonly

employed when assessing rating data. The inter rater reliability

statistic is considered informative; nevertheless, its capacity to detect

potential rater effects, such as severity bias, is restricted. The MFRM

offers a sound explanation for possible sources of variance in ratings

that may be undesirable, such as severity/leniency or bias (Erguvan

& Dunya, 2020).

b. Qualitative Analysis

The researchers utilized the qualitative data analysis method

developed by Miles et al. (2014) to assess the responses provided by the

lecturers and the students regarding their reflections on the implementation

of the model. The qualitative methodology consists of three stages: 1) data

condensation, 2) data display, and 3) conclusion, drawing, or verification.

123