Page 167 - BUKU SYNOPSIS

relied upon. MFRM aids the researcher in ensuring the quality of rating

across raters. The percentage of opportunities for inter-rater agreement

based on MFRM is 80.0%, which is close to the expected value of 54.5%.

According to Sumintono, excellent inter-rater agreement is between >30%

and 80%. The researcher also tested the consistency among raters by using

interrater coefficient correlation (ICC) analysis through SPSS version 29.

The analysis reveals that the Cronbach Alpha is .829 (categorized

“excellent”), and ICC is .707 (classified “good”).

5. The Revision of the Initial Products

The multipurpose assessment model's products are a set of assessment

packages with supporting devices (a lesson plan and students worksheet) and

book of guidelines) in blended learning of writing text were revised through

two stages: validation and field testing. The former, after the completion of

validation activities, revisions were made to the design of the multipurpose

assessment model utilized in blended learning for writing text. The researcher

got ideas for changes from the validators based on the validation results.

These comments were either specified in the validation sheet or written

directly on the validated document. The recommendations for enhancements

have been changed and elaborated upon in section 4, specifically focusing on

the initial products. The researcher conducted a comprehensive evaluation of

the design of the generated model, examining the theoretical foundations and

references utilized in its development and subsequent enhancements.

162