Page 47 - MODUL

The criteria of the instrument validity in this study use a validity degree. It
can be seen in Table 7 as follows.

Table 2. Instrument Validity Criteria
Score Scale Category

85,01% - 100,00% 4 Very Valid, it can be used without revision.
70,01% - 85,00% 3 Sufficient Valid, it can be used with few
revisions.
50,01% - 70,00% 2 Fair Valid, it cannot be used because of lots of
revisions.
01,00% - 50,00% 1 Invalid, it‘s not allowed to use.

The criteria enacted to categorize that the instruments are valid are if those

have the mean score of validity degree in 3 (sufficient valid). Based on the
validity test, those instruments are sufficient valid. It means that the instruments

can be used in the field study. If those are in fair valid or invalid, the researcher do

revisions in line with validators‘ suggestions and comments. Furthermore, the
researcher conducts a revalidation test until those instruments are valid.

b) Reliability

The instruments categorized valid should be sure reliability. Reliability
provides whether the data collection procedure is consistent and accurate. The

researcher applies inter-rater reliability to estimate the consistency and accuracy
of instrument. Howell (Larson-Hall, 2010: 170) states that the best way to

calculate inter-reliability for cases of judges rating person is to look at interclass
correlation and to measure the interclass correlation using percentage of

agreement (PA). The reliability of instruments is measured by minimum score

0.70.
Based on the result of reliability scores, the instruments of questionnaires

are reliable in score 0.74. The instrument of the observation is reliable in score
0.73, the instrument of the writing test is reliable in score 0.73, and the instrument

of the interview is reliable in score 0.73.
4. Data Analysis

There are two data that are collected that are quantitative and qualitative

data. The quantitative and qualitative data were gathered by using instrument of
needs analysis, product validation from some experts, and instructional try-out.

43