Cohen’s kappa between prompts P1–P12 and expert scorers H1–H3.
Prompts | H1 | H2 | H3 | Mean |
---|---|---|---|---|
P1 | .21 | .21 | .24 | .22 |
P2 | .18 | .13 | .19 | .17 |
P3 | .22 | .25 | .17 | .21 |
P4 | .28 | .24 | .22 | .25 |
P5 | .34 | .26 | .25 | .28 |
P6 | .17 | .15 | .14 | .15 |
P7 | .27 | .23 | .26 | .25 |
P8 | .16 | .17 | .13 | .15 |
P9 | .19 | .18 | .12 | .16 |
P10 | .17 | .12 | .16 | .15 |
P11 | .22 | .15 | .16 | .18 |
P12 | .20 | .18 | .17 | .18 |
Mean | .22 | .19 | .18 | .20 |