Analysis of the difference between confidence in understanding the concept and confidence in understanding the AI response (questions with no errors in AI responses).
| Question | Understanding concepts | Understanding AI responses | Number of students (%) | Confidence in response | M | S.D | t | p |
|---|---|---|---|---|---|---|---|---|
| 2 | ○ | ○ | 5(3.85) | C-UC | 3.40 | 1.140 | -3.318 |
.035 |
| C-UAI | 5.00 | .000 | ||||||
| × | 0(0) | C-UC | - | - | - | - | ||
| C-UAI | - | - | ||||||
| × | ○ | 78(60.00) | C-UC | 3.22 | 1.089 | -4.345 |
.000 | |
| C-UAI | 3.83 | .710 | ||||||
| × | 47(36.15) | C-UC | 3.49 | 1.120 | 9.510 |
.000 | ||
| C-UAI | 1.57 | .500 | ||||||
| 3 | ○ | ○ | 92(70.77) | C-UC | 3.38 | 1.015 | 2.292 |
.024 |
| C-UAI | 2.96 | 1.309 | ||||||
| × | 3(2.31) | C-UC | 3.33 | 1.528 | 1.387 | .300 | ||
| C-UAI | 1.67 | .577 | ||||||
| × | ○ | 29(22.31) | C-UC | 3.07 | 1.193 | -2.117 |
.043 | |
| C-UAI | 3.62 | 1.083 | ||||||
| × | 6(4.62) | C-UC | 3.67 | 1.751 | .889 | .415 | ||
| C-UAI | 2.67 | 1.633 | ||||||
| 6 | ○ | ○ | 21(16.15) | C-UC | 3.19 | 1.436 | -4.318 |
.000 |
| C-UAI | 4.57 | .676 | ||||||
| × | 2(1.54) | C-UC | 3.00 | 2.828 | .500 | .705 | ||
| C-UAI | 2.00 | .000 | ||||||
| × | ○ | 87(66.92) | C-UC | 2.76 | 1.414 | -5.670 |
.000 | |
| C-UAI | 3.71 | .714 | ||||||
| × | 20(15.38) | C-UC | 3.15 | 1.309 | 4.459 |
.000 | ||
| C-UAI | 1.65 | .489 | ||||||
| 8 | ○ | ○ | 47(36.15) | C-UC | 3.00 | 1.445 | -5.452 |
.000 |
| C-UAI | 4.19 | .798 | ||||||
| × | 8(6.15) | C-UC | 3.38 | 1.302 | -1.821 | .111 | ||
| C-UAI | 4.13 | .991 | ||||||
| × | ○ | 61(46.92) | C-UC | 2.81 | 1.258 | -2.425 |
.018 | |
| C-UAI | 3.41 | 1.146 | ||||||
| × | 14(10.77) | C-UC | 3.07 | 1.328 | 1.465 | .167 | ||
| C-UAI | 2.29 | 1.267 |
○: Correct answer, ×: Wrong answer / C-UC: Confidence in response-Understanding Concepts, C-UAI: Confidence in response-Understanding AI responses (*