Table. 16.

Analysis of the difference between confidence in understanding the concept and confidence in understanding the AI response (questions with no errors in AI responses).

Question Understanding concepts Understanding AI responses Number of students (%) Confidence in response M S.D t p
2 5(3.85) C-UC 3.40 1.140 -3.318* .035
C-UAI 5.00 .000
× 0(0) C-UC - - - -
C-UAI - -
× 78(60.00) C-UC 3.22 1.089 -4.345*** .000
C-UAI 3.83 .710
× 47(36.15) C-UC 3.49 1.120 9.510*** .000
C-UAI 1.57 .500
3 92(70.77) C-UC 3.38 1.015 2.292** .024
C-UAI 2.96 1.309
× 3(2.31) C-UC 3.33 1.528 1.387 .300
C-UAI 1.67 .577
× 29(22.31) C-UC 3.07 1.193 -2.117* .043
C-UAI 3.62 1.083
× 6(4.62) C-UC 3.67 1.751 .889 .415
C-UAI 2.67 1.633
6 21(16.15) C-UC 3.19 1.436 -4.318*** .000
C-UAI 4.57 .676
× 2(1.54) C-UC 3.00 2.828 .500 .705
C-UAI 2.00 .000
× 87(66.92) C-UC 2.76 1.414 -5.670*** .000
C-UAI 3.71 .714
× 20(15.38) C-UC 3.15 1.309 4.459*** .000
C-UAI 1.65 .489
8 47(36.15) C-UC 3.00 1.445 -5.452*** .000
C-UAI 4.19 .798
× 8(6.15) C-UC 3.38 1.302 -1.821 .111
C-UAI 4.13 .991
× 61(46.92) C-UC 2.81 1.258 -2.425* .018
C-UAI 3.41 1.146
× 14(10.77) C-UC 3.07 1.328 1.465 .167
C-UAI 2.29 1.267

○: Correct answer, ×: Wrong answer / C-UC: Confidence in response-Understanding Concepts, C-UAI: Confidence in response-Understanding AI responses (*p<.05, **p<.01, ***p<.001)

New Phys.: Sae Mulli 2024;74:664~677 https://doi.org/10.3938/NPSM.74.664