‘No rhyme or reason': AI grading issue affects hundreds of MCAS essaysThe state's testing contractor, Cognia, found roughly 1,400 essays did not receive the correct scores, according to a spokesperson with the Department of Elementary and Secondary Education.
…
Turns out an alert teacher at Reilly Elementary School was reading through her third-grade students' essays over the summer. When the instructor looked up the scores some of the students received, something did not add up.
The teacher notified the school principal, who then flagged the issue with district leaders…"We could not understand why an individual score was scored a zero when it should have gotten six out of seven points," Crocker-Roberge said. "There just wasn't any rhyme or reason to that."
That’s bullshit. MCAS itself is dubious — school funding and reputation are tied to it. Given that, it shouldn’t be graded with a a model that checks basically for similarity. Cognia should be fired. Paying them to only really check 10% of the essays is insane.
Would you want your kid’s essay graded by A.I.? I actually am going to write my state congressman and senator about this.