Unchecked or Falsely Accused?
AI-generated text detectors, tested on Kazakh. A study by Mansur Ozaman.
Under review through ACL Rolling Review, for COLING 2027
Kazakh has written ң in five scripts.
Runes, the Arabic-script töte jazu, Latin, Cyrillic, and Latin again. The AI detectors schools download were built for English.
81.4%
of human-written Kazakh, all of it published before ChatGPT existed, flagged as AI by a public detector.
1.3%
of machine-written Kazakh is caught once the same detectors are retuned to stop accusing people.
Published student essays flagged as AI: 79.6%
Қазақ тіліQazaq tılı
In the 2021 Latin alphabet, machine-written Kazakh slips past every detector that ignores script.
0.9%
of human writing flagged by AINA-KK-Det, the detector built on this benchmark. It reads Ң and Ñ as one letter and still catches 88.8% of machine text from known generators.
A flag can start a conversation. It is not evidence.
- 3,811human passages, dated before ChatGPT
- 5,597machine and gray-zone passages
- 9generators, two built for Kazakh