AINA-KK

Abai, First Word, 1890s

Written by a person.

Unchecked or Falsely Accused?

AI-generated text detectors, tested on Kazakh. A study by Mansur Ozaman.

Under review through ACL Rolling Review, for COLING 2027

Kazakh has written ң in five scripts.

Runes, the Arabic-script töte jazu, Latin, Cyrillic, and Latin again. The AI detectors schools download were built for English.

81.4%

of human-written Kazakh, all of it published before ChatGPT existed, flagged as AI by a public detector.

1.3%

of machine-written Kazakh is caught once the same detectors are retuned to stop accusing people.

Published student essays flagged as AI: 79.6%

Қазақ тіліQazaq tılı

In the 2021 Latin alphabet, machine-written Kazakh slips past every detector that ignores script.

0.9%

of human writing flagged by AINA-KK-Det, the detector built on this benchmark. It reads Ң and Ñ as one letter and still catches 88.8% of machine text from known generators.

A flag can start a conversation. It is not evidence.

  • 3,811human passages, dated before ChatGPT
  • 5,597machine and gray-zone passages
  • 9generators, two built for Kazakh
Mansur OzamanSchool of Computing and Artificial Intelligence, Nazarbayev Universitymansur.ozaman@nu.edu.kz