The Effectiveness of Free Software for Detecting AI-Generated Writing

Abstract

As artificial intelligence (AI) technology advances, educators are faced with the challenge of detecting AI-generated writing in student assignments. This study explores the effectiveness of freely available AI detection software in identifying AI-generated content and its implications for teacher evaluation of student work. The research involved Japanese university students who used AI for English writing assignments. We compared our manual analysis with results from five different free AI writing detectors. The findings reveal the limitations of free AI detection tools and the need for cautious use in educational settings.