Do AI Detectors Work for ChatGPT? It's Complicated. OpenAI released a teacher's guide for ChatGPT ahead of back-to-school season. However, the company had bad news for teachers hoping to better catch students cheating by using the AI chat bot.
Key Takeaways
- OpenAI's guide for teachers on using ChatGPT in the classroom addresses concerns about cheating and provides tips for lesson planning and assessment.
- AI cheating detectors are currently unreliable, as they struggle to distinguish between AI-generated and human-generated content.
Opinions expressed by BIZ Experiences contributors are their own.
With school back in session, OpenAI is chiming in with a guide for teachers on how to use the now widely popular ChatGPT tool in the classroom.
Since the prompt-driven chatbot was released last November, educators have sounded alarms about the tool's power to be used for cheating or as a shortcut to essay writing and other assignments.
While the guide for educators gives tips on how to use the technology for lesson planning, crafting quizzes, and generating examples, OpenAI has some bad news on the question of whether AI cheating detectors work: "In short, no," the company writes in the FAQ section.
Related: Authors Are Suing OpenAI Because ChatGPT Is Too 'Accurate' — Here's What That Means
"While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human-generated content," the company added.
Furthermore, when prompted with text and asked if "ChatGPT wrote this" or whether the content could have been written by AI, OpenAI says the responses are "random and have no basis in fact." The company added that when training the program, it was given text by Shakespeare and the Declaration of Independence, which is subsequently labeled as AI-generated.
OpenAI says it will continue to "provide resources and insights" in the cheating sphere, but in the meantime, it suggests a counter approach: accept students are using the tool, and require them to submit it as part of their work.
"Sharing interactions with the model ensures that students are held accountable for the way they use AI in their work," OpenAI added. "Educators can verify that students are engaging with the tool responsibly and meaningfully, rather than simply copying answers."
Related: We Will Inevitably Lose Skills to AI, But Do The Benefits Outweigh The Risks?
ChatGPT has been subject to ongoing concern since its launch, with ongoing lawsuits from authors claiming that OpenAI used copyrighted material to train the chatbot, lawyers facing ridicule for using the technology in writing briefs, and even OpenAI CEO Sam Altman himself saying government intervention is "crucial" as the world embarks on expanding use of artificial intelligence.
BIZ Experiences has reached out to OpenAI for comment.
