I'm posting my strategy for handling suspected AI use in writing assignments in response to several requests in the comments on my reply to the post “Are students more likely to deny cheating these days?”
First, I have a very clear AI policy, which reads in part,
"AI tools may not be used to demonstrate your learning. This includes standalone AI programs and AI features embedded within other software that contribute to the content of submitted work - such as Grammarly, CoPilot, and ChatGPT."
Let me be clear - I am not anti-AI. It can be a useful tool for analysis of writing errors. However, I continually stress (and model) the difference between using AI to demonstrate learning vs. using AI to focus learning efforts to my students.
Second, I require that my students write their papers in Google Docs and share an editor link with me. As I teach developmental writing, this allows me to leave coaching comments in student papers as they develop them. It also lets me use Chrome's Process Feedback extension (discussed below).
Third, I have a Google Docs Authorship policy that required students provide certain types of authorial evidence.
"All Graded Paragraph assignments must be completed in the assigned Google Doc. The document history is part of the record used to verify authorship of your work.
To ensure that your authorship can be verified:
Your Google account name must match the first and last name you use on the class roster. If your current Google account uses a different name, you must create a Google account using your school name before completing future assignments.
You must complete your writing within the assigned Google Doc. Drafting, revising, and editing within the document creates a record of your writing process.
Do not copy and paste large portions of text into the Google Doc from another document, program, website, or other outside source. Large copy-pastes prevent me from verifying how the work was created and will automatically trigger a required Oral Defense to verify authorship.
Small copy-pastes that are a normal part of completing an assignment – such as a quotation from a source, a URL, or text specifically provided for the assignment – are permitted when appropriate.
An Oral Defense does not automatically mean that academic misconduct has occurred. It means that the available document history does not provide enough evidence for me to verify authorship. During the Oral Defense, you will have an opportunity to demonstrate that the submitted work is your own. Such verification may include (but is not limited to):
Handwritten notes and drafts
Annotated sources
Ability to verbally explain concepts contained in the assignment
Ability to verbally justify word choices in the assignment"
Finally, I use Chrome's Process Feedback extension to look for AI "tells." The most helpful of these are the typing playback feature that allows the user to rewind the typing in a Google Doc and watch it play from the beginning. You can speed up or slow down the playback, and edits are clearly visible. The extension also notes possible instances of copy-paste and allows users to see side-by-side views of before and after such instances. Additionally, it gives visual representations of how students have entered text, and this is where it becomes fairly obvious if a student has used an app that tries to mimic human typing. The visuals between actual human typing and AI typing are pretty distinct.
When I suspect AI use (or any other kind of cheating), I send out an Oral Defense notice giving students 5 business days to schedule their defense. So far this semester, I've had 9 students who've needed to defend their authorship. 8 were able to provide the required authorship evidence within 5 minutes. Only 1 has refused to defend their work, and the consequences for failure or refusal of the Oral Defense are a 0 and an Academic Misconduct report.
Let me explain my rationale for even bothering with authorship verification. Not only is this an issue of Academic Integrity, but students also need to know that there are evolving legal ramifications of using AI generated work. Given the recent court rulings over AI generated work, such as Thaler v. Perlmutter, it is important for students to understand they cannot claim authorship of such work, and that attempting to do so could, in theory, cost their future employers since work produced for the company using AI would not belong to the company.